Domain Resources
The amount of CPU, memory, and network resources available for domains depends on the SuperCluster model and the domain configuration that is set up during the initial installation.
This figure depicts how the CPU and memory resources are made available for the creation of domains. The figure represents one compute node on a SuperCluster T5-8 or one PDomain on a SuperCluster M6-32.
Domains are assigned resources from repositories. This enables domains to be configured with more CPU and memory than what is available from a single Root Domain, as long as there are adequate CPU and memory resources available from the repositories of the compute node.
If a domain is deleted, the resources are returned to the repositories.
The resources in the repositories are dictated by these activities:
-
During installation – If Root Domains are configured, the majority of the Root Domain CPU and memory resources are automatically parked in the CPU and memory repositories.
A small number of CPU and memory resources are reserved for the Root Domain itself.
IB and 10GbE interfaces are made available to domains in the form of a virtual function (VF) created from the physical devices in each Root Domain. These physical devices—IB HCAs and 10GbE NICs— are referred to as physical functions (PFs). Multiple VFs are created from each PF for use by domains, and each VF operates in the same way as the underlying physical device from which it is created.
-
During subsequent configuration – You can use the osc-setcoremem utility to park CPU and memory resources from dedicated domains. The parked resources are placed in the CPU and memory repositories, making them available for domains. Depending on the version of SuperCluster software, parked resources have these conditions:
-
SuperCluster version 2.6 (or earlier) – After you create I/O Domains, any parked dedicated domain resources cannot be returned to the dedicated domains.
-
SuperCluster version 3.0 (or later) – After you create I/O Domains, you can use osc-setcoremem to unpark resources, returning the resources to dedicated domains.
-