How to Create a Root Domain by Assigning a PCIe Bus
This example procedure shows how to create a new root domain from an initial configuration where several buses are owned by the primary
domain. By default the primary
domain owns all buses present on the system. This example is for a SPARC T4-2 server. This procedure can also be used on other servers. The instructions for different servers might vary slightly from these, but you can obtain the basic principles from this example.
Note:
Do not add independent root domains to the following system types:-
Single-bus systems. Such systems, like a SPARC T4-1 server, can use only the
primary
domain as a root domain. -
Some smaller multi-bus systems. Systems such as SPARC S7-2 and SPARC S7-2L servers have built-in cards that communicate only with a single bus and cannot be split across multiple buses. To create a second root domain, you must install additional cards to ensure that each root domain has a network interface and a boot disk.
Ensure that you do not remove the PCIe buses that host the boot disk and primary network interface from the primary
domain.
Caution:
All internal disks on the supported servers might be connected to a single PCIe bus. If a domain is booted from an internal disk, do not remove that bus from the domain. Ensure that you do not remove a bus that has devices that are used by a domain, such as network ports orusbecm
devices. If you remove the wrong bus, a domain might not be able to access the required devices and could become unusable. To remove a bus that has devices that are used by a domain, reconfigure that domain to use devices from other buses. For example, you might have to reconfigure the domain to use a different on-board network port or a PCIe card from a different PCIe slot.
On certain SPARC servers, you can remove a PCIe bus that contains USB, graphics controllers, and other devices. However, you cannot add such a PCIe bus to any other domain. Such PCIe buses can be added only to the primary
domain.
In this example, the primary
domain uses only a ZFS pool (rpool
) and network interface (igb0
). If the primary
domain uses more devices, repeat Steps 2-4 for each device to ensure that none are located on the bus that will be removed.
You can add a bus to or remove a bus from a domain by using its device path (pci@
nnn) or its pseudonym (pci_
n). The ldm list-bindings primary
or ldm list -l -o physio primary
command shows the following:
-
pci@400
corresponds topci_0
-
pci@500
corresponds topci_1
-
pci@600
corresponds topci_2
-
pci@700
corresponds topci_3