Go to main content

SPARC T7-4 Server Service Manual

Exit Print View

Updated: February 2019
 
 

Understanding PCIe Root Complex Connections

All 16 PCIe slots support PCIe cards with the following characteristics:

  • Hot-plug low-profile adapters

  • x8 Gen1, x8 Gen2, and x8 Gen3 cards

In addition, the following PCIe slots support x16 Gen3 cards at full bandwidth:

  • Slot 3

  • Slot 4

  • Slot 7

  • Slot 8

  • Slot 11

  • Slot 12

  • Slot 15

  • Slot 16

A root complex is the CMP circuitry that provides the base to a PCIe I/O fabric. Each PCIe I/O fabric consists of the PCIe switches, PCIe slots, and leaf devices associated with the root complex. Understanding the relationship of the PCIe root complexes to the PCIe I/O fabrics will help you properly assign devices when configuring Oracle VM Server for SPARC logical domains.

image:Illustration showing dual PM root complex topology.

This diagram illustrates the root complex connections between the four CPUs and the 16 PCIe I/O slots. Each CPU supports all I/O root complex fabrics. In single-PM configurations, all PCIe slots are available. In addition, all 16 PCIe slots are still available even if PM1 goes offline.

The port ID values shown in the diagram correspond to the pci@ values reported in the showdevs command output.

PCIe Slot
Device Path
MR
IOS
RP
Maximum bandwidth
Slot 1
/pci@305/pci@2
MR0
0
1
x8
Slot 2
/pci@305/pci@1
MR0
0
0
x8
Slot 3
/pci@306/pci@1
MR0
3
0
x16
Slot 4
/pci@307/pci@1
MR0
2
0
x16
Slot 5
/pci@308/pci@2
MR1
0
1
x8
Slot 6
/pci@308/pci@1
MR1
0
0
x8
Slot 7
/pci@309/pci@1
MR1
3
0
x16
Slot 8
/pci@30a/pci@1
MR1
2
0
x16
Slot 9
/pci@30b/pci@2
MR2
0
1
x8
Slot 10
/pci@30b/pci@1
MR2
0
0
x8
Slot 11
/pci@30c/pci@1
MR2
3
0
x16
Slot 12
/pci@30d/pci@1
MR3
1
0
x16
Slot 13
/pci@30e/pci@2
MR3
0
1
x8
Slot 14
/pci@30e/pci@1
MR3
0
0
x8
Slot 15
/pci@30f/pci@1
MR3
3
0
x16
Slot 16
/pci@310/pci@1
MR3
2
0
x16

If you are reviewing root complex changes after adding a second processor module, return to Server Upgrade Process.

Related Information