11 Servicing PCIe Cards
This section describes how to service PCIe cards and PCIe Risers.
PCIe cards and PCIe risers are replaceable components that require you to power off the server before servicing. Foot 1
For more information about replaceable components, see Illustrated Parts Breakdown and Replaceable Components. For complete software and cabling information about your card, refer to your PCIe card documentation. For a complete list of supported PCIe cards, see Product Description.
Caution:
These procedures require that you handle components that are sensitive to electrostatic discharge. This sensitivity can cause the components to fail. To avoid damage, ensure that you follow antistatic practices as described in Electrostatic Discharge Safety.Caution:
Ensure that all power is removed from the server before removing or installing PCIe cards. You must disconnect all power cables from the system before performing these procedures.PCIe Slot Locations
The server is designed to support both full height and low profile PCIe cards. Using PCIe risers, the full height PCI slot configuration supports up to 4 full height and 2 half height PCIe cards. The 9-slot PCIe half height configuration supports up to 9 half height PCIe cards. See Back Panel Components for PCIe slot numbering and supported PCIe configurations.
- All card slots support Half Height, Half Length (HHHL) PCIe cards (Low profile short) at PCIe Gen4 or Gen5.
- Four riser card slots support Full Height, Full Length (FHFL) PCIe cards at PCIe Gen5.
- All PCIe card slots are 75W capable slots. All of the PCIe slots comply with the PCI Express 5.0 specification and can accommodate 75 Watt PCIe cards.
- All PCIe card slots support persistent power.
- All Add-in-Card (AIC) slots support Hot-Plug. Foot 2
- PCIe card slots 1 through 4 are nonfunctional in single-processor systems.
- The Full Height card chassis configuration uses two PCIe riser cards supporting two Full height 10.5 inch double width GPU cards at x16 PCIe Gen4.
- Each riser also supports a PCIe Gen3 Pensando Ortano/Elba Server Adapter, DSC-200V, 2x200GbE, Dual QSFP56 Smart NIC card.
- PCIe Gen5 card slots can be up to four x16 PCIe slots, or up to six x8 PCIe slots, depending upon the PCIe card slots 6 and 7 motherboard cabling option.
- Full Height PCIe card risers support a 150W SmartNIC in slots 4 and 8, and a 400W GPU in slots 2 and 6.
Remove a Half Height PCIe Card
Install a Half Height PCIe Card
Remove a Full Height PCIe Card
Note:
Before replacing or installing a PCIe card, refer to the card documentation for specific installation and cabling instructions.Install a Full Height PCIe Card
If you are installing a x16 PCIe card in Riser 6, you must install the motherboard PCIe Flyover cable in to slot 6 to enable support for a PCIe x16 electrical interface; otherwise, slot 6 supports only a PCIe x8 electrical interface. See Configure PCIe Electrical Interfaces Using the PCIe Flyover Cable.
Configure PCIe Electrical Interfaces Using the PCIe Flyover Cable
Using the PCIe Flyover cable, server PCIe slots 6 and 7 can be configured to support either a PCIe x16 (slot 6) or PCIe x8 (slot 7) electrical interface. PCIe slot 6 supports a PCIe x8 electrical interface and PCIe slot 7 is non-functional when the PCIe Flyover PCIe cable is not installed in the server. Installing the cable in slot 6 configures the slot as a PCIe x16 electrical interface. Installing the cable in slot 7 configures the slot as a PCIe x8 electrical interface.
Note:
The PCIe Flyover cable is factory installed in either PCIe slot 6 or slot 7. You must switch the cable to the desired PCIe slot prior to installing a PCIe card or PCIe Riser 6.Remove the PCIe Flyover Cable
Install the PCIe Flyover Cable
Footnote Legend
Footnote 1: Hot-Plug support is limited to Exadata storage node configurations only.Footnote 2: Hot-Plug support is limited to Exadata storage node configurations only.