The InfiniBand (IB) fabric connects together the IB switches and the servers listed below in Oracle SuperCluster T5-8. For IB cable information, see Identifying InfiniBand Fabric Connections.
The Ethernet Management Switch also connects to the servers listed below. For 1 Gb/s Cat 5E cabling information, see Ethernet Management Switch Connections.
The following figures are in this section:
Sun Datacenter InfiniBand Switch 36 (Figure 24):
IB Spine Switch (slot U1)
IB Leaf Switch No. 1 (slot U26)
IB Leaf Switch No. 2 (slot U32)
SPARC T5-8 servers (Figure 25, Figure 26, and Figure 27):
SPARC T5-8 No. 1 (slot 10)
SPARC T5-8 No. 2 (slot 18)
ZFS storage controllers (Figure 28):
ZFS storage controller No. 1 (slot 33)
ZFS storage controller No. 2 (slot 34)
Exadata Storage Servers (Figure 29):
Exadata Storage Server No. 1 (slot 2)
Exadata Storage Server No. 2 (slot 4)
Exadata Storage Server No. 3 (slot 6)
Exadata Storage Server No. 4 (slot 8)
Exadata Storage Server No. 5 (slot 35) (Full Rack only)
Exadata Storage Server No. 6 (slot 37) (Full Rack only)
Exadata Storage Server No. 7 (slot 39) (Full Rack only)
Exadata Storage Server No. 8 (slot 41) (Full Rack only)
The Ethernet Management Switch (Figure 30)
PDU circuit breakers and AC sockets (Figure 31)
Figure 24 Sun Datacenter InfiniBand Switch 36
1 NET MGT 0 and NET MGT 1 ports
2InfiniBand ports 0A-17A (upper ports)
3InfiniBand ports 0B-17B (lower ports)
Figure 25 SPARC T5-8 Server Card Locations (Full Rack)
1 Dual-port 10 GbE network interface cards, for connection to the 10 GbE client access network
2Dual-port InfiniBand host channel adapters, for connection to the InfiniBand network
Figure 26 SPARC T5-8 Server Card Locations (Half Rack)
1 Dual-port 10 GbE network interface cards, for connection to the 10 GbE client access network
2Dual-port InfiniBand host channel adapters, for connection to the InfiniBand network
Figure 27 NET MGT and NET0-3 Port Locations on the SPARC T5-8 Server
1 NET MGT port, for connection to Oracle ILOM management network
2NET0-NET3 ports, for connection to 1 GbE host management network
Figure 28 ZFS Storage Controller
1 Power supply 1
2Power supply 2
3System status LEDs
4Serial management port
5Service processor network management port
6Gigabit Ethernet ports NET 0, 1, 2, 3
7USB ports 0, 1
8HD15 video connector
Figure 29 Exadata Storage Server
1 Power supply 1
2Power supply 2
3System status LEDs
4Serial management port
5Service processor network management port
6Gigabit Ethernet ports NET 0, 1, 2, 3
7USB ports 0, 1
8HD15 video connector
Figure 30 Ethernet Management Switch (Cisco Catalyst 4948 Ethernet Switch)
1 Indicators and reset switch
2Ports 1-16, 10/100/1000BASE-T Ethernet
3Ports 17-32, 10/100/1000BASE-T Ethernet
4Ports 33-48, 10/100/1000BASE-T Ethernet
5CON (upper), MGT (lower)
6Ports 45-48, 10-Gigabit Ethernet
Figure 31 Circuit Breakers and AC Sockets on the PDU
1 PDU A
2PDU B