1. Extending and Multi-Rack Cabling Guide
  2. Multi-Rack Cabling Tables for Oracle Exadata Rack Models with InfiniBand Network Fabric (X2 to X8)
  3. Understanding Multi-Rack Cabling for Racks with InfiniBand Network Fabric
  4. Cabling Oracle Exadata Quarter Racks and Oracle Exadata Eighth Racks with InfiniBand Network Fabric

6.1.2 Cabling Oracle Exadata Quarter Racks and Oracle Exadata Eighth Racks with InfiniBand Network Fabric

Oracle Exadata Quarter Racks and Oracle Exadata Eighth Racks with InfiniBand Network Fabric can be cabled as follows:

  • Oracle Exadata Quarter Rack to Oracle Exadata Quarter Rack

  • Oracle Exadata Quarter Rack to Oracle Exadata Half Rack, or multiple Oracle Exadata Half Racks or Oracle Exadata Full Racks

  • Oracle Exadata Quarter Rack to Oracle Exadata Full Rack, or multiple Oracle Exadata Full Racks or Oracle Exadata Half Racks

  • Oracle Exadata Eighth Rack to Oracle Exadata Eighth Rack

  • Oracle Exadata Eighth Rack to Oracle Exadata Half Rack, or multiple Oracle Exadata Half Racks or Oracle Exadata Full Racks

  • Oracle Exadata Eighth Rack to Oracle Exadata Full Rack, or multiple Oracle Exadata Full Racks or Oracle Exadata Half Racks

Note:

  • To cable additional Oracle Exadata Quarter Racks or Oracle Exadata Eighth Racks, it is necessary to purchase additional Sun Datacenter InfiniBand Switch 36 switches.

  • It is assumed that four of the six ports dedicated for external connectivity in Oracle Exadata Half Rack or Oracle Exadata Full Rack are unused and available for switch interconnections with Oracle Exadata Quarter Rack or Oracle Exadata Eighth Rack. The six ports are 5B, 6A, 6B, 7A, 7B, and 12A in each leaf switch.

The following graphic shows the cable connections for two Oracle Exadata Quarter Racks. The leaf switches within each rack maintain their existing seven connections. The leaf switches interconnect between the racks with two links each using the ports reserved for external connectivity.

Figure 6-5 Leaf Switch Connections Between 2 Quarter Racks

Description of Figure 6-5 follows
Description of "Figure 6-5 Leaf Switch Connections Between 2 Quarter Racks"

The following graphic shows the cable connections from Oracle Exadata Quarter Rack to Oracle Exadata Half Rack or Oracle Exadata Full Rack. The leaf switches within each rack maintain their existing seven connections. The leaf switches interconnect between the racks with two links each using the ports reserved for external connectivity.

Figure 6-6 Leaf and Spine Switch Connections Between a Quarter Rack and a Half or Full Rack

Description of Figure 6-6 follows
Description of "Figure 6-6 Leaf and Spine Switch Connections Between a Quarter Rack and a Half or Full Rack"

The following graphic shows the cable connections from Oracle Exadata Quarter Rack to two or more racks. The racks that connect to Oracle Exadata Quarter Rack must be all Oracle Exadata Half Racks or Oracle Exadata Full Racks, interconnected using a fat-tree topology. Each leaf switch in Oracle Exadata Quarter Rack connects to the spine switches in the other half racks or full racks with two links each. If there are more than four racks, then use one link instead of two. The seven inter-switch links between the leaf switches in the quarter rack are removed.

Figure 6-7 Leaf and Spine Switch Connections for a Quarter Rack Connected to One or More Half or Full Racks

Description of Figure 6-7 follows
Description of "Figure 6-7 Leaf and Spine Switch Connections for a Quarter Rack Connected to One or More Half or Full Racks"

Parent topic: Understanding Multi-Rack Cabling for Racks with InfiniBand Network Fabric