4 Multi-Rack Cabling Tables for Oracle Exadata X9M and Later Models

This section contains multi-rack cabling tables for Oracle Exadata X9M and later models, which use RoCE Network Fabric.

• Understanding Multi-Rack Cabling for X9M and Later Model Racks
  Up to 14 racks (X9M and later models) can be cabled together without external RDMA Network Fabric switches.
• Preparing for Multi-Rack Cabling with X9M and Later Model Racks
  
• Two-Rack Cabling for X9M and Later Model Racks
  
• Three-Rack Cabling for X9M and Later Model Racks
  
• Four-Rack Cabling for X9M and Later Model Racks
  
• Five-Rack Cabling for X9M and Later Model Racks
  
• Six-Rack Cabling for X9M and Later Model Racks
  
• Seven-Rack Cabling for X9M and Later Model Racks
  
• Eight-Rack Cabling for X9M and Later Model Racks
  
• Nine-Rack Cabling for X9M and Later Model Racks
  
• Ten-Rack Cabling for X9M and Later Model Racks
  
• Eleven-Rack Cabling for X9M and Later Model Racks
  
• Twelve-Rack Cabling for X9M and Later Model Racks
  
• Thirteen-Rack Cabling for X9M and Later Model Racks
  
• Fourteen-Rack Cabling for X9M and Later Model Racks
  

4.1 Understanding Multi-Rack Cabling for X9M and Later Model Racks

Up to 14 racks (X9M and later models) can be cabled together without external RDMA Network Fabric switches.

To interconnect multiple racks, each rack must contain three RDMA Network Fabric switches.

Two of the switches, known as leaf switches, connect to all of the database servers and storage servers in the rack. The leaf switches are located as follows:

• At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata X9M-2 and later models).

• At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

The third switch, known as the spine switch, interconnects the leaf switches in a multi-rack configuration. The spine switch is located at rack unit 1 (U1). If any rack does not include a spine switch, then order the expansion switch kit.

The procedures in this section assume the racks are adjacent to each other, standard routing in raised floor is used, and there are no obstacles in the raised floor. If these assumptions are not correct for your environment, then longer cables may be required for the connections.

Note:

By default, Oracle Exadata Database Machine racks do not include spare cables or a third RoCE Network Fabric switch. To extend these racks, you must order the required cables and RoCE Network Fabric switch.

The following diagram shows the default RDMA Network Fabric architecture for a single-rack system. Each rack has two leaf switches, with eight connections between the leaf switches. The database servers and storage servers are each connected to both leaf switches. Each server contains a dual-port RDMA Network Fabric card, with port 1 connected to the lower leaf switch and port 2 connected to the upper leaf switch.

Description of the illustration single_rack_rdma_fabric.eps

To connect up to 14 racks (X9M and later models) together, use the following general approach:

1. Remove the eight existing inter-switch connections between the leaf switches on each rack.

2. From each leaf switch, evenly distribute 14 connections to the spine switches in all of the interconnected racks.

   The 14 connections use the 8 ports that were previously used for the inter-switch connections and 6 additional free ports on each leaf switch.

Note:

For X9M-8 systems with three database servers and 11 storage servers only, the database servers and storage server require 23 leaf switch ports, which leaves only 13 inter-switch links on each leaf switch. Consequently, these systems are limited to a maximum of 13 interconnected racks.

The resulting RoCE Network Fabric for a typical 2 rack system is illustrated in the following diagram:

Description of the illustration x9m-2-rack-overview.eps

As shown in the preceding diagram, every leaf switch has 7 connections to every spine switch. The leaf switches are not directly interconnected with other leaf switches, and the spine switches are not directly interconnected with each other.

As the number of racks increases, the inter-switch connections from every leaf switch are evenly distributed to all of spine switches.

4.2 Preparing for Multi-Rack Cabling with X9M and Later Model Racks

Racks can be added together to increase system capacity and performance. When cabling racks together, note the following:

• The cable lengths shown in this document assume the racks are adjacent to each other. If the racks are not adjacent, or there are obstacles in the raised floor, or if you use overhead cabling, then longer cables may be required. For optical cables, the maximum supported cable length is 100 meters. For copper cables, the maximum supported cable length is 5 meters.

• Oracle recommends that the names for the servers include the rack unit number. This helps identify the server during diagnostics.

• When completing Oracle Exadata Deployment Assistant (OEDA) for the additional rack, you are prompted for SCAN addresses. However, these SCAN addresses are not used because the SCAN address from the original rack are used. Manually remove the new SCAN addresses from the generated installation files.

• The software owner account names and group names, as well as their identifiers, must match the names and identifiers of the original rack.

• If the additional grid disks are used with existing disk groups, then ensure the grid disk sizes for the new rack are the same as the original rack.

• For multi-rack configurations containing up to 14 racks, a spine switch must exist in each rack in order to interconnect the RoCE Network Fabric.

Perform the following tasks before cabling racks together:

1. Determine the number of racks that will be cabled together.

2. Order the parts needed to connect the racks.

   To extend Oracle Exadata racks with RoCE Network Fabric, for each rack being added you must order extra cables, transceivers for longer cables, and a RoCE Network Fabric spine switch, if one is required.

   When connecting four or more racks, or if you need longer cables for your environment, you must purchase additional 10 meter or 15 meter fiber cables with two QSFP28 SR transceivers to connect each end. The QSFP28 SR transceivers are needed for fiber cables over 5 meters in length.

   For multi-rack configurations containing up to 14 racks, the following table outlines the cables needed to interconnect the racks:

   Number of Racks	3 Meter Cables Required	5 Meter Cables Required	10 Meter Cables Required	15 Meter Cables Required
   2	28	28	0	0
   3	28	56	0	0
   4	28	71	13	0
   5	28	78	34	0
   6	28	87	53	0
   7	28	88	80	0
   8	28	91	105	0
   9	28	94	130	0
   10	28	95	151	6
   11	28	97	168	15
   12	28	99	184	25
   13	28	100	196	40
   14	28	100	204	60

3. Gather the following tools:

   • Pen
   • Note pad
   • Flashlight
   • Labels for cables and rack
   • Cable ties (Oracle recommends hook and loop straps)

4. Determine a naming method for the rack prefixes. For example, if the original rack has the prefix dbm01, then use the prefix dbm02 for the second rack, the prefix dbm03 for the third rack, and so on.

5. Verify that the racks have unique host names and IP addresses. All servers interconnected in the racks must have unique names and IP addresses.

   Server name and IP address conventions may differ in the following cases:

   • Initial installation of all Oracle Exadata Racks: System address assignments and host names should be complete.

   • New Oracle Exadata Racks are added to an existing cluster: The new rack configuration should require unique host names and IP addresses for the new Oracle Exadata. The IP addresses on the same subnet cannot conflict with the existing systems.

   • Two existing Oracle Exadata Racks are clustered together: You can assign host names and IP addresses only if Oracle Exadata racks are already assigned unique host names and IP addresses, or the entire cluster must be reconfigured. The machines must be on the same subnet and not have conflicting IP addresses.

6. Ensure the IP addresses for the new servers are in the same subnet, and do not overlap with the currently-installed servers.

7. Check that the firmware on the original switches is at the same level as the new switches by using the sh ver command.

   It is highly recommended, though not mandatory, to use the same firmware version on all of the switches. If the firmware is not at the same level, you can apply a firmware patch to bring the switches up to the same firmware level.

The remaining topics in this section provide detailed cabling information for cabling up to 14 racks together.

4.3 Two-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect two racks, both of which use RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a two-rack system.

Table 4-1 Leaf Switch Connections for the First Rack in a Two-Rack System

Switch Pair	Connections	Cable Length
R1UL to R1SS	R1UL-P1 to R1SS-P21 R1UL-P2 to R1SS-P23 R1UL-P3 to R1SS-P25 R1UL-P4 to R1SS-P9 R1UL-P5 to R1SS-P5 R1UL-P6 to R1SS-P11 R1UL-P7 to R1SS-P7	3 meters
R1UL to R2SS	R1UL-P30 to R2SS-P9 R1UL-P31 to R2SS-P5 R1UL-P32 to R2SS-P11 R1UL-P33 to R2SS-P7 R1UL-P34 to R2SS-P21 R1UL-P35 to R2SS-P23 R1UL-P36 to R2SS-P25	5 meters
R1LL to R1SS	R1LL-P1 to R1SS-P27 R1LL-P2 to R1SS-P29 R1LL-P3 to R1SS-P31 R1LL-P4 to R1SS-P17 R1LL-P5 to R1SS-P13 R1LL-P6 to R1SS-P19 R1LL-P7 to R1SS-P15	3 meters
R1LL to R2SS	R1LL-P30 to R2SS-P17 R1LL-P31 to R2SS-P13 R1LL-P32 to R2SS-P19 R1LL-P33 to R2SS-P15 R1LL-P34 to R2SS-P27 R1LL-P35 to R2SS-P29 R1LL-P36 to R2SS-P31	5 meters

Table 4-2 Leaf Switch Connections for the Second Rack in a Two-Rack System

Switch Pair	Connections	Cable Length
R2UL to R1SS	R2UL-P1 to R1SS-P22 R2UL-P2 to R1SS-P24 R2UL-P3 to R1SS-P26 R2UL-P4 to R1SS-P10 R2UL-P5 to R1SS-P6 R2UL-P6 to R1SS-P12 R2UL-P7 to R1SS-P8	5 meters
R2UL to R2SS	R2UL-P30 to R2SS-P10 R2UL-P31 to R2SS-P6 R2UL-P32 to R2SS-P12 R2UL-P33 to R2SS-P8 R2UL-P34 to R2SS-P22 R2UL-P35 to R2SS-P24 R2UL-P36 to R2SS-P26	3 meters
R2LL to R1SS	R2LL-P1 to R1SS-P28 R2LL-P2 to R1SS-P30 R2LL-P3 to R1SS-P32 R2LL-P4 to R1SS-P18 R2LL-P5 to R1SS-P14 R2LL-P6 to R1SS-P20 R2LL-P7 to R1SS-P16	5 meters
R2LL to R2SS	R2LL-P30 to R2SS-P18 R2LL-P31 to R2SS-P14 R2LL-P32 to R2SS-P20 R2LL-P33 to R2SS-P16 R2LL-P34 to R2SS-P28 R2LL-P35 to R2SS-P30 R2LL-P36 to R2SS-P32	3 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-3 Two-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R1UL-P7	3 meters
R1SS-P8	R2UL-P7	5 meters
R1SS-P9	R1UL-P4	3 meters
R1SS-P10	R2UL-P4	5 meters
R1SS-P11	R1UL-P6	3 meters
R1SS-P12	R2UL-P6	5 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R1LL-P7	3 meters
R1SS-P16	R2LL-P7	5 meters
R1SS-P17	R1LL-P4	3 meters
R1SS-P18	R2LL-P4	5 meters
R1SS-P19	R1LL-P6	3 meters
R1SS-P20	R2LL-P6	5 meters
R1SS-P21	R1UL-P1	3 meters
R1SS-P22	R2UL-P1	5 meters
R1SS-P23	R1UL-P2	3 meters
R1SS-P24	R2UL-P2	5 meters
R1SS-P25	R1UL-P3	3 meters
R1SS-P26	R2UL-P3	5 meters
R1SS-P27	R1LL-P1	3 meters
R1SS-P28	R2LL-P1	5 meters
R1SS-P29	R1LL-P2	3 meters
R1SS-P30	R2LL-P2	5 meters
R1SS-P31	R1LL-P3	3 meters
R1SS-P32	R2LL-P3	5 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R1UL-P33	5 meters
R2SS-P8	R2UL-P33	3 meters
R2SS-P9	R1UL-P30	5 meters
R2SS-P10	R2UL-P30	3 meters
R2SS-P11	R1UL-P32	5 meters
R2SS-P12	R2UL-P32	3 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R1LL-P33	5 meters
R2SS-P16	R2LL-P33	3 meters
R2SS-P17	R1LL-P30	5 meters
R2SS-P18	R2LL-P30	3 meters
R2SS-P19	R1LL-P32	5 meters
R2SS-P20	R2LL-P32	3 meters
R2SS-P21	R1UL-P34	5 meters
R2SS-P22	R2UL-P34	3 meters
R2SS-P23	R1UL-P35	5 meters
R2SS-P24	R2UL-P35	3 meters
R2SS-P25	R1UL-P36	5 meters
R2SS-P26	R2UL-P36	3 meters
R2SS-P27	R1LL-P34	5 meters
R2SS-P28	R2LL-P34	3 meters
R2SS-P29	R1LL-P35	5 meters
R2SS-P30	R2LL-P35	3 meters
R2SS-P31	R1LL-P36	5 meters
R2SS-P32	R2LL-P36	3 meters

4.4 Three-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect three racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a three-rack system.

Table 4-4 Leaf Switch Connections for the First Rack in a Three-Rack System

Switch Pair	Connections	Cable Length
R1UL to R1SS	R1UL-P2 to R1SS-P21 R1UL-P3 to R1SS-P23 R1UL-P4 to R1SS-P9 R1UL-P5 to R1SS-P5 R1UL-P7 to R1SS-P7	3 meters
R1UL to R2SS	R1UL-P30 to R2SS-P9 R1UL-P31 to R2SS-P5 R1UL-P33 to R2SS-P7 R1UL-P34 to R2SS-P21 R1UL-P35 to R2SS-P23	5 meters
R1UL to R3SS	R1UL-P1 to R3SS-P21 R1UL-P6 to R3SS-P5 R1UL-P32 to R3SS-P7 R1UL-P36 to R3SS-P23	5 meters
R1LL to R1SS	R1LL-P2 to R1SS-P27 R1LL-P3 to R1SS-P29 R1LL-P5 to R1SS-P13 R1LL-P7 to R1SS-P15	3 meters
R1LL to R2SS	R1LL-P30 to R2SS-P17 R1LL-P31 to R2SS-P13 R1LL-P33 to R2SS-P15 R1LL-P34 to R2SS-P27 R1LL-P35 to R2SS-P29	5 meters
R1LL to R3SS	R1LL-P1 to R3SS-P27 R1LL-P4 to R3SS-P13 R1LL-P6 to R3SS-P15 R1LL-P32 to R3SS-P17 R1LL-P36 to R3SS-P29	5 meters

Table 4-5 Leaf Switch Connections for the Second Rack in a Three-Rack System

Switch Pair	Connections	Cable Length
R2UL to R1SS	R2UL-P2 to R1SS-P22 R2UL-P3 to R1SS-P24 R2UL-P4 to R1SS-P10 R2UL-P5 to R1SS-P6 R2UL-P7 to R1SS-P8	5 meters
R2UL to R2SS	R2UL-P31 to R2SS-P6 R2UL-P33 to R2SS-P8 R2UL-P34 to R2SS-P22 R2UL-P35 to R2SS-P24	3 meters
R2UL to R3SS	R2UL-P1 to R3SS-P22 R2UL-P6 to R3SS-P6 R2UL-P30 to R3SS-P8 R2UL-P32 to R3SS-P10 R2UL-P36 to R3SS-P24	5 meters
R2LL to R1SS	R2LL-P2 to R1SS-P28 R2LL-P3 to R1SS-P30 R2LL-P4 to R1SS-P18 R2LL-P5 to R1SS-P14 R2LL-P7 to R1SS-P16	5 meters
R2LL to R2SS	R2LL-P30 to R2SS-P18 R2LL-P31 to R2SS-P14 R2LL-P33 to R2SS-P16 R2LL-P34 to R2SS-P28 R2LL-P35 to R2SS-P30	3 meters
R2LL to R3	R2LL-P1 to R3SS-P28 R2LL-P6 to R3SS-P14 R2LL-P32 to R3SS-P16 R2LL-P36 to R3SS-P30	5 meters

Table 4-6 Leaf Switch Connections for the Third Rack in a Three-Rack System

Switch Pair	Connections	Cable Length
R3UL to R1SS	R3UL-P2 to R1SS-P25 R3UL-P3 to R1SS-P31 R3UL-P5 to R1SS-P11 R3UL-P7 to R1SS-P12	5 meters
R3UL to R2SS	R3UL-P4 to R2SS-P10 R3UL-P6 to R2SS-P11 R3UL-P31 to R2SS-P12 R3UL-P34 to R2SS-P25 R3UL-P35 to R2SS-P31	5 meters
R3UL to R3SS	R3UL-P1 to R3SS-P25 R3UL-P30 to R3SS-P11 R3UL-P32 to R3SS-P12 R3UL-P33 to R3SS-P9 R3UL-P36 to R3SS-P31	3 meters
R3LL to R1SS	R3LL-P2 to R1SS-P26 R3LL-P3 to R1SS-P32 R3LL-P4 to R1SS-P20 R3LL-P5 to R1SS-P17 R3LL-P7 to R1SS-P19	5 meters
R3LL to R2SS	R3LL-P6 to R2SS-P19 R3LL-P31 to R2SS-P20 R3LL-P34 to R2SS-P26 R3LL-P35 to R2SS-P32	5 meters
R3LL to R3SS	R3LL-P1 to R3SS-P26 R3LL-P30 to R3SS-P19 R3LL-P32 to R3SS-P20 R3LL-P33 to R3SS-P18 R3LL-P36 to R3SS-P32	3 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-7 Three-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R1UL-P7	3 meters
R1SS-P8	R2UL-P7	5 meters
R1SS-P9	R1UL-P4	3 meters
R1SS-P10	R2UL-P4	5 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R3UL-P7	5 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R1LL-P7	3 meters
R1SS-P16	R2LL-P7	5 meters
R1SS-P17	R3LL-P5	5 meters
R1SS-P18	R2LL-P4	5 meters
R1SS-P19	R3LL-P7	5 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R1UL-P2	3 meters
R1SS-P22	R2UL-P2	5 meters
R1SS-P23	R1UL-P3	3 meters
R1SS-P24	R2UL-P3	5 meters
R1SS-P25	R3UL-P2	5 meters
R1SS-P26	R3LL-P2	5 meters
R1SS-P27	R1LL-P2	3 meters
R1SS-P28	R2LL-P2	5 meters
R1SS-P29	R1LL-P3	3 meters
R1SS-P30	R2LL-P3	5 meters
R1SS-P31	R3UL-P3	5 meters
R1SS-P32	R3LL-P3	5 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R1UL-P33	5 meters
R2SS-P8	R2UL-P33	3 meters
R2SS-P9	R1UL-P30	5 meters
R2SS-P10	R3UL-P4	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R3UL-P31	5 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R1LL-P33	5 meters
R2SS-P16	R2LL-P33	3 meters
R2SS-P17	R1LL-P30	5 meters
R2SS-P18	R2LL-P30	3 meters
R2SS-P19	R3LL-P6	5 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R1UL-P34	5 meters
R2SS-P22	R2UL-P34	3 meters
R2SS-P23	R1UL-P35	5 meters
R2SS-P24	R2UL-P35	3 meters
R2SS-P25	R3UL-P34	5 meters
R2SS-P26	R3LL-P34	5 meters
R2SS-P27	R1LL-P34	5 meters
R2SS-P28	R2LL-P34	3 meters
R2SS-P29	R1LL-P35	5 meters
R2SS-P30	R2LL-P35	3 meters
R2SS-P31	R3UL-P35	5 meters
R2SS-P32	R3LL-P35	5 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R1UL-P32	5 meters
R3SS-P8	R2UL-P30	5 meters
R3SS-P9	R3UL-P33	3 meters
R3SS-P10	R2UL-P32	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R3UL-P32	3 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R1LL-P6	5 meters
R3SS-P16	R2LL-P32	5 meters
R3SS-P17	R1LL-P32	5 meters
R3SS-P18	R3LL-P33	3 meters
R3SS-P19	R3LL-P30	3 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R1UL-P1	5 meters
R3SS-P22	R2UL-P1	5 meters
R3SS-P23	R1UL-P36	5 meters
R3SS-P24	R2UL-P36	5 meters
R3SS-P25	R3UL-P1	3 meters
R3SS-P26	R3LL-P1	3 meters
R3SS-P27	R1LL-P1	5 meters
R3SS-P28	R2LL-P1	5 meters
R3SS-P29	R1LL-P36	5 meters
R3SS-P30	R2LL-P36	5 meters
R3SS-P31	R3UL-P36	3 meters
R3SS-P32	R3LL-P36	3 meters

4.5 Four-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect four racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a four-rack system.

Table 4-8 Leaf Switch Connections for the First Rack in a Four-Rack System

Switch Pair	Connections	Cable Length
R1UL to R1SS	R1UL-P2 to R1SS-P21 R1UL-P3 to R1SS-P23 R1UL-P5 to R1SS-P5 R1UL-P7 to R1SS-P7	3 meters
R1UL to R2SS	R1UL-P31 to R2SS-P5 R1UL-P33 to R2SS-P7 R1UL-P34 to R2SS-P21 R1UL-P35 to R2SS-P23	5 meters
R1UL to R3SS	R1UL-P1 to R3SS-P21 R1UL-P6 to R3SS-P5 R1UL-P32 to R3SS-P7	5 meters
R1UL to R4SS	R1UL-P4 to R4SS-P5 R1UL-P30 to R4SS-P7 R1UL-P36 to R4SS-P21	10 meters
R1LL to R1SS	R1LL-P3 to R1SS-P27 R1LL-P5 to R1SS-P13 R1LL-P7 to R1SS-P15	3 meters
R1LL to R2SS	R1LL-P31 to R2SS-P13 R1LL-P33 to R2SS-P15 R1LL-P34 to R2SS-P27 R1LL-P35 to R2SS-P29	5 meters
R1LL to R3SS	R1LL-P1 to R3SS-P27 R1LL-P2 to R3SS-P29 R1LL-P4 to R3SS-P13 R1LL-P6 to R3SS-P15	5 meters
R1LL to R4SS	R1LL-P30 to R4SS-P13 R1LL-P32 to R4SS-P15 R1LL-P36 to R4SS-P27	10 meters

Table 4-9 Leaf Switch Connections for the Second Rack in a Four-Rack System

Switch Pair	Connections	Cable Length
R2UL to R1SS	R2UL-P3 to R1SS-P22 R2UL-P5 to R1SS-P6 R2UL-P7 to R1SS-P8	5 meters
R2UL to R2SS	R2UL-P31 to R2SS-P6 R2UL-P33 to R2SS-P8 R2UL-P35 to R2SS-P22	3 meters
R2UL to R3SS	R2UL-P1 to R3SS-P22 R2UL-P2 to R3SS-P24 R2UL-P6 to R3SS-P6 R2UL-P30 to R3SS-P8	5 meters
R2UL to R4SS	R2UL-P4 to R4SS-P6 R2UL-P32 to R4SS-P8 R2UL-P34 to R4SS-P22 R2UL-P36 to R4SS-P24	5 meters
R2LL to R1SS	R2LL-P1 to R1SS-P24 R2LL-P3 to R1SS-P28 R2LL-P5 to R1SS-P14 R2LL-P7 to R1SS-P16	5 meters
R2LL to R2SS	R2LL-P31 to R2SS-P14 R2LL-P33 to R2SS-P16 R2LL-P35 to R2SS-P28	3 meters
R2LL to R3SS	R2LL-P6 to R3SS-P14 R2LL-P32 to R3SS-P16 R2LL-P34 to R3SS-P28	5 meters
R2LL to R4SS	R2LL-P2 to R4SS-P28 R2LL-P4 to R4SS-P14 R2LL-P30 to R4SS-P16 R2LL-P36 to R4SS-P30	5 meters

Table 4-10 Leaf Switch Connections for the Third Rack in a Four-Rack System

Switch Pair	Connections	Cable Length
R3UL to R1SS	R3UL-P1 to R1SS-P25 R3UL-P3 to R1SS-P29 R3UL-P5 to R1SS-P11 R3UL-P7 to R1SS-P12	5 meters
R3UL to R2SS	R3UL-P2 to R2SS-P25 R3UL-P6 to R2SS-P11 R3UL-P31 to R2SS-P12 R3UL-P35 to R2SS-P31	5 meters
R3UL to R3SS	R3UL-P30 to R3SS-P11 R3UL-P32 to R3SS-P12 R3UL-P34 to R3SS-P25	3 meters
R3UL to R4SS	R3UL-P4 to R4SS-P11 R3UL-P33 to R4SS-P12 R3UL-P36 to R4SS-P25	5 meters
R3LL to R1SS	R3LL-P3 to R1SS-P26 R3LL-P4 to R1SS-P20 R3LL-P7 to R1SS-P19	5 meters
R3LL to R2SS	R3LL-P2 to R2SS-P24 R3LL-P6 to R2SS-P19 R3LL-P31 to R2SS-P20 R3LL-P35 to R2SS-P26	5 meters
R3LL to R3SS	R3LL-P1 to R3SS-P26 R3LL-P30 to R3SS-P19 R3LL-P32 to R3SS-P20 R3LL-P34 to R3SS-P23	3 meters
R3LL to R4SS	R3LL-P5 to R4SS-P19 R3LL-P33 to R4SS-P20 R3LL-P36 to R4SS-P26	5 meters

Table 4-11 Leaf Switch Connections for the Fourth Rack in a Four-Rack System

Switch Pair	Connections	Cable Length
R4UL to R1SS	R4UL-P3 to R1SS-P31 R4UL-P5 to R1SS-P9 R4UL-P7 to R1SS-P10	10 meters
R4UL to R2SS	R4UL-P2 to R2SS-P30 R4UL-P4 to R2SS-P9 R4UL-P6 to R2SS-P10	5 meters
R4UL to R3SS	R4UL-P31 to R3SS-P9 R4UL-P33 to R3SS-P10 R4UL-P34 to R3SS-P30 R4UL-P35 to R3SS-P31	5 meters
R4UL to R4SS	R4UL-P1 to R4SS-P23 R4UL-P30 to R4SS-P9 R4UL-P32 to R4SS-P10 R4UL-P36 to R4SS-P29	3 meters
R4LL to R1SS	R4LL-P1 to R1SS-P32 R4LL-P3 to R1SS-P30 R4LL-P5 to R1SS-P17 R4LL-P7 to R1SS-P18	10 meters
R4LL to R2SS	R4LL-P2 to R2SS-P32 R4LL-P4 to R2SS-P17 R4LL-P6 to R2SS-P18	5 meters
R4LL to R3SS	R4LL-P31 to R3SS-P17 R4LL-P33 to R3SS-P18 R4LL-P34 to R3SS-P32	5 meters
R4LL to R4SS	R4LL-P30 to R4SS-P17 R4LL-P32 to R4SS-P18 R4LL-P35 to R4SS-P31 R4LL-P36 to R4SS-P32	3 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-12 Four-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R1UL-P7	3 meters
R1SS-P8	R2UL-P7	5 meters
R1SS-P9	R4UL-P5	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R3UL-P7	5 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R1LL-P7	3 meters
R1SS-P16	R2LL-P7	5 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R4LL-P7	10 meters
R1SS-P19	R3LL-P7	5 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R1UL-P2	3 meters
R1SS-P22	R2UL-P3	5 meters
R1SS-P23	R1UL-P3	3 meters
R1SS-P24	R2LL-P1	5 meters
R1SS-P25	R3UL-P1	5 meters
R1SS-P26	R3LL-P3	5 meters
R1SS-P27	R1LL-P3	3 meters
R1SS-P28	R2LL-P3	5 meters
R1SS-P29	R3UL-P3	5 meters
R1SS-P30	R4LL-P3	10 meters
R1SS-P31	R4UL-P3	10 meters
R1SS-P32	R4LL-P1	10 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R1UL-P33	5 meters
R2SS-P8	R2UL-P33	3 meters
R2SS-P9	R4UL-P4	5 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R3UL-P31	5 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R1LL-P33	5 meters
R2SS-P16	R2LL-P33	3 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R4LL-P6	5 meters
R2SS-P19	R3LL-P6	5 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R1UL-P34	5 meters
R2SS-P22	R2UL-P35	3 meters
R2SS-P23	R1UL-P35	5 meters
R2SS-P24	R3LL-P2	5 meters
R2SS-P25	R3UL-P2	5 meters
R2SS-P26	R3LL-P35	5 meters
R2SS-P27	R1LL-P34	5 meters
R2SS-P28	R2LL-P35	3 meters
R2SS-P29	R1LL-P35	5 meters
R2SS-P30	R4UL-P2	5 meters
R2SS-P31	R3UL-P35	5 meters
R2SS-P32	R4LL-P2	5 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R1UL-P32	5 meters
R3SS-P8	R2UL-P30	5 meters
R3SS-P9	R4UL-P31	5 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R3UL-P32	3 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R1LL-P6	5 meters
R3SS-P16	R2LL-P32	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R4LL-P33	5 meters
R3SS-P19	R3LL-P30	3 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R1UL-P1	5 meters
R3SS-P22	R2UL-P1	5 meters
R3SS-P23	R3LL-P34	3 meters
R3SS-P24	R2UL-P2	5 meters
R3SS-P25	R3UL-P34	3 meters
R3SS-P26	R3LL-P1	3 meters
R3SS-P27	R1LL-P1	5 meters
R3SS-P28	R2LL-P34	5 meters
R3SS-P29	R1LL-P2	5 meters
R3SS-P30	R4UL-P34	5 meters
R3SS-P31	R4UL-P35	5 meters
R3SS-P32	R4LL-P34	5 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R1UL-P30	10 meters
R4SS-P8	R2UL-P32	5 meters
R4SS-P9	R4UL-P30	3 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R3UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R1LL-P32	10 meters
R4SS-P16	R2LL-P30	5 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R4LL-P32	3 meters
R4SS-P19	R3LL-P5	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R1UL-P36	10 meters
R4SS-P22	R2UL-P34	5 meters
R4SS-P23	R4UL-P1	3 meters
R4SS-P24	R2UL-P36	5 meters
R4SS-P25	R3UL-P36	5 meters
R4SS-P26	R3LL-P36	5 meters
R4SS-P27	R1LL-P36	10 meters
R4SS-P28	R2LL-P2	5 meters
R4SS-P29	R4UL-P36	3 meters
R4SS-P30	R2LL-P36	5 meters
R4SS-P31	R4LL-P35	3 meters
R4SS-P32	R4LL-P36	3 meters

4.6 Five-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect five racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a five-rack system.

Table 4-13 Leaf Switch Connections for the First Rack in a Five-Rack System

Switch Pair	Connections	Cable Length
R1UL to R1SS	R1UL-P3 to R1SS-P21 R1UL-P5 to R1SS-P5 R1UL-P7 to R1SS-P7	3 meters
R1UL to R2SS	R1UL-P31 to R2SS-P5 R1UL-P33 to R2SS-P7 R1UL-P35 to R2SS-P21	5 meters
R1UL to R3SS	R1UL-P1 to R3SS-P21 R1UL-P6 to R3SS-P5 R1UL-P32 to R3SS-P7	5 meters
R1UL to R4SS	R1UL-P2 to R4SS-P21 R1UL-P4 to R4SS-P5 R1UL-P34 to R4SS-P23	10 meters
R1UL to R5SS	R1UL-P30 to R5SS-P5 R1UL-P36 to R5SS-P21	10 meters
R1LL to R1SS	R1LL-P3 to R1SS-P27 R1LL-P5 to R1SS-P13	3 meters
R1LL to R2SS	R1LL-P31 to R2SS-P13 R1LL-P33 to R2SS-P15 R1LL-P35 to R2SS-P27	5 meters
R1LL to R3SS	R1LL-P2 to R3SS-P27 R1LL-P4 to R3SS-P13 R1LL-P6 to R3SS-P15	5 meters
R1LL to R4SS	R1LL-P30 to R4SS-P13 R1LL-P32 to R4SS-P15 R1LL-P34 to R4SS-P27	10 meters
R1LL to R5SS	R1LL-P1 to R5SS-P25 R1LL-P7 to R5SS-P13 R1LL-P36 to R5SS-P27	10 meters

Table 4-14 Leaf Switch Connections for the Second Rack in a Five-Rack System

Switch Pair	Connections	Cable Length
R2UL to R1SS	R2UL-P1 to R1SS-P24 R2UL-P3 to R1SS-P22 R2UL-P5 to R1SS-P6	5 meters
R2UL to R2SS	R2UL-P31 to R2SS-P6 R2UL-P35 to R2SS-P22	3 meters
R2UL to R3SS	R2UL-P2 to R3SS-P22 R2UL-P6 to R3SS-P6 R2UL-P30 to R3SS-P8	5 meters
R2UL to R4SS	R2UL-P4 to R4SS-P6 R2UL-P32 to R4SS-P8 R2UL-P34 to R4SS-P22	5 meters
R2UL to R5SS	R2UL-P7 to R5SS-P6 R2UL-P33 to R5SS-P8 R2UL-P36 to R5SS-P22	10 meters
R2LL to R1SS	R2LL-P3 to R1SS-P28 R2LL-P5 to R1SS-P14 R2LL-P7 to R1SS-P16	5 meters
R2LL to R2SS	R2LL-P31 to R2SS-P14 R2LL-P34 to R2SS-P24 R2LL-P35 to R2SS-P28	3 meters
R2LL to R3SS	R2LL-P1 to R3SS-P28 R2LL-P6 to R3SS-P14	5 meters
R2LL to R4SS	R2LL-P2 to R4SS-P28 R2LL-P4 to R4SS-P14 R2LL-P30 to R4SS-P16	5 meters
R2LL to R5SS	R2LL-P32 to R5SS-P16 R2LL-P33 to R5SS-P14 R2LL-P36 to R5SS-P28	10 meters

Table 4-15 Leaf Switch Connections for the Third Rack in a Five-Rack System

Switch Pair	Connections	Cable Length
R3UL to R1SS	R3UL-P3 to R1SS-P25 R3UL-P5 to R1SS-P11 R3UL-P7 to R1SS-P12	5 meters
R3UL to R2SS	R3UL-P2 to R2SS-P25 R3UL-P6 to R2SS-P11 R3UL-P31 to R2SS-P12	5 meters
R3UL to R3SS	R3UL-P30 to R3SS-P11 R3UL-P34 to R3SS-P25 R3UL-P36 to R3SS-P24	3 meters
R3UL to R4SS	R3UL-P1 to R4SS-P25 R3UL-P4 to R4SS-P11	5 meters
R3UL to R5SS	R3UL-P32 to R5SS-P11 R3UL-P33 to R5SS-P12 R3UL-P35 to R5SS-P24	5 meters
R3LL to R1SS	R3LL-P3 to R1SS-P26 R3LL-P4 to R1SS-P20 R3LL-P7 to R1SS-P19	5 meters
R3LL to R2SS	R3LL-P2 to R2SS-P26 R3LL-P6 to R2SS-P19 R3LL-P31 to R2SS-P20	5 meters
R3LL to R3SS	R3LL-P30 to R3SS-P19 R3LL-P32 to R3SS-P20 R3LL-P34 to R3SS-P26	3 meters
R3LL to R4SS	R3LL-P33 to R4SS-P20 R3LL-P35 to R4SS-P24 R3LL-P36 to R4SS-P26	5 meters
R3LL to R5SS	R3LL-P1 to R5SS-P26 R3LL-P5 to R5SS-P20	5 meters

Table 4-16 Leaf Switch Connections for the Fourth Rack in a Five-Rack System

Switch Pair	Connections	Cable Length
R4UL to R1SS	R4UL-P3 to R1SS-P31 R4UL-P7 to R1SS-P10	10 meters
R4UL to R2SS	R4UL-P2 to R2SS-P31 R4UL-P4 to R2SS-P9 R4UL-P6 to R2SS-P10	5 meters
R4UL to R3SS	R4UL-P31 to R3SS-P9 R4UL-P33 to R3SS-P10 R4UL-P35 to R3SS-P31	5 meters
R4UL to R4SS	R4UL-P30 to R4SS-P9 R4UL-P32 to R4SS-P10 R4UL-P34 to R4SS-P31	3 meters
R4UL to R5SS	R4UL-P1 to R5SS-P31 R4UL-P5 to R5SS-P10 R4UL-P36 to R5SS-P32	5 meters
R4LL to R1SS	R4LL-P1 to R1SS-P32 R4LL-P3 to R1SS-P30 R4LL-P5 to R1SS-P17	10 meters
R4LL to R2SS	R4LL-P2 to R2SS-P30 R4LL-P4 to R2SS-P17	5 meters
R4LL to R3SS	R4LL-P31 to R3SS-P17 R4LL-P33 to R3SS-P18 R4LL-P35 to R3SS-P30	5 meters
R4LL to R4SS	R4LL-P30 to R4SS-P17 R4LL-P32 to R4SS-P18 R4LL-P34 to R4SS-P30	3 meters
R4LL to R5SS	R4LL-P7 to R5SS-P17 R4LL-P6 to R5SS-P18 R4LL-P36 to R5SS-P30	5 meters

Table 4-17 Leaf Switch Connections for the Fifth Rack in a Five-Rack System

Switch Pair	Connections	Cable Length
R5UL to R1SS	R5UL-P3 to R1SS-P23 R5UL-P5 to R1SS-P8 R5UL-P7 to R1SS-P9	10 meters
R5UL to R2SS	R5UL-P1 to R2SS-P32 R5UL-P2 to R2SS-P23 R5UL-P4 to R2SS-P8	10 meters
R5UL to R3SS	R5UL-P6 to R3SS-P12 R5UL-P34 to R3SS-P23	5 meters
R5UL to R4SS	R5UL-P31 to R4SS-P7 R5UL-P33 to R4SS-P12 R5UL-P35 to R4SS-P32	5 meters
R5UL to R5SS	R5UL-P30 to R5SS-P7 R5UL-P32 to R5SS-P9 R5UL-P36 to R5SS-P23	3 meters
R5LL to R1SS	R5LL-P3 to R1SS-P29 R5LL-P5 to R1SS-P15 R5LL-P7 to R1SS-P18	10 meters
R5LL to R2SS	R5LL-P2 to R2SS-P29 R5LL-P4 to R2SS-P16 R5LL-P6 to R2SS-P18	10 meters
R5LL to R3SS	R5LL-P1 to R3SS-P32 R5LL-P31 to R3SS-P16 R5LL-P35 to R3SS-P29	5 meters
R5LL to R4SS	R5LL-P33 to R4SS-P19 R5LL-P34 to R4SS-P29	5 meters
R5LL to R5SS	R5LL-P30 to R5SS-P15 R5LL-P32 to R5SS-P19 R5LL-P36 to R5SS-P29	3 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-18 Five-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R1UL-P7	3 meters
R1SS-P8	R5UL-P5	10 meters
R1SS-P9	R5UL-P7	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R3UL-P7	5 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R5LL-P5	10 meters
R1SS-P16	R2LL-P7	5 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R5LL-P7	10 meters
R1SS-P19	R3LL-P7	5 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R1UL-P3	3 meters
R1SS-P22	R2UL-P3	5 meters
R1SS-P23	R5UL-P3	10 meters
R1SS-P24	R2UL-P1	5 meters
R1SS-P25	R3UL-P3	5 meters
R1SS-P26	R3LL-P3	5 meters
R1SS-P27	R1LL-P3	3 meters
R1SS-P28	R2LL-P3	5 meters
R1SS-P29	R5LL-P3	10 meters
R1SS-P30	R4LL-P3	10 meters
R1SS-P31	R4UL-P3	10 meters
R1SS-P32	R4LL-P1	10 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R1UL-P33	5 meters
R2SS-P8	R5UL-P4	10 meters
R2SS-P9	R4UL-P4	5 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R3UL-P31	5 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R1LL-P33	5 meters
R2SS-P16	R5LL-P4	10 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R5LL-P6	10 meters
R2SS-P19	R3LL-P6	5 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R1UL-P35	5 meters
R2SS-P22	R2UL-P35	3 meters
R2SS-P23	R5UL-P2	10 meters
R2SS-P24	R2LL-P34	3 meters
R2SS-P25	R3UL-P2	5 meters
R2SS-P26	R3LL-P2	5 meters
R2SS-P27	R1LL-P35	5 meters
R2SS-P28	R2LL-P35	3 meters
R2SS-P29	R5LL-P2	10 meters
R2SS-P30	R4LL-P2	5 meters
R2SS-P31	R4UL-P2	5 meters
R2SS-P32	R5UL-P1	10 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R1UL-P32	5 meters
R3SS-P8	R2UL-P30	5 meters
R3SS-P9	R4UL-P31	5 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R5UL-P6	5 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R1LL-P6	5 meters
R3SS-P16	R5LL-P31	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R4LL-P33	5 meters
R3SS-P19	R3LL-P30	3 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R1UL-P1	5 meters
R3SS-P22	R2UL-P2	5 meters
R3SS-P23	R5UL-P34	5 meters
R3SS-P24	R3UL-P36	3 meters
R3SS-P25	R3UL-P34	3 meters
R3SS-P26	R3LL-P34	3 meters
R3SS-P27	R1LL-P2	5 meters
R3SS-P28	R2LL-P1	5 meters
R3SS-P29	R5LL-P35	5 meters
R3SS-P30	R4LL-P35	5 meters
R3SS-P31	R4UL-P35	5 meters
R3SS-P32	R5LL-P1	5 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R5UL-P31	5 meters
R4SS-P8	R2UL-P32	5 meters
R4SS-P9	R4UL-P30	3 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R5UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R1LL-P32	10 meters
R4SS-P16	R2LL-P30	5 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R4LL-P32	3 meters
R4SS-P19	R5LL-P33	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R1UL-P2	10 meters
R4SS-P22	R2UL-P34	5 meters
R4SS-P23	R1UL-P34	10 meters
R4SS-P24	R3LL-P35	5 meters
R4SS-P25	R3UL-P1	5 meters
R4SS-P26	R3LL-P36	5 meters
R4SS-P27	R1LL-P34	10 meters
R4SS-P28	R2LL-P2	5 meters
R4SS-P29	R5LL-P34	5 meters
R4SS-P30	R4LL-P34	3 meters
R4SS-P31	R4UL-P34	3 meters
R4SS-P32	R5UL-P35	5 meters
R5SS-P5	R1UL-P30	10 meters
R5SS-P6	R2UL-P7	10 meters
R5SS-P7	R5UL-P30	3 meters
R5SS-P8	R2UL-P33	10 meters
R5SS-P9	R5UL-P32	3 meters
R5SS-P10	R4UL-P5	5 meters
R5SS-P11	R3UL-P32	5 meters
R5SS-P12	R3UL-P33	5 meters
R5SS-P13	R1LL-P7	10 meters
R5SS-P14	R2LL-P33	10 meters
R5SS-P15	R5LL-P30	3 meters
R5SS-P16	R2LL-P32	10 meters
R5SS-P17	R4LL-P7	5 meters
R5SS-P18	R4LL-P6	5 meters
R5SS-P19	R5LL-P32	3 meters
R5SS-P20	R3LL-P5	5 meters
R5SS-P21	R1UL-P36	10 meters
R5SS-P22	R2UL-P36	10 meters
R5SS-P23	R5UL-P36	3 meters
R5SS-P24	R3UL-P35	5 meters
R5SS-P25	R1LL-P1	10 meters
R5SS-P26	R3LL-P1	5 meters
R5SS-P27	R1LL-P36	10 meters
R5SS-P28	R2LL-P36	10 meters
R5SS-P29	R5LL-P36	3 meters
R5SS-P30	R4LL-P36	5 meters
R5SS-P31	R4UL-P1	5 meters
R5SS-P32	R4UL-P36	5 meters

4.7 Six-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect six racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a six-rack system.

Table 4-19 Leaf Switch Connections for the First Rack in a Six-Rack System

Switch Pair	Connections	Cable Length
R1UL to R1SS	R1UL-P3 to R1SS-P21 R1UL-P5 to R1SS-P5 R1UL-P7 to R1SS-P7	3 meters
R1UL to R2SS	R1UL-P31 to R2SS-P5 R1UL-P33 to R2SS-P7 R1UL-P35 to R2SS-P21	5 meters
R1UL to R3SS	R1UL-P1 to R3SS-P21 R1UL-P6 to R3SS-P5	5 meters
R1UL to R4SS	R1UL-P2 to R4SS-P21 R1UL-P4 to R4SS-P5	10 meters
R1UL to R5SS	R1UL-P30 to R5SS-P5 R1UL-P34 to R5SS-P21	10 meters
R1UL to R6SS	R1UL-P32 to R6SS-P5 R1UL-P36 to R6SS-P21	10 meters
R1LL to R1SS	R1LL-P3 to R1SS-P27 R1LL-P5 to R1SS-P13	3 meters
R1LL to R2SS	R1LL-P31 to R2SS-P13 R1LL-P33 to R2SS-P15 R1LL-P35 to R2SS-P27	5 meters
R1LL to R3SS	R1LL-P2 to R3SS-P27 R1LL-P4 to R3SS-P13 R1LL-P6 to R3SS-P15	5 meters
R1LL to R4SS	R1LL-P30 to R4SS-P13 R1LL-P34 to R4SS-P27	10 meters
R1LL to R5SS	R1LL-P7 to R5SS-P13 R1LL-P1 to R5SS-P27	10 meters
R1LL to R6SS	R1LL-P32 to R6SS-P13 R1LL-P36 to R6SS-P27	10 meters

Table 4-20 Leaf Switch Connections for the Second Rack in a Six-Rack System

Switch Pair	Connections	Cable Length
R2UL to R1SS	R2UL-P3 to R1SS-P22 R2UL-P5 to R1SS-P6	5 meters
R2UL to R2SS	R2UL-P31 to R2SS-P6 R2UL-P35 to R2SS-P22	3 meters
R2UL to R3SS	R2UL-P6 to R3SS-P6 R2UL-P30 to R3SS-P8 R2UL-P2 to R3SS-P22	5 meters
R2UL to R4SS	R2UL-P4 to R4SS-P6 R2UL-P32 to R4SS-P8 R2UL-P34 to R4SS-P22	5 meters
R2UL to R5SS	R2UL-P1 to R5SS-P22 R2UL-P7 to R5SS-P6	10 meters
R2UL to R6SS	R2UL-P33 to R6SS-P6 R2UL-P36 to R6SS-P22	10 meters
R2LL to R1SS	R2LL-P3 to R1SS-P28 R2LL-P5 to R1SS-P14	5 meters
R2LL to R2SS	R2LL-P31 to R2SS-P14 R2LL-P35 to R2SS-P28	3 meters
R2LL to R3SS	R2LL-P2 to R3SS-P28 R2LL-P6 to R3SS-P14	5 meters
R2LL to R4SS	R2LL-P4 to R4SS-P14 R2LL-P30 to R4SS-P16 R2LL-P34 to R4SS-P28	5 meters
R2LL to R5SS	R2LL-P32 to R5SS-P16 R2LL-P33 to R5SS-P14 R2LL-P36 to R5SS-P28	10 meters
R2LL to R6SS	R2LL-P1 to R6SS-P28 R2LL-P7 to R6SS-P14	10 meters

Table 4-21 Leaf Switch Connections for the Third Rack in a Six-Rack System

Switch Pair	Connections	Cable Length
R3UL to R1SS	R3UL-P3 to R1SS-P25 R3UL-P5 to R1SS-P11	5 meters
R3UL to R2SS	R3UL-P2 to R2SS-P25 R3UL-P6 to R2SS-P11	5 meters
R3UL to R3SS	R3UL-P30 to R3SS-P11 R3UL-P34 to R3SS-P25	3 meters
R3UL to R4SS	R3UL-P1 to R4SS-P25 R3UL-P4 to R4SS-P11	5 meters
R3UL to R5SS	R3UL-P32 to R5SS-P11 R3UL-P33 to R5SS-P12 R3UL-P35 to R5SS-P25	5 meters
R3UL to R6SS	R3UL-P7 to R6SS-P11 R3UL-P31 to R6SS-P12 R3UL-P36 to R6SS-P25	10 meters
R3LL to R1SS	R3LL-P3 to R1SS-P26 R3LL-P4 to R1SS-P20 R3LL-P7 to R1SS-P19	5 meters
R3LL to R2SS	R3LL-P31 to R2SS-P20 R3LL-P35 to R2SS-P26	5 meters
R3LL to R3SS	R3LL-P32 to R3SS-P20 R3LL-P34 to R3SS-P26	3 meters
R3LL to R4SS	R3LL-P33 to R4SS-P20 R3LL-P36 to R4SS-P26	5 meters
R3LL to R5SS	R3LL-P1 to R5SS-P26 R3LL-P5 to R5SS-P20	5 meters
R3LL to R6SS	R3LL-P2 to R6SS-P26 R3LL-P6 to R6SS-P19 R3LL-P30 to R6SS-P20	10 meters

Table 4-22 Leaf Switch Connections for the Fourth Rack in a Six-Rack System

Switch Pair	Connections	Cable Length
R4UL to R1SS	R4UL-P1 to R1SS-P32 R4UL-P3 to R1SS-P31 R4UL-P7 to R1SS-P10	10 meters
R4UL to R2SS	R4UL-P2 to R2SS-P31 R4UL-P4 to R2SS-P9 R4UL-P6 to R2SS-P10	5 meters
R4UL to R3SS	R4UL-P31 to R3SS-P9 R4UL-P33 to R3SS-P10	5 meters
R4UL to R4SS	R4UL-P32 to R4SS-P10 R4UL-P34 to R4SS-P31	3 meters
R4UL to R5SS	R4UL-P5 to R5SS-P10 R4UL-P35 to R5SS-P31	5 meters
R4UL to R6SS	R4UL-P30 to R6SS-P10 R4UL-P36 to R6SS-P31	5 meters
R4LL to R1SS	R4LL-P3 to R1SS-P30 R4LL-P5 to R1SS-P17	10 meters
R4LL to R2SS	R4LL-P1 to R2SS-P32 R4LL-P2 to R2SS-P30 R4LL-P4 to R2SS-P17	5 meters
R4LL to R3SS	R4LL-P31 to R3SS-P17 R4LL-P33 to R3SS-P18 R4LL-P35 to R3SS-P30	5 meters
R4LL to R4SS	R4LL-P30 to R4SS-P17 R4LL-P32 to R4SS-P18	3 meters
R4LL to R5SS	R4LL-P7 to R5SS-P17 R4LL-P34 to R5SS-P30	5 meters
R4LL to R6SS	R4LL-P6 to R6SS-P17 R4LL-P36 to R6SS-P30	5 meters

Table 4-23 Leaf Switch Connections for the Fifth Rack in a Six-Rack System

Switch Pair	Connections	Cable Length
R5UL to R1SS	R5UL-P3 to R1SS-P23 R5UL-P5 to R1SS-P8	10 meters
R5UL to R2SS	R5UL-P2 to R2SS-P23 R5UL-P4 to R2SS-P8	10 meters
R5UL to R3SS	R5UL-P6 to R3SS-P12 R5UL-P1 to R3SS-P23 R5UL-P34 to R3SS-P24	5 meters
R5UL to R4SS	R5UL-P31 to R4SS-P7 R5UL-P33 to R4SS-P12 R5UL-P35 to R4SS-P23	5 meters
R5UL to R5SS	R5UL-P30 to R5SS-P7 R5UL-P32 to R5SS-P9	3 meters
R5UL to R6SS	R5UL-P7 to R6SS-P7 R5UL-P36 to R6SS-P23	5 meters
R5LL to R1SS	R5LL-P3 to R1SS-P29 R5LL-P7 to R1SS-P18	10 meters
R5LL to R2SS	R5LL-P6 to R2SS-P18 R5LL-P34 to R2SS-P29	10 meters
R5LL to R3SS	R5LL-P31 to R3SS-P16 R5LL-P35 to R3SS-P29	5 meters
R5LL to R4SS	R5LL-P1 to R4SS-P29 R5LL-P2 to R4SS-P30 R5LL-P33 to R4SS-P19	5 meters
R5LL to R5SS	R5LL-P30 to R5SS-P15 R5LL-P32 to R5SS-P19 R5LL-P36 to R5SS-P29	3 meters
R5LL to R6SS	R5LL-P4 to R6SS-P15 R5LL-P5 to R6SS-P9	5 meters

Table 4-24 Leaf Switch Connections for the Sixth Rack in a Six-Rack System

Switch Pair	Connections	Cable Length
R6UL to R1SS	R6UL-P5 to R1SS-P9 R6UL-P7 to R1SS-P16	10 meters
R6UL to R2SS	R6UL-P2 to R2SS-P24 R6UL-P4 to R2SS-P16	10 meters
R6UL to R3SS	R6UL-P3 to R3SS-P31 R6UL-P6 to R3SS-P19	10 meters
R6UL to R4SS	R6UL-P1 to R4SS-P32 R6UL-P31 to R4SS-P15	5 meters
R6UL to R5SS	R6UL-P33 to R5SS-P18 R6UL-P34 to R5SS-P24 R6UL-P35 to R5SS-P23	5 meters
R6UL to R6SS	R6UL-P30 to R6SS-P16 R6UL-P32 to R6SS-P18 R6UL-P36 to R6SS-P24	3 meters
R6LL to R1SS	R6LL-P3 to R1SS-P24 R6LL-P5 to R1SS-P12 R6LL-P7 to R1SS-P15	10 meters
R6LL to R2SS	R6LL-P4 to R2SS-P12 R6LL-P6 to R2SS-P19	10 meters
R6LL to R3SS	R6LL-P1 to R3SS-P32 R6LL-P31 to R3SS-P7	10 meters
R6LL to R4SS	R6LL-P2 to R4SS-P24 R6LL-P33 to R4SS-P9	5 meters
R6LL to R5SS	R6LL-P30 to R5SS-P8 R6LL-P34 to R5SS-P32	5 meters
R6LL to R6SS	R6LL-P32 to R6SS-P8 R6LL-P35 to R6SS-P29 R6LL-P36 to R6SS-P32	3 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-25 Six-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R1UL-P7	3 meters
R1SS-P8	R5UL-P5	10 meters
R1SS-P9	R6UL-P5	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R6LL-P5	10 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R6LL-P7	10 meters
R1SS-P16	R6UL-P7	10 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R5LL-P7	10 meters
R1SS-P19	R3LL-P7	5 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R1UL-P3	3 meters
R1SS-P22	R2UL-P3	5 meters
R1SS-P23	R5UL-P3	10 meters
R1SS-P24	R6LL-P3	10 meters
R1SS-P25	R3UL-P3	5 meters
R1SS-P26	R3LL-P3	5 meters
R1SS-P27	R1LL-P3	3 meters
R1SS-P28	R2LL-P3	5 meters
R1SS-P29	R5LL-P3	10 meters
R1SS-P30	R4LL-P3	10 meters
R1SS-P31	R4UL-P3	10 meters
R1SS-P32	R4UL-P1	10 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R1UL-P33	5 meters
R2SS-P8	R5UL-P4	10 meters
R2SS-P9	R4UL-P4	5 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R6LL-P4	10 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R1LL-P33	5 meters
R2SS-P16	R6UL-P4	10 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R5LL-P6	10 meters
R2SS-P19	R6LL-P6	10 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R1UL-P35	5 meters
R2SS-P22	R2UL-P35	3 meters
R2SS-P23	R5UL-P2	10 meters
R2SS-P24	R6UL-P2	10 meters
R2SS-P25	R3UL-P2	5 meters
R2SS-P26	R3LL-P35	5 meters
R2SS-P27	R1LL-P35	5 meters
R2SS-P28	R2LL-P35	3 meters
R2SS-P29	R5LL-P34	10 meters
R2SS-P30	R4LL-P2	5 meters
R2SS-P31	R4UL-P2	5 meters
R2SS-P32	R4LL-P1	5 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R6LL-P31	10 meters
R3SS-P8	R2UL-P30	5 meters
R3SS-P9	R4UL-P31	5 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R5UL-P6	5 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R1LL-P6	5 meters
R3SS-P16	R5LL-P31	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R4LL-P33	5 meters
R3SS-P19	R6UL-P6	10 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R1UL-P1	5 meters
R3SS-P22	R2UL-P2	5 meters
R3SS-P23	R5UL-P1	5 meters
R3SS-P24	R5UL-P34	5 meters
R3SS-P25	R3UL-P34	3 meters
R3SS-P26	R3LL-P34	3 meters
R3SS-P27	R1LL-P2	5 meters
R3SS-P28	R2LL-P2	5 meters
R3SS-P29	R5LL-P35	5 meters
R3SS-P30	R4LL-P35	5 meters
R3SS-P31	R6UL-P3	10 meters
R3SS-P32	R6LL-P1	10 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R5UL-P31	5 meters
R4SS-P8	R2UL-P32	5 meters
R4SS-P9	R6LL-P33	5 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R5UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R6UL-P31	5 meters
R4SS-P16	R2LL-P30	5 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R4LL-P32	3 meters
R4SS-P19	R5LL-P33	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R1UL-P2	10 meters
R4SS-P22	R2UL-P34	5 meters
R4SS-P23	R5UL-P35	5 meters
R4SS-P24	R6LL-P2	5 meters
R4SS-P25	R3UL-P1	5 meters
R4SS-P26	R3LL-P36	5 meters
R4SS-P27	R1LL-P34	10 meters
R4SS-P28	R2LL-P34	5 meters
R4SS-P29	R5LL-P1	5 meters
R4SS-P30	R5LL-P2	5 meters
R4SS-P31	R4UL-P34	3 meters
R4SS-P32	R6UL-P1	5 meters
R5SS-P5	R1UL-P30	10 meters
R5SS-P6	R2UL-P7	10 meters
R5SS-P7	R5UL-P30	3 meters
R5SS-P8	R6LL-P30	5 meters
R5SS-P9	R5UL-P32	3 meters
R5SS-P10	R4UL-P5	5 meters
R5SS-P11	R3UL-P32	5 meters
R5SS-P12	R3UL-P33	5 meters
R5SS-P13	R1LL-P7	10 meters
R5SS-P14	R2LL-P33	10 meters
R5SS-P15	R5LL-P30	3 meters
R5SS-P16	R2LL-P32	10 meters
R5SS-P17	R4LL-P7	5 meters
R5SS-P18	R6UL-P33	5 meters
R5SS-P19	R5LL-P32	3 meters
R5SS-P20	R3LL-P5	5 meters
R5SS-P21	R1UL-P34	10 meters
R5SS-P22	R2UL-P1	10 meters
R5SS-P23	R6UL-P35	5 meters
R5SS-P24	R6UL-P34	5 meters
R5SS-P25	R3UL-P35	5 meters
R5SS-P26	R3LL-P1	5 meters
R5SS-P27	R1LL-P1	10 meters
R5SS-P28	R2LL-P36	10 meters
R5SS-P29	R5LL-P36	3 meters
R5SS-P30	R4LL-P34	5 meters
R5SS-P31	R4UL-P35	5 meters
R5SS-P32	R6LL-P34	5 meters
R6SS-P5	R1UL-P32	10 meters
R6SS-P6	R2UL-P33	10 meters
R6SS-P7	R5UL-P7	5 meters
R6SS-P8	R6LL-P32	3 meters
R6SS-P9	R5LL-P5	5 meters
R6SS-P10	R4UL-P30	5 meters
R6SS-P11	R3UL-P7	10 meters
R6SS-P12	R3UL-P31	10 meters
R6SS-P13	R1LL-P32	10 meters
R6SS-P14	R2LL-P7	10 meters
R6SS-P15	R5LL-P4	5 meters
R6SS-P16	R6UL-P30	3 meters
R6SS-P17	R4LL-P6	5 meters
R6SS-P18	R6UL-P32	3 meters
R6SS-P19	R3LL-P6	10 meters
R6SS-P20	R3LL-P30	10 meters
R6SS-P21	R1UL-P36	10 meters
R6SS-P22	R2UL-P36	10 meters
R6SS-P23	R5UL-P36	5 meters
R6SS-P24	R6UL-P36	3 meters
R6SS-P25	R3UL-P36	10 meters
R6SS-P26	R3LL-P2	10 meters
R6SS-P27	R1LL-P36	10 meters
R6SS-P28	R2LL-P1	10 meters
R6SS-P29	R6LL-P35	3 meters
R6SS-P30	R4LL-P36	5 meters
R6SS-P31	R4UL-P36	5 meters
R6SS-P32	R6LL-P36	3 meters

4.8 Seven-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect seven racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a seven-rack system.

Table 4-26 Leaf Switch Connections for the First Rack in a Seven-Rack System

Switch Pair	Connections	Cable Length
R1UL to R1SS	R1UL-P5 to R1SS-P5 R1UL-P7 to R1SS-P7	3 meters
R1UL to R2SS	R1UL-P3 to R2SS-P21 R1UL-P31 to R2SS-P5	5 meters
R1UL to R3SS	R1UL-P1 to R3SS-P27 R1UL-P6 to R3SS-P5	5 meters
R1UL to R4SS	R1UL-P2 to R4SS-P22 R1UL-P4 to R4SS-P5	10 meters
R1UL to R5SS	R1UL-P30 to R5SS-P5 R1UL-P34 to R5SS-P29	10 meters
R1UL to R6SS	R1UL-P32 to R6SS-P5 R1UL-P35 to R6SS-P23	10 meters
R1UL to R7SS	R1UL-P33 to R7SS-P5 R1UL-P36 to R7SS-P23	10 meters
R1LL to R1SS	R1LL-P3 to R1SS-P21 R1LL-P5 to R1SS-P13	3 meters
R1LL to R2SS	R1LL-P31 to R2SS-P13 R1LL-P33 to R2SS-P15	5 meters
R1LL to R3SS	R1LL-P2 to R3SS-P21 R1LL-P4 to R3SS-P13	5 meters
R1LL to R4SS	R1LL-P30 to R4SS-P13 R1LL-P34 to R4SS-P21	10 meters
R1LL to R5SS	R1LL-P7 to R5SS-P13 R1LL-P35 to R5SS-P21	10 meters
R1LL to R6SS	R1LL-P32 to R6SS-P13 R1LL-P36 to R6SS-P21	10 meters
R1LL to R7SS	R1LL-P1 to R7SS-P21 R1LL-P6 to R7SS-P13	10 meters

Table 4-27 Leaf Switch Connections for the Second Rack in a Seven-Rack System

Switch Pair	Connections	Cable Length
R2UL to R1SS	R2UL-P3 to R1SS-P28 R2UL-P5 to R1SS-P6	5 meters
R2UL to R2SS	R2UL-P31 to R2SS-P6 R2UL-P34 to R2SS-P28	3 meters
R2UL to R3SS	R2UL-P6 to R3SS-P6 R2UL-P30 to R3SS-P8	5 meters
R2UL to R4SS	R2UL-P2 to R4SS-P28 R2UL-P4 to R4SS-P6	5 meters
R2UL to R5SS	R2UL-P1 to R5SS-P28 R2UL-P7 to R5SS-P6	10 meters
R2UL to R6SS	R2UL-P33 to R6SS-P6 R2UL-P35 to R6SS-P28	10 meters
R2UL to R7SS	R2UL-P32 to R7SS-P6 R2UL-P36 to R7SS-P28	10 meters
R2LL to R1SS	R2LL-P3 to R1SS-P22 R2LL-P5 to R1SS-P14	5 meters
R2LL to R2SS	R2LL-P2 to R2SS-P22 R2LL-P31 to R2SS-P14	3 meters
R2LL to R3SS	R2LL-P1 to R3SS-P22 R2LL-P6 to R3SS-P14	5 meters
R2LL to R4SS	R2LL-P4 to R4SS-P14 R2LL-P30 to R4SS-P16	5 meters
R2LL to R5SS	R2LL-P33 to R5SS-P14 R2LL-P35 to R5SS-P22	10 meters
R2LL to R6SS	R2LL-P7 to R6SS-P14 R2LL-P36 to R6SS-P22	10 meters
R2LL to R7SS	R2LL-P32 to R7SS-P14 R2LL-P34 to R7SS-P22	10 meters

Table 4-28 Leaf Switch Connections for the Third Rack in a Seven-Rack System

Switch Pair	Connections	Cable Length
R3UL to R1SS	R3UL-P3 to R1SS-P25 R3UL-P5 to R1SS-P11	5 meters
R3UL to R2SS	R3UL-P2 to R2SS-P25 R3UL-P6 to R2SS-P11	5 meters
R3UL to R3SS	R3UL-P30 to R3SS-P11 R3UL-P34 to R3SS-P25	3 meters
R3UL to R4SS	R3UL-P1 to R4SS-P25 R3UL-P4 to R4SS-P11	5 meters
R3UL to R5SS	R3UL-P32 to R5SS-P11 R3UL-P33 to R5SS-P12	5 meters
R3UL to R6SS	R3UL-P7 to R6SS-P11 R3UL-P36 to R6SS-P32	10 meters
R3UL to R7SS	R3UL-P31 to R7SS-P11 R3UL-P35 to R7SS-P12	10 meters
R3LL to R1SS	R3LL-P2 to R1SS-P32 R3LL-P4 to R1SS-P20	5 meters
R3LL to R2SS	R3LL-P1 to R2SS-P32 R3LL-P31 to R2SS-P20	5 meters
R3LL to R3SS	R3LL-P32 to R3SS-P20 R3LL-P34 to R3SS-P32	3 meters
R3LL to R4SS	R3LL-P33 to R4SS-P20 R3LL-P35 to R4SS-P32	5 meters
R3LL to R5SS	R3LL-P3 to R5SS-P32 R3LL-P5 to R5SS-P20	5 meters
R3LL to R6SS	R3LL-P6 to R6SS-P19 R3LL-P30 to R6SS-P20	10 meters
R3LL to R7SS	R3LL-P7 to R7SS-P20 R3LL-P36 to R7SS-P32	10 meters

Table 4-29 Leaf Switch Connections for the Fourth Rack in a Seven-Rack System

Switch Pair	Connections	Cable Length
R4UL to R1SS	R4UL-P3 to R1SS-P31 R4UL-P7 to R1SS-P10	10 meters
R4UL to R2SS	R4UL-P4 to R2SS-P9 R4UL-P6 to R2SS-P10	5 meters
R4UL to R3SS	R4UL-P1 to R3SS-P31 R4UL-P33 to R3SS-P10	5 meters
R4UL to R4SS	R4UL-P32 to R4SS-P10 R4UL-P34 to R4SS-P31	3 meters
R4UL to R5SS	R4UL-P2 to R5SS-P31 R4UL-P5 to R5SS-P10	5 meters
R4UL to R6SS	R4UL-P30 to R6SS-P10 R4UL-P35 to R6SS-P31	5 meters
R4UL to R7SS	R4UL-P31 to R7SS-P10 R4UL-P36 to R7SS-P31	10 meters
R4LL to R1SS	R4LL-P3 to R1SS-P27 R4LL-P5 to R1SS-P17	10 meters
R4LL to R2SS	R4LL-P2 to R2SS-P27 R4LL-P4 to R2SS-P17	5 meters
R4LL to R3SS	R4LL-P31 to R3SS-P17 R4LL-P33 to R3SS-P18	5 meters
R4LL to R4SS	R4LL-P30 to R4SS-P17 R4LL-P34 to R4SS-P27	3 meters
R4LL to R5SS	R4LL-P1 to R5SS-P27 R4LL-P7 to R5SS-P17	5 meters
R4LL to R6SS	R4LL-P6 to R6SS-P17 R4LL-P35 to R6SS-P27	5 meters
R4LL to R7SS	R4LL-P32 to R7SS-P17 R4LL-P36 to R7SS-P27	10 meters

Table 4-30 Leaf Switch Connections for the Fifth Rack in a Seven-Rack System

Switch Pair	Connections	Cable Length
R5UL to R1SS	R5UL-P3 to R1SS-P24 R5UL-P5 to R1SS-P8	10 meters
R5UL to R2SS	R5UL-P2 to R2SS-P24 R5UL-P4 to R2SS-P8	10 meters
R5UL to R3SS	R5UL-P1 to R3SS-P24 R5UL-P6 to R3SS-P12	5 meters
R5UL to R4SS	R5UL-P31 to R4SS-P7 R5UL-P33 to R4SS-P12	5 meters
R5UL to R5SS	R5UL-P30 to R5SS-P7 R5UL-P34 to R5SS-P25	3 meters
R5UL to R6SS	R5UL-P7 to R6SS-P7 R5UL-P35 to R6SS-P25	5 meters
R5UL to R7SS	R5UL-P32 to R7SS-P7 R5UL-P36 to R7SS-P25	5 meters
R5LL to R1SS	R5LL-P3 to R1SS-P29 R5LL-P7 to R1SS-P18	10 meters
R5LL to R2SS	R5LL-P2 to R2SS-P29 R5LL-P6 to R2SS-P18	10 meters
R5LL to R3SS	R5LL-P31 to R3SS-P16 R5LL-P34 to R3SS-P29	5 meters
R5LL to R4SS	R5LL-P33 to R4SS-P19 R5LL-P35 to R4SS-P29	5 meters
R5LL to R5SS	R5LL-P30 to R5SS-P15 R5LL-P32 to R5SS-P19	3 meters
R5LL to R6SS	R5LL-P1 to R6SS-P29 R5LL-P4 to R6SS-P15	5 meters
R5LL to R7SS	R5LL-P5 to R7SS-P15 R5LL-P36 to R7SS-P29	5 meters

Table 4-31 Leaf Switch Connections for the Sixth Rack in a Seven-Rack System

Switch Pair	Connections	Cable Length
R6UL to R1SS	R6UL-P3 to R1SS-P23 R6UL-P7 to R1SS-P16	10 meters
R6UL to R2SS	R6UL-P2 to R2SS-P23 R6UL-P4 to R2SS-P16	10 meters
R6UL to R3SS	R6UL-P1 to R3SS-P23 R6UL-P6 to R3SS-P19	10 meters
R6UL to R4SS	R6UL-P31 to R4SS-P15 R6UL-P34 to R4SS-P23	5 meters
R6UL to R5SS	R6UL-P33 to R5SS-P18 R6UL-P35 to R5SS-P23	5 meters
R6UL to R6SS	R6UL-P30 to R6SS-P16 R6UL-P32 to R6SS-P18	3 meters
R6UL to R7SS	R6UL-P5 to R7SS-P16 R6UL-P36 to R7SS-P26	5 meters
R6LL to R1SS	R6LL-P5 to R1SS-P12 R6LL-P7 to R1SS-P15	10 meters
R6LL to R2SS	R6LL-P2 to R2SS-P31 R6LL-P4 to R2SS-P12	10 meters
R6LL to R3SS	R6LL-P3 to R3SS-P28 R6LL-P31 to R3SS-P7	10 meters
R6LL to R4SS	R6LL-P33 to R4SS-P9 R6LL-P34 to R4SS-P24	5 meters
R6LL to R5SS	R6LL-P30 to R5SS-P8 R6LL-P35 to R5SS-P24	5 meters
R6LL to R6SS	R6LL-P32 to R6SS-P8 R6LL-P36 to R6SS-P24	3 meters
R6LL to R7SS	R6LL-P1 to R7SS-P24 R6LL-P6 to R7SS-P8	5 meters

Table 4-32 Leaf Switch Connections for the Seventh Rack in a Seven-Rack System

Switch Pair	Connections	Cable Length
R7UL to R1SS	R7UL-P3 to R1SS-P30 R7UL-P5 to R1SS-P9	10 meters
R7UL to R2SS	R7UL-P1 to R2SS-P30 R7UL-P7 to R2SS-P7	10 meters
R7UL to R3SS	R7UL-P2 to R3SS-P30 R7UL-P4 to R3SS-P9	10 meters
R7UL to R4SS	R7UL-P6 to R4SS-P8 R7UL-P34 to R4SS-P30	10 meters
R7UL to R5SS	R7UL-P31 to R5SS-P9 R7UL-P35 to R5SS-P30	5 meters
R7UL to R6SS	R7UL-P33 to R6SS-P9 R7UL-P36 to R6SS-P30	5 meters
R7UL to R7SS	R7UL-P30 to R7SS-P9 R7UL-P32 to R7SS-P30	3 meters
R7LL to R1SS	R7LL-P3 to R1SS-P26 R7LL-P5 to R1SS-P19	10 meters
R7LL to R2SS	R7LL-P1 to R2SS-P26 R7LL-P7 to R2SS-P19	10 meters
R7LL to R3SS	R7LL-P2 to R3SS-P26 R7LL-P4 to R3SS-P15	10 meters
R7LL to R4SS	R7LL-P6 to R4SS-P18 R7LL-P34 to R4SS-P26	10 meters
R7LL to R5SS	R7LL-P31 to R5SS-P16 R7LL-P35 to R5SS-P26	5 meters
R7LL to R6SS	R7LL-P33 to R6SS-P12 R7LL-P36 to R6SS-P26	5 meters
R7LL to R7SS	R7LL-P30 to R7SS-P18 R7LL-P32 to R7SS-P19	3 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-33 Seven-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R1UL-P7	3 meters
R1SS-P8	R5UL-P5	10 meters
R1SS-P9	R7UL-P5	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R6LL-P5	10 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R6LL-P7	10 meters
R1SS-P16	R6UL-P7	10 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R5LL-P7	10 meters
R1SS-P19	R7LL-P5	10 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R1LL-P3	3 meters
R1SS-P22	R2LL-P3	5 meters
R1SS-P23	R6UL-P3	10 meters
R1SS-P24	R5UL-P3	10 meters
R1SS-P25	R3UL-P3	5 meters
R1SS-P26	R7LL-P3	10 meters
R1SS-P27	R4LL-P3	10 meters
R1SS-P28	R2UL-P3	5 meters
R1SS-P29	R5LL-P3	10 meters
R1SS-P30	R7UL-P3	10 meters
R1SS-P31	R4UL-P3	10 meters
R1SS-P32	R3LL-P2	5 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R7UL-P7	10 meters
R2SS-P8	R5UL-P4	10 meters
R2SS-P9	R4UL-P4	5 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R6LL-P4	10 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R1LL-P33	5 meters
R2SS-P16	R6UL-P4	10 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R5LL-P6	10 meters
R2SS-P19	R7LL-P7	10 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R1UL-P3	5 meters
R2SS-P22	R2LL-P2	3 meters
R2SS-P23	R6UL-P2	10 meters
R2SS-P24	R5UL-P2	10 meters
R2SS-P25	R3UL-P2	5 meters
R2SS-P26	R7LL-P1	10 meters
R2SS-P27	R4LL-P2	5 meters
R2SS-P28	R2UL-P34	3 meters
R2SS-P29	R5LL-P2	10 meters
R2SS-P30	R7UL-P1	10 meters
R2SS-P31	R6LL-P2	10 meters
R2SS-P32	R3LL-P1	5 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R6LL-P31	10 meters
R3SS-P8	R2UL-P30	5 meters
R3SS-P9	R7UL-P4	10 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R5UL-P6	5 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R7LL-P4	10 meters
R3SS-P16	R5LL-P31	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R4LL-P33	5 meters
R3SS-P19	R6UL-P6	10 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R1LL-P2	5 meters
R3SS-P22	R2LL-P1	5 meters
R3SS-P23	R6UL-P1	10 meters
R3SS-P24	R5UL-P1	5 meters
R3SS-P25	R3UL-P34	3 meters
R3SS-P26	R7LL-P2	10 meters
R3SS-P27	R1UL-P1	5 meters
R3SS-P28	R6LL-P3	10 meters
R3SS-P29	R5LL-P34	5 meters
R3SS-P30	R7UL-P2	10 meters
R3SS-P31	R4UL-P1	5 meters
R3SS-P32	R3LL-P34	3 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R5UL-P31	5 meters
R4SS-P8	R7UL-P6	10 meters
R4SS-P9	R6LL-P33	5 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R5UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R6UL-P31	5 meters
R4SS-P16	R2LL-P30	5 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R7LL-P6	10 meters
R4SS-P19	R5LL-P33	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R1LL-P34	10 meters
R4SS-P22	R1UL-P2	10 meters
R4SS-P23	R6UL-P34	5 meters
R4SS-P24	R6LL-P34	5 meters
R4SS-P25	R3UL-P1	5 meters
R4SS-P26	R7LL-P34	10 meters
R4SS-P27	R4LL-P34	3 meters
R4SS-P28	R2UL-P2	5 meters
R4SS-P29	R5LL-P35	5 meters
R4SS-P30	R7UL-P34	10 meters
R4SS-P31	R4UL-P34	3 meters
R4SS-P32	R3LL-P35	5 meters
R5SS-P5	R1UL-P30	10 meters
R5SS-P6	R2UL-P7	10 meters
R5SS-P7	R5UL-P30	3 meters
R5SS-P8	R6LL-P30	5 meters
R5SS-P9	R7UL-P31	5 meters
R5SS-P10	R4UL-P5	5 meters
R5SS-P11	R3UL-P32	5 meters
R5SS-P12	R3UL-P33	5 meters
R5SS-P13	R1LL-P7	10 meters
R5SS-P14	R2LL-P33	10 meters
R5SS-P15	R5LL-P30	3 meters
R5SS-P16	R7LL-P31	5 meters
R5SS-P17	R4LL-P7	5 meters
R5SS-P18	R6UL-P33	5 meters
R5SS-P19	R5LL-P32	3 meters
R5SS-P20	R3LL-P5	5 meters
R5SS-P21	R1LL-P35	10 meters
R5SS-P22	R2LL-P35	10 meters
R5SS-P23	R6UL-P35	5 meters
R5SS-P24	R6LL-P35	5 meters
R5SS-P25	R5UL-P34	3 meters
R5SS-P26	R7LL-P35	5 meters
R5SS-P27	R4LL-P1	5 meters
R5SS-P28	R2UL-P1	10 meters
R5SS-P29	R1UL-P34	10 meters
R5SS-P30	R7UL-P35	5 meters
R5SS-P31	R4UL-P2	5 meters
R5SS-P32	R3LL-P3	5 meters
R6SS-P5	R1UL-P32	10 meters
R6SS-P6	R2UL-P33	10 meters
R6SS-P7	R5UL-P7	5 meters
R6SS-P8	R6LL-P32	3 meters
R6SS-P9	R7UL-P33	5 meters
R6SS-P10	R4UL-P30	5 meters
R6SS-P11	R3UL-P7	10 meters
R6SS-P12	R7LL-P33	5 meters
R6SS-P13	R1LL-P32	10 meters
R6SS-P14	R2LL-P7	10 meters
R6SS-P15	R5LL-P4	5 meters
R6SS-P16	R6UL-P30	3 meters
R6SS-P17	R4LL-P6	5 meters
R6SS-P18	R6UL-P32	3 meters
R6SS-P19	R3LL-P6	10 meters
R6SS-P20	R3LL-P30	10 meters
R6SS-P21	R1LL-P36	10 meters
R6SS-P22	R2LL-P36	10 meters
R6SS-P23	R1UL-P35	10 meters
R6SS-P24	R6LL-P36	3 meters
R6SS-P25	R5UL-P35	5 meters
R6SS-P26	R7LL-P36	5 meters
R6SS-P27	R4LL-P35	5 meters
R6SS-P28	R2UL-P35	10 meters
R6SS-P29	R5LL-P1	5 meters
R6SS-P30	R7UL-P36	5 meters
R6SS-P31	R4UL-P35	5 meters
R6SS-P32	R3UL-P36	10 meters
R7SS-P5	R1UL-P33	10 meters
R7SS-P6	R2UL-P32	10 meters
R7SS-P7	R5UL-P32	5 meters
R7SS-P8	R6LL-P6	5 meters
R7SS-P9	R7UL-P30	3 meters
R7SS-P10	R4UL-P31	10 meters
R7SS-P11	R3UL-P31	10 meters
R7SS-P12	R3UL-P35	10 meters
R7SS-P13	R1LL-P6	10 meters
R7SS-P14	R2LL-P32	10 meters
R7SS-P15	R5LL-P5	5 meters
R7SS-P16	R6UL-P5	5 meters
R7SS-P17	R4LL-P32	10 meters
R7SS-P18	R7LL-P30	3 meters
R7SS-P19	R7LL-P32	3 meters
R7SS-P20	R3LL-P7	10 meters
R7SS-P21	R1LL-P1	10 meters
R7SS-P22	R2LL-P34	10 meters
R7SS-P23	R1UL-P36	10 meters
R7SS-P24	R6LL-P1	5 meters
R7SS-P25	R5UL-P36	5 meters
R7SS-P26	R6UL-P36	5 meters
R7SS-P27	R4LL-P36	10 meters
R7SS-P28	R2UL-P36	10 meters
R7SS-P29	R5LL-P36	5 meters
R7SS-P30	R7UL-P32	3 meters
R7SS-P31	R4UL-P36	10 meters
R7SS-P32	R3LL-P36	10 meters

4.9 Eight-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect eight racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.

The following tables contain details for all of the RoCE Network Fabric cabling connections in an eight-rack system.

Table 4-34 Leaf Switch Connections for the First Rack in a Eight-Rack System

Connection	Cable Length
R1UL-P1 to R3SS-P23	5 meters
R1UL-P2 to R4SS-P23	10 meters
R1UL-P3 to R1SS-P23	3 meters
R1UL-P4 to R4SS-P5	10 meters
R1UL-P5 to R1SS-P5	3 meters
R1UL-P6 to R3SS-P5	5 meters
R1UL-P7 to R8SS-P5	10 meters
R1UL-P30 to R5SS-P5	10 meters
R1UL-P31 to R2SS-P5	5 meters
R1UL-P32 to R6SS-P5	10 meters
R1UL-P33 to R7SS-P5	10 meters
R1UL-P34 to R2SS-P23	5 meters
R1UL-P35 to R5SS-P23	10 meters
R1UL-P36 to R6SS-P23	10 meters
R1LL-P1 to R2SS-P24	5 meters
R1LL-P2 to R3SS-P24	5 meters
R1LL-P3 to R5SS-P24	10 meters
R1LL-P4 to R3SS-P13	5 meters
R1LL-P5 to R1SS-P13	3 meters
R1LL-P6 to R7SS-P13	10 meters
R1LL-P7 to R5SS-P13	10 meters
R1LL-P30 to R4SS-P13	10 meters
R1LL-P31 to R2SS-P13	5 meters
R1LL-P32 to R6SS-P13	10 meters
R1LL-P33 to R8SS-P13	10 meters
R1LL-P34 to R4SS-P24	10 meters
R1LL-P35 to R6SS-P24	10 meters
R1LL-P36 to R7SS-P24	10 meters

Table 4-35 Leaf Switch Connections for the Second Rack in a Eight-Rack System

Connection	Cable Length
R2UL-P1 to R5SS-P25	10 meters
R2UL-P2 to R3SS-P25	5 meters
R2UL-P3 to R4SS-P25	5 meters
R2UL-P4 to R4SS-P6	5 meters
R2UL-P5 to R1SS-P6	5 meters
R2UL-P6 to R3SS-P6	5 meters
R2UL-P7 to R5SS-P6	10 meters
R2UL-P30 to R8SS-P6	10 meters
R2UL-P31 to R2SS-P6	3 meters
R2UL-P32 to R7SS-P6	10 meters
R2UL-P33 to R6SS-P6	10 meters
R2UL-P34 to R7SS-P25	10 meters
R2UL-P35 to R6SS-P25	10 meters
R2UL-P36 to R8SS-P25	10 meters
R2LL-P1 to R6SS-P32	10 meters
R2LL-P2 to R4SS-P32	5 meters
R2LL-P3 to R1SS-P22	5 meters
R2LL-P4 to R4SS-P14	5 meters
R2LL-P5 to R1SS-P14	5 meters
R2LL-P6 to R3SS-P14	5 meters
R2LL-P7 to R6SS-P14	10 meters
R2LL-P30 to R8SS-P14	10 meters
R2LL-P31 to R2SS-P14	3 meters
R2LL-P32 to R7SS-P14	10 meters
R2LL-P33 to R5SS-P14	10 meters
R2LL-P34 to R7SS-P32	10 meters
R2LL-P35 to R5SS-P32	10 meters
R2LL-P36 to R8SS-P32	10 meters

Table 4-36 Leaf Switch Connections for the Third Rack in a Eight-Rack System

Connection	Cable Length
R3UL-P1 to R6SS-P31	10 meters
R3UL-P2 to R2SS-P25	5 meters
R3UL-P3 to R1SS-P25	5 meters
R3UL-P4 to R4SS-P11	5 meters
R3UL-P5 to R1SS-P11	5 meters
R3UL-P6 to R2SS-P11	5 meters
R3UL-P7 to R6SS-P11	10 meters
R3UL-P30 to R3SS-P11	3 meters
R3UL-P31 to R7SS-P11	10 meters
R3UL-P32 to R5SS-P11	5 meters
R3UL-P33 to R8SS-P11	10 meters
R3UL-P34 to R5SS-P31	5 meters
R3UL-P35 to R7SS-P31	10 meters
R3UL-P36 to R8SS-P31	10 meters
R3LL-P1 to R7SS-P27	10 meters
R3LL-P2 to R1SS-P32	5 meters
R3LL-P3 to R2SS-P32	5 meters
R3LL-P4 to R1SS-P20	5 meters
R3LL-P5 to R5SS-P20	5 meters
R3LL-P6 to R8SS-P20	10 meters
R3LL-P7 to R7SS-P20	10 meters
R3LL-P30 to R6SS-P20	10 meters
R3LL-P31 to R2SS-P20	5 meters
R3LL-P32 to R3SS-P20	3 meters
R3LL-P33 to R4SS-P20	5 meters
R3LL-P34 to R3SS-P32	3 meters
R3LL-P35 to R6SS-P27	10 meters
R3LL-P36 to R8SS-P27	10 meters

Table 4-37 Leaf Switch Connections for the Fourth Rack in a Eight-Rack System

Connection	Cable Length
R4UL-P1 to R8SS-P23	10 meters
R4UL-P2 to R2SS-P31	5 meters
R4UL-P3 to R1SS-P31	10 meters
R4UL-P4 to R8SS-P10	10 meters
R4UL-P5 to R5SS-P10	5 meters
R4UL-P6 to R2SS-P10	5 meters
R4UL-P7 to R1SS-P10	10 meters
R4UL-P30 to R6SS-P10	5 meters
R4UL-P31 to R7SS-P10	10 meters
R4UL-P32 to R4SS-P10	3 meters
R4UL-P33 to R3SS-P10	5 meters
R4UL-P34 to R4SS-P31	3 meters
R4UL-P35 to R3SS-P31	5 meters
R4UL-P36 to R7SS-P23	10 meters
R4LL-P1 to R5SS-P27	5 meters
R4LL-P2 to R2SS-P27	5 meters
R4LL-P3 to R1SS-P27	10 meters
R4LL-P4 to R2SS-P17	5 meters
R4LL-P5 to R1SS-P17	10 meters
R4LL-P6 to R6SS-P17	5 meters
R4LL-P7 to R5SS-P17	5 meters
R4LL-P30 to R4SS-P17	3 meters
R4LL-P31 to R3SS-P17	5 meters
R4LL-P32 to R7SS-P17	10 meters
R4LL-P33 to R8SS-P17	10 meters
R4LL-P34 to R3SS-P27	5 meters
R4LL-P35 to R4SS-P27	3 meters
R4LL-P36 to R8SS-P24	10 meters

Table 4-38 Leaf Switch Connections for the Fifth Rack in a Eight-Rack System

Connection	Cable Length
R5UL-P1 to R3SS-P28	5 meters
R5UL-P2 to R2SS-P28	10 meters
R5UL-P3 to R1SS-P28	10 meters
R5UL-P4 to R2SS-P8	10 meters
R5UL-P5 to R1SS-P8	10 meters
R5UL-P6 to R3SS-P8	5 meters
R5UL-P7 to R6SS-P7	5 meters
R5UL-P30 to R5SS-P7	3 meters
R5UL-P31 to R8SS-P7	10 meters
R5UL-P32 to R7SS-P7	5 meters
R5UL-P33 to R4SS-P12	5 meters
R5UL-P34 to R4SS-P28	5 meters
R5UL-P35 to R5SS-P28	3 meters
R5UL-P36 to R6SS-P28	5 meters
R5LL-P1 to R7SS-P22	5 meters
R5LL-P2 to R6SS-P22	5 meters
R5LL-P3 to R2SS-P22	10 meters
R5LL-P4 to R6SS-P15	5 meters
R5LL-P5 to R7SS-P15	5 meters
R5LL-P6 to R2SS-P18	10 meters
R5LL-P7 to R1SS-P18	10 meters
R5LL-P30 to R5SS-P15	3 meters
R5LL-P31 to R3SS-P16	5 meters
R5LL-P32 to R8SS-P15	10 meters
R5LL-P33 to R4SS-P19	5 meters
R5LL-P34 to R3SS-P22	5 meters
R5LL-P35 to R4SS-P22	5 meters
R5LL-P36 to R5SS-P22	3 meters

Table 4-39 Leaf Switch Connections for the Sixth Rack in a Eight-Rack System

Connection	Cable Length
R6UL-P1 to R4SS-P30	5 meters
R6UL-P2 to R3SS-P30	10 meters
R6UL-P3 to R7SS-P30	5 meters
R6UL-P4 to R2SS-P16	10 meters
R6UL-P5 to R7SS-P16	5 meters
R6UL-P6 to R3SS-P19	10 meters
R6UL-P7 to R1SS-P16	10 meters
R6UL-P30 to R6SS-P16	3 meters
R6UL-P31 to R4SS-P15	5 meters
R6UL-P32 to R8SS-P16	5 meters
R6UL-P33 to R5SS-P18	5 meters
R6UL-P34 to R5SS-P30	5 meters
R6UL-P35 to R6SS-P30	3 meters
R6UL-P36 to R8SS-P30	5 meters
R6LL-P1 to R8SS-P26	5 meters
R6LL-P2 to R7SS-P26	5 meters
R6LL-P3 to R1SS-P24	10 meters
R6LL-P4 to R2SS-P12	10 meters
R6LL-P5 to R1SS-P12	10 meters
R6LL-P6 to R7SS-P8	5 meters
R6LL-P7 to R8SS-P8	5 meters
R6LL-P30 to R5SS-P8	5 meters
R6LL-P31 to R3SS-P7	10 meters
R6LL-P32 to R6SS-P8	3 meters
R6LL-P33 to R4SS-P9	5 meters
R6LL-P34 to R4SS-P26	5 meters
R6LL-P35 to R5SS-P26	5 meters
R6LL-P36 to R6SS-P26	3 meters

Table 4-40 Leaf Switch Connections for the Seventh Rack in a Eight-Rack System

Connection	Cable Length
R7UL-P1 to R2SS-P30	10 meters
R7UL-P2 to R5SS-P21	5 meters
R7UL-P3 to R1SS-P30	10 meters
R7UL-P4 to R3SS-P9	10 meters
R7UL-P5 to R1SS-P9	10 meters
R7UL-P6 to R4SS-P8	10 meters
R7UL-P7 to R2SS-P7	10 meters
R7UL-P30 to R7SS-P9	3 meters
R7UL-P31 to R5SS-P9	5 meters
R7UL-P32 to R8SS-P9	5 meters
R7UL-P33 to R6SS-P9	5 meters
R7UL-P34 to R8SS-P21	5 meters
R7UL-P35 to R6SS-P21	5 meters
R7UL-P36 to R7SS-P21	3 meters
R7LL-P1 to R2SS-P26	10 meters
R7LL-P2 to R3SS-P26	10 meters
R7LL-P3 to R1SS-P26	10 meters
R7LL-P4 to R3SS-P15	10 meters
R7LL-P5 to R1SS-P19	10 meters
R7LL-P6 to R4SS-P18	10 meters
R7LL-P7 to R2SS-P19	10 meters
R7LL-P30 to R7SS-P18	3 meters
R7LL-P31 to R5SS-P16	5 meters
R7LL-P32 to R8SS-P12	5 meters
R7LL-P33 to R6SS-P18	5 meters
R7LL-P34 to R6SS-P29	5 meters
R7LL-P35 to R7SS-P29	3 meters
R7LL-P36 to R8SS-P29	5 meters

Table 4-41 Leaf Switch Connections for the Eighth Rack in a Eight-Rack System

Connection	Cable Length
R8UL-P1 to R2SS-P21	10 meters
R8UL-P2 to R3SS-P21	10 meters
R8UL-P3 to R1SS-P21	10 meters
R8UL-P4 to R3SS-P18	10 meters
R8UL-P5 to R1SS-P15	10 meters
R8UL-P6 to R4SS-P16	10 meters
R8UL-P7 to R2SS-P15	10 meters
R8UL-P30 to R7SS-P19	5 meters
R8UL-P31 to R5SS-P19	10 meters
R8UL-P32 to R8SS-P19	3 meters
R8UL-P33 to R6SS-P19	5 meters
R8UL-P34 to R7SS-P28	5 meters
R8UL-P35 to R8SS-P28	3 meters
R8UL-P36 to R4SS-P21	10 meters
R8LL-P1 to R2SS-P29	10 meters
R8LL-P2 to R3SS-P29	10 meters
R8LL-P3 to R1SS-P29	10 meters
R8LL-P4 to R3SS-P12	10 meters
R8LL-P5 to R1SS-P7	10 meters
R8LL-P6 to R4SS-P7	10 meters
R8LL-P7 to R2SS-P9	10 meters
R8LL-P30 to R7SS-P12	5 meters
R8LL-P31 to R5SS-P12	10 meters
R8LL-P32 to R8SS-P18	3 meters
R8LL-P33 to R6SS-P12	5 meters
R8LL-P34 to R8SS-P22	3 meters
R8LL-P35 to R5SS-P29	10 meters
R8LL-P36 to R4SS-P29	10 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-42 Eight-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R8LL-P5	10 meters
R1SS-P8	R5UL-P5	10 meters
R1SS-P9	R7UL-P5	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R6LL-P5	10 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R8UL-P5	10 meters
R1SS-P16	R6UL-P7	10 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R5LL-P7	10 meters
R1SS-P19	R7LL-P5	10 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R8UL-P3	10 meters
R1SS-P22	R2LL-P3	5 meters
R1SS-P23	R1UL-P3	3 meters
R1SS-P24	R6LL-P3	10 meters
R1SS-P25	R3UL-P3	5 meters
R1SS-P26	R7LL-P3	10 meters
R1SS-P27	R4LL-P3	10 meters
R1SS-P28	R5UL-P3	10 meters
R1SS-P29	R8LL-P3	10 meters
R1SS-P30	R7UL-P3	10 meters
R1SS-P31	R4UL-P3	10 meters
R1SS-P32	R3LL-P2	5 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R7UL-P7	10 meters
R2SS-P8	R5UL-P4	10 meters
R2SS-P9	R8LL-P7	10 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R6LL-P4	10 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R8UL-P7	10 meters
R2SS-P16	R6UL-P4	10 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R5LL-P6	10 meters
R2SS-P19	R7LL-P7	10 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R8UL-P1	10 meters
R2SS-P22	R5LL-P3	10 meters
R2SS-P23	R1UL-P34	5 meters
R2SS-P24	R1LL-P1	5 meters
R2SS-P25	R3UL-P2	5 meters
R2SS-P26	R7LL-P1	10 meters
R2SS-P27	R4LL-P2	5 meters
R2SS-P28	R5UL-P2	10 meters
R2SS-P29	R8LL-P1	10 meters
R2SS-P30	R7UL-P1	10 meters
R2SS-P31	R4UL-P2	5 meters
R2SS-P32	R3LL-P3	5 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R6LL-P31	10 meters
R3SS-P8	R5UL-P6	5 meters
R3SS-P9	R7UL-P4	10 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R8LL-P4	10 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R7LL-P4	10 meters
R3SS-P16	R5LL-P31	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R8UL-P4	10 meters
R3SS-P19	R6UL-P6	10 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R8UL-P2	10 meters
R3SS-P22	R5LL-P34	5 meters
R3SS-P23	R1UL-P1	5 meters
R3SS-P24	R1LL-P2	5 meters
R3SS-P25	R2UL-P2	5 meters
R3SS-P26	R7LL-P2	10 meters
R3SS-P27	R4LL-P34	5 meters
R3SS-P28	R5UL-P1	5 meters
R3SS-P29	R8LL-P2	10 meters
R3SS-P30	R6UL-P2	10 meters
R3SS-P31	R4UL-P35	5 meters
R3SS-P32	R3LL-P34	3 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R8LL-P6	10 meters
R4SS-P8	R7UL-P6	10 meters
R4SS-P9	R6LL-P33	5 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R5UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R6UL-P31	5 meters
R4SS-P16	R8UL-P6	10 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R7LL-P6	10 meters
R4SS-P19	R5LL-P33	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R8UL-P36	10 meters
R4SS-P22	R5LL-P35	5 meters
R4SS-P23	R1UL-P2	10 meters
R4SS-P24	R1LL-P34	10 meters
R4SS-P25	R2UL-P3	5 meters
R4SS-P26	R6LL-P34	5 meters
R4SS-P27	R4LL-P35	3 meters
R4SS-P28	R5UL-P34	5 meters
R4SS-P29	R8LL-P36	10 meters
R4SS-P30	R6UL-P1	5 meters
R4SS-P31	R4UL-P34	3 meters
R4SS-P32	R2LL-P2	5 meters
R5SS-P5	R1UL-P30	10 meters
R5SS-P6	R2UL-P7	10 meters
R5SS-P7	R5UL-P30	3 meters
R5SS-P8	R6LL-P30	5 meters
R5SS-P9	R7UL-P31	5 meters
R5SS-P10	R4UL-P5	5 meters
R5SS-P11	R3UL-P32	5 meters
R5SS-P12	R8LL-P31	10 meters
R5SS-P13	R1LL-P7	10 meters
R5SS-P14	R2LL-P33	10 meters
R5SS-P15	R5LL-P30	3 meters
R5SS-P16	R7LL-P31	5 meters
R5SS-P17	R4LL-P7	5 meters
R5SS-P18	R6UL-P33	5 meters
R5SS-P19	R8UL-P31	10 meters
R5SS-P20	R3LL-P5	5 meters
R5SS-P21	R7UL-P2	5 meters
R5SS-P22	R5LL-P36	3 meters
R5SS-P23	R1UL-P35	10 meters
R5SS-P24	R1LL-P3	10 meters
R5SS-P25	R2UL-P1	10 meters
R5SS-P26	R6LL-P35	5 meters
R5SS-P27	R4LL-P1	5 meters
R5SS-P28	R5UL-P35	3 meters
R5SS-P29	R8LL-P35	10 meters
R5SS-P30	R6UL-P34	5 meters
R5SS-P31	R3UL-P34	5 meters
R5SS-P32	R2LL-P35	10 meters
R6SS-P5	R1UL-P32	10 meters
R6SS-P6	R2UL-P33	10 meters
R6SS-P7	R5UL-P7	5 meters
R6SS-P8	R6LL-P32	3 meters
R6SS-P9	R7UL-P33	5 meters
R6SS-P10	R4UL-P30	5 meters
R6SS-P11	R3UL-P7	10 meters
R6SS-P12	R8LL-P33	5 meters
R6SS-P13	R1LL-P32	10 meters
R6SS-P14	R2LL-P7	10 meters
R6SS-P15	R5LL-P4	5 meters
R6SS-P16	R6UL-P30	3 meters
R6SS-P17	R4LL-P6	5 meters
R6SS-P18	R7LL-P33	5 meters
R6SS-P19	R8UL-P33	5 meters
R6SS-P20	R3LL-P30	10 meters
R6SS-P21	R7UL-P35	5 meters
R6SS-P22	R5LL-P2	5 meters
R6SS-P23	R1UL-P36	10 meters
R6SS-P24	R1LL-P35	10 meters
R6SS-P25	R2UL-P35	10 meters
R6SS-P26	R6LL-P36	3 meters
R6SS-P27	R3LL-P35	10 meters
R6SS-P28	R5UL-P36	5 meters
R6SS-P29	R7LL-P34	5 meters
R6SS-P30	R6UL-P35	3 meters
R6SS-P31	R3UL-P1	10 meters
R6SS-P32	R2LL-P1	10 meters
R7SS-P5	R1UL-P33	10 meters
R7SS-P6	R2UL-P32	10 meters
R7SS-P7	R5UL-P32	5 meters
R7SS-P8	R6LL-P6	5 meters
R7SS-P9	R7UL-P30	3 meters
R7SS-P10	R4UL-P31	10 meters
R7SS-P11	R3UL-P31	10 meters
R7SS-P12	R8LL-P30	5 meters
R7SS-P13	R1LL-P6	10 meters
R7SS-P14	R2LL-P32	10 meters
R7SS-P15	R5LL-P5	5 meters
R7SS-P16	R6UL-P5	5 meters
R7SS-P17	R4LL-P32	10 meters
R7SS-P18	R7LL-P30	3 meters
R7SS-P19	R8UL-P30	5 meters
R7SS-P20	R3LL-P7	10 meters
R7SS-P21	R7UL-P36	3 meters
R7SS-P22	R5LL-P1	5 meters
R7SS-P23	R4UL-P36	10 meters
R7SS-P24	R1LL-P36	10 meters
R7SS-P25	R2UL-P34	10 meters
R7SS-P26	R6LL-P2	5 meters
R7SS-P27	R3LL-P1	10 meters
R7SS-P28	R8UL-P34	5 meters
R7SS-P29	R7LL-P35	3 meters
R7SS-P30	R6UL-P3	5 meters
R7SS-P31	R3UL-P35	10 meters
R7SS-P32	R2LL-P34	10 meters
R8SS-P5	R1UL-P7	10 meters
R8SS-P6	R2UL-P30	10 meters
R8SS-P7	R5UL-P31	10 meters
R8SS-P8	R6LL-P7	5 meters
R8SS-P9	R7UL-P32	5 meters
R8SS-P10	R4UL-P4	10 meters
R8SS-P11	R3UL-P33	10 meters
R8SS-P12	R7LL-P32	5 meters
R8SS-P13	R1LL-P33	10 meters
R8SS-P14	R2LL-P30	10 meters
R8SS-P15	R5LL-P32	10 meters
R8SS-P16	R6UL-P32	5 meters
R8SS-P17	R4LL-P33	10 meters
R8SS-P18	R8LL-P32	3 meters
R8SS-P19	R8UL-P32	3 meters
R8SS-P20	R3LL-P6	10 meters
R8SS-P21	R7UL-P34	5 meters
R8SS-P22	R8LL-P34	3 meters
R8SS-P23	R4UL-P1	10 meters
R8SS-P24	R4LL-P36	10 meters
R8SS-P25	R2UL-P36	10 meters
R8SS-P26	R6LL-P1	5 meters
R8SS-P27	R3LL-P36	10 meters
R8SS-P28	R8UL-P35	3 meters
R8SS-P29	R7LL-P36	5 meters
R8SS-P30	R6UL-P36	5 meters
R8SS-P31	R3UL-P36	10 meters
R8SS-P32	R2LL-P36	10 meters

4.10 Nine-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect nine racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a 9 rack system.

Table 4-43 Leaf Switch Connections for the First Rack in a 9 Rack System

Connection	Cable Length
R1UL-P1 to R3SS-P23	5 meters
R1UL-P2 to R4SS-P23	10 meters
R1UL-P3 to R1SS-P23	3 meters
R1UL-P4 to R4SS-P5	10 meters
R1UL-P5 to R1SS-P5	3 meters
R1UL-P6 to R3SS-P5	5 meters
R1UL-P7 to R8SS-P5	10 meters
R1UL-P30 to R5SS-P5	10 meters
R1UL-P31 to R2SS-P5	5 meters
R1UL-P32 to R6SS-P5	10 meters
R1UL-P33 to R7SS-P5	10 meters
R1UL-P34 to R2SS-P23	5 meters
R1UL-P35 to R5SS-P23	10 meters
R1UL-P36 to R9SS-P5	10 meters
R1LL-P1 to R2SS-P25	5 meters
R1LL-P2 to R3SS-P25	5 meters
R1LL-P3 to R5SS-P25	10 meters
R1LL-P4 to R3SS-P13	5 meters
R1LL-P5 to R1SS-P13	3 meters
R1LL-P6 to R7SS-P13	10 meters
R1LL-P7 to R5SS-P13	10 meters
R1LL-P30 to R4SS-P13	10 meters
R1LL-P31 to R2SS-P13	5 meters
R1LL-P32 to R6SS-P13	10 meters
R1LL-P33 to R8SS-P13	10 meters
R1LL-P34 to R4SS-P25	10 meters
R1LL-P35 to R6SS-P25	10 meters
R1LL-P36 to R9SS-P13	10 meters

Table 4-44 Leaf Switch Connections for the Second Rack in a 9 Rack System

Connection	Cable Length
R2UL-P1 to R5SS-P31	10 meters
R2UL-P2 to R3SS-P31	5 meters
R2UL-P3 to R4SS-P31	5 meters
R2UL-P4 to R4SS-P6	5 meters
R2UL-P5 to R1SS-P6	5 meters
R2UL-P6 to R3SS-P6	5 meters
R2UL-P7 to R5SS-P6	10 meters
R2UL-P30 to R8SS-P6	10 meters
R2UL-P31 to R2SS-P6	3 meters
R2UL-P32 to R7SS-P6	10 meters
R2UL-P33 to R6SS-P6	10 meters
R2UL-P34 to R7SS-P31	10 meters
R2UL-P35 to R6SS-P31	10 meters
R2UL-P36 to R9SS-P6	10 meters
R2LL-P1 to R6SS-P27	10 meters
R2LL-P2 to R4SS-P27	5 meters
R2LL-P3 to R9SS-P14	10 meters
R2LL-P4 to R4SS-P14	5 meters
R2LL-P5 to R1SS-P14	5 meters
R2LL-P6 to R3SS-P14	5 meters
R2LL-P7 to R6SS-P14	10 meters
R2LL-P30 to R8SS-P14	10 meters
R2LL-P31 to R2SS-P14	3 meters
R2LL-P32 to R7SS-P14	10 meters
R2LL-P33 to R5SS-P14	10 meters
R2LL-P34 to R7SS-P27	10 meters
R2LL-P35 to R5SS-P27	10 meters
R2LL-P36 to R8SS-P27	10 meters

Table 4-45 Leaf Switch Connections for the Third Rack in a 9 Rack System

Connection	Cable Length
R3UL-P1 to R6SS-P28	10 meters
R3UL-P2 to R9SS-P11	10 meters
R3UL-P3 to R9SS-P28	10 meters
R3UL-P4 to R4SS-P11	5 meters
R3UL-P5 to R1SS-P11	5 meters
R3UL-P6 to R2SS-P11	5 meters
R3UL-P7 to R6SS-P11	10 meters
R3UL-P30 to R3SS-P11	3 meters
R3UL-P31 to R7SS-P11	10 meters
R3UL-P32 to R5SS-P11	5 meters
R3UL-P33 to R8SS-P11	10 meters
R3UL-P34 to R5SS-P28	5 meters
R3UL-P35 to R7SS-P28	10 meters
R3UL-P36 to R8SS-P28	10 meters
R3LL-P1 to R7SS-P23	10 meters
R3LL-P2 to R1SS-P32	5 meters
R3LL-P3 to R9SS-P20	10 meters
R3LL-P4 to R1SS-P20	5 meters
R3LL-P5 to R5SS-P20	5 meters
R3LL-P6 to R8SS-P20	10 meters
R3LL-P7 to R7SS-P20	10 meters
R3LL-P30 to R6SS-P20	10 meters
R3LL-P31 to R2SS-P20	5 meters
R3LL-P32 to R3SS-P20	3 meters
R3LL-P33 to R4SS-P20	5 meters
R3LL-P34 to R9SS-P23	10 meters
R3LL-P35 to R6SS-P23	10 meters
R3LL-P36 to R8SS-P23	10 meters

Table 4-46 Leaf Switch Connections for the Fourth Rack in a 9 Rack System

Connection	Cable Length
R4UL-P1 to R8SS-P25	10 meters
R4UL-P2 to R2SS-P31	5 meters
R4UL-P3 to R1SS-P31	10 meters
R4UL-P4 to R8SS-P10	10 meters
R4UL-P5 to R5SS-P10	5 meters
R4UL-P6 to R2SS-P10	5 meters
R4UL-P7 to R1SS-P10	10 meters
R4UL-P30 to R6SS-P10	5 meters
R4UL-P31 to R7SS-P10	10 meters
R4UL-P32 to R4SS-P10	3 meters
R4UL-P33 to R3SS-P10	5 meters
R4UL-P34 to R9SS-P10	10 meters
R4UL-P35 to R9SS-P25	10 meters
R4UL-P36 to R7SS-P25	10 meters
R4LL-P1 to R9SS-P17	10 meters
R4LL-P2 to R2SS-P27	5 meters
R4LL-P3 to R1SS-P27	10 meters
R4LL-P4 to R2SS-P17	5 meters
R4LL-P5 to R1SS-P17	10 meters
R4LL-P6 to R6SS-P17	5 meters
R4LL-P7 to R5SS-P17	5 meters
R4LL-P30 to R4SS-P17	3 meters
R4LL-P31 to R3SS-P17	5 meters
R4LL-P32 to R7SS-P17	10 meters
R4LL-P33 to R8SS-P17	10 meters
R4LL-P34 to R3SS-P27	5 meters
R4LL-P35 to R9SS-P31	10 meters
R4LL-P36 to R8SS-P31	10 meters

Table 4-47 Leaf Switch Connections for the Fifth Rack in a 9 Rack System

Connection	Cable Length
R5UL-P1 to R3SS-P28	5 meters
R5UL-P2 to R2SS-P28	10 meters
R5UL-P3 to R1SS-P28	10 meters
R5UL-P4 to R2SS-P8	10 meters
R5UL-P5 to R1SS-P8	10 meters
R5UL-P6 to R3SS-P8	5 meters
R5UL-P7 to R6SS-P7	5 meters
R5UL-P30 to R5SS-P7	3 meters
R5UL-P31 to R8SS-P7	10 meters
R5UL-P32 to R7SS-P7	5 meters
R5UL-P33 to R4SS-P12	5 meters
R5UL-P34 to R4SS-P28	5 meters
R5UL-P35 to R9SS-P7	10 meters
R5UL-P36 to R9SS-P27	10 meters
R5LL-P1 to R9SS-P15	10 meters
R5LL-P2 to R1SS-P22	10 meters
R5LL-P3 to R2SS-P22	10 meters
R5LL-P4 to R6SS-P15	5 meters
R5LL-P5 to R7SS-P15	5 meters
R5LL-P6 to R2SS-P18	10 meters
R5LL-P7 to R1SS-P18	10 meters
R5LL-P30 to R5SS-P15	3 meters
R5LL-P31 to R3SS-P16	5 meters
R5LL-P32 to R8SS-P15	10 meters
R5LL-P33 to R4SS-P19	5 meters
R5LL-P34 to R3SS-P22	5 meters
R5LL-P35 to R4SS-P22	5 meters
R5LL-P36 to R5SS-P22	3 meters

Table 4-48 Leaf Switch Connections for the Sixth Rack in a 9 Rack System

Connection	Cable Length
R6UL-P1 to R4SS-P32	5 meters
R6UL-P2 to R3SS-P32	10 meters
R6UL-P3 to R9SS-P16	10 meters
R6UL-P4 to R2SS-P16	10 meters
R6UL-P5 to R7SS-P16	5 meters
R6UL-P6 to R3SS-P19	10 meters
R6UL-P7 to R1SS-P16	10 meters
R6UL-P30 to R6SS-P16	3 meters
R6UL-P31 to R4SS-P15	5 meters
R6UL-P32 to R8SS-P16	5 meters
R6UL-P33 to R5SS-P18	5 meters
R6UL-P34 to R5SS-P32	5 meters
R6UL-P35 to R6SS-P32	3 meters
R6UL-P36 to R2SS-P32	10 meters
R6LL-P1 to R9SS-P8	10 meters
R6LL-P2 to R7SS-P21	5 meters
R6LL-P3 to R3SS-P21	10 meters
R6LL-P4 to R2SS-P12	10 meters
R6LL-P5 to R1SS-P12	10 meters
R6LL-P6 to R7SS-P8	5 meters
R6LL-P7 to R8SS-P8	5 meters
R6LL-P30 to R5SS-P8	5 meters
R6LL-P31 to R3SS-P7	10 meters
R6LL-P32 to R6SS-P8	3 meters
R6LL-P33 to R4SS-P9	5 meters
R6LL-P34 to R4SS-P21	5 meters
R6LL-P35 to R5SS-P21	5 meters
R6LL-P36 to R6SS-P21	3 meters

Table 4-49 Leaf Switch Connections for the Seventh Rack in a 9 Rack System

Connection	Cable Length
R7UL-P1 to R5SS-P26	5 meters
R7UL-P2 to R9SS-P9	5 meters
R7UL-P3 to R4SS-P26	10 meters
R7UL-P4 to R3SS-P9	10 meters
R7UL-P5 to R1SS-P9	10 meters
R7UL-P6 to R4SS-P8	10 meters
R7UL-P7 to R2SS-P7	10 meters
R7UL-P30 to R7SS-P9	3 meters
R7UL-P31 to R5SS-P9	5 meters
R7UL-P32 to R8SS-P9	5 meters
R7UL-P33 to R6SS-P9	5 meters
R7UL-P34 to R8SS-P26	5 meters
R7UL-P35 to R6SS-P26	5 meters
R7UL-P36 to R7SS-P26	3 meters
R7LL-P1 to R9SS-P12	5 meters
R7LL-P2 to R9SS-P30	5 meters
R7LL-P3 to R5SS-P30	5 meters
R7LL-P4 to R3SS-P15	10 meters
R7LL-P5 to R1SS-P19	10 meters
R7LL-P6 to R4SS-P18	10 meters
R7LL-P7 to R2SS-P19	10 meters
R7LL-P30 to R7SS-P18	3 meters
R7LL-P31 to R5SS-P16	5 meters
R7LL-P32 to R8SS-P12	5 meters
R7LL-P33 to R6SS-P18	5 meters
R7LL-P34 to R6SS-P30	5 meters
R7LL-P35 to R7SS-P30	3 meters
R7LL-P36 to R8SS-P30	5 meters

Table 4-50 Leaf Switch Connections for the Eighth Rack in a 9 Rack System

Connection	Cable Length
R8UL-P1 to R9SS-P19	5 meters
R8UL-P2 to R9SS-P22	5 meters
R8UL-P3 to R1SS-P25	10 meters
R8UL-P4 to R3SS-P18	10 meters
R8UL-P5 to R1SS-P15	10 meters
R8UL-P6 to R4SS-P16	10 meters
R8UL-P7 to R2SS-P15	10 meters
R8UL-P30 to R7SS-P19	5 meters
R8UL-P31 to R5SS-P19	10 meters
R8UL-P32 to R8SS-P19	3 meters
R8UL-P33 to R6SS-P19	5 meters
R8UL-P34 to R7SS-P22	5 meters
R8UL-P35 to R8SS-P22	3 meters
R8UL-P36 to R6SS-P22	5 meters
R8LL-P1 to R2SS-P21	10 meters
R8LL-P2 to R9SS-P18	5 meters
R8LL-P3 to R1SS-P21	10 meters
R8LL-P4 to R3SS-P12	10 meters
R8LL-P5 to R1SS-P7	10 meters
R8LL-P6 to R4SS-P7	10 meters
R8LL-P7 to R2SS-P9	10 meters
R8LL-P30 to R7SS-P12	5 meters
R8LL-P31 to R5SS-P12	10 meters
R8LL-P32 to R8SS-P18	3 meters
R8LL-P33 to R6SS-P12	5 meters
R8LL-P34 to R8SS-P32	3 meters
R8LL-P35 to R9SS-P32	5 meters
R8LL-P36 to R7SS-P32	5 meters

Table 4-51 Leaf Switch Connections for the Ninth Rack in a 9 Rack System

Connection	Cable Length
R9UL-P1 to R1SS-P24	10 meters
R9UL-P2 to R1SS-P26	10 meters
R9UL-P3 to R2SS-P24	10 meters
R9UL-P4 to R2SS-P26	10 meters
R9UL-P5 to R3SS-P24	10 meters
R9UL-P6 to R3SS-P26	10 meters
R9UL-P7 to R4SS-P24	10 meters
R9UL-P30 to R5SS-P24	10 meters
R9UL-P31 to R6SS-P24	10 meters
R9UL-P32 to R7SS-P24	5 meters
R9UL-P33 to R8SS-P21	5 meters
R9UL-P34 to R8SS-P24	5 meters
R9UL-P35 to R9SS-P21	3 meters
R9UL-P36 to R9SS-P24	3 meters
R9LL-P1 to R1SS-P29	10 meters
R9LL-P2 to R1SS-P30	10 meters
R9LL-P3 to R2SS-P29	10 meters
R9LL-P4 to R2SS-P30	10 meters
R9LL-P5 to R3SS-P29	10 meters
R9LL-P6 to R3SS-P30	10 meters
R9LL-P7 to R4SS-P29	10 meters
R9LL-P30 to R4SS-P30	10 meters
R9LL-P31 to R5SS-P29	10 meters
R9LL-P32 to R6SS-P29	10 meters
R9LL-P33 to R7SS-P29	5 meters
R9LL-P34 to R8SS-P29	5 meters
R9LL-P35 to R9SS-P26	3 meters
R9LL-P36 to R9SS-P29	3 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-52 Nine-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R8LL-P5	10 meters
R1SS-P8	R5UL-P5	10 meters
R1SS-P9	R7UL-P5	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R6LL-P5	10 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R8UL-P5	10 meters
R1SS-P16	R6UL-P7	10 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R5LL-P7	10 meters
R1SS-P19	R7LL-P5	10 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R8LL-P3	10 meters
R1SS-P22	R5LL-P2	10 meters
R1SS-P23	R1UL-P3	3 meters
R1SS-P24	R9UL-P1	10 meters
R1SS-P25	R8UL-P3	10 meters
R1SS-P26	R9UL-P2	10 meters
R1SS-P27	R4LL-P3	10 meters
R1SS-P28	R5UL-P3	10 meters
R1SS-P29	R9LL-P1	10 meters
R1SS-P30	R9LL-P2	10 meters
R1SS-P31	R4UL-P3	10 meters
R1SS-P32	R3LL-P2	5 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R7UL-P7	10 meters
R2SS-P8	R5UL-P4	10 meters
R2SS-P9	R8LL-P7	10 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R6LL-P4	10 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R8UL-P7	10 meters
R2SS-P16	R6UL-P4	10 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R5LL-P6	10 meters
R2SS-P19	R7LL-P7	10 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R8LL-P1	10 meters
R2SS-P22	R5LL-P3	10 meters
R2SS-P23	R1UL-P34	5 meters
R2SS-P24	R9UL-P3	10 meters
R2SS-P25	R1LL-P1	5 meters
R2SS-P26	R9UL-P4	10 meters
R2SS-P27	R4LL-P2	5 meters
R2SS-P28	R5UL-P2	10 meters
R2SS-P29	R9LL-P3	10 meters
R2SS-P30	R9LL-P4	10 meters
R2SS-P31	R4UL-P2	5 meters
R2SS-P32	R6UL-P36	10 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R6LL-P31	10 meters
R3SS-P8	R5UL-P6	5 meters
R3SS-P9	R7UL-P4	10 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R8LL-P4	10 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R7LL-P4	10 meters
R3SS-P16	R5LL-P31	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R8UL-P4	10 meters
R3SS-P19	R6UL-P6	10 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R6LL-P3	10 meters
R3SS-P22	R5LL-P34	5 meters
R3SS-P23	R1UL-P1	5 meters
R3SS-P24	R9UL-P5	10 meters
R3SS-P25	R1LL-P2	5 meters
R3SS-P26	R9UL-P6	10 meters
R3SS-P27	R4LL-P34	5 meters
R3SS-P28	R5UL-P1	5 meters
R3SS-P29	R9LL-P5	10 meters
R3SS-P30	R9LL-P6	10 meters
R3SS-P31	R2UL-P2	5 meters
R3SS-P32	R6UL-P2	10 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R8LL-P6	10 meters
R4SS-P8	R7UL-P6	10 meters
R4SS-P9	R6LL-P33	5 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R5UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R6UL-P31	5 meters
R4SS-P16	R8UL-P6	10 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R7LL-P6	10 meters
R4SS-P19	R5LL-P33	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R6LL-P34	5 meters
R4SS-P22	R5LL-P35	5 meters
R4SS-P23	R1UL-P2	10 meters
R4SS-P24	R9UL-P7	10 meters
R4SS-P25	R1LL-P34	10 meters
R4SS-P26	R7UL-P3	10 meters
R4SS-P27	R2LL-P2	5 meters
R4SS-P28	R5UL-P34	5 meters
R4SS-P29	R9LL-P7	10 meters
R4SS-P30	R9LL-P30	10 meters
R4SS-P31	R2UL-P3	5 meters
R4SS-P32	R6UL-P1	5 meters
R5SS-P5	R1UL-P30	10 meters
R5SS-P6	R2UL-P7	10 meters
R5SS-P7	R5UL-P30	3 meters
R5SS-P8	R6LL-P30	5 meters
R5SS-P9	R7UL-P31	5 meters
R5SS-P10	R4UL-P5	5 meters
R5SS-P11	R3UL-P32	5 meters
R5SS-P12	R8LL-P31	10 meters
R5SS-P13	R1LL-P7	10 meters
R5SS-P14	R2LL-P33	10 meters
R5SS-P15	R5LL-P30	3 meters
R5SS-P16	R7LL-P31	5 meters
R5SS-P17	R4LL-P7	5 meters
R5SS-P18	R6UL-P33	5 meters
R5SS-P19	R8UL-P31	10 meters
R5SS-P20	R3LL-P5	5 meters
R5SS-P21	R6LL-P35	5 meters
R5SS-P22	R5LL-P36	3 meters
R5SS-P23	R1UL-P35	10 meters
R5SS-P24	R9UL-P30	10 meters
R5SS-P25	R1LL-P3	10 meters
R5SS-P26	R7UL-P1	5 meters
R5SS-P27	R2LL-P35	10 meters
R5SS-P28	R3UL-P34	5 meters
R5SS-P29	R9LL-P31	10 meters
R5SS-P30	R7LL-P3	5 meters
R5SS-P31	R2UL-P1	10 meters
R5SS-P32	R6UL-P34	5 meters
R6SS-P5	R1UL-P32	10 meters
R6SS-P6	R2UL-P33	10 meters
R6SS-P7	R5UL-P7	5 meters
R6SS-P8	R6LL-P32	3 meters
R6SS-P9	R7UL-P33	5 meters
R6SS-P10	R4UL-P30	5 meters
R6SS-P11	R3UL-P7	10 meters
R6SS-P12	R8LL-P33	5 meters
R6SS-P13	R1LL-P32	10 meters
R6SS-P14	R2LL-P7	10 meters
R6SS-P15	R5LL-P4	5 meters
R6SS-P16	R6UL-P30	3 meters
R6SS-P17	R4LL-P6	5 meters
R6SS-P18	R7LL-P33	5 meters
R6SS-P19	R8UL-P33	5 meters
R6SS-P20	R3LL-P30	10 meters
R6SS-P21	R6LL-P36	3 meters
R6SS-P22	R8UL-P36	5 meters
R6SS-P23	R3LL-P35	10 meters
R6SS-P24	R9UL-P31	10 meters
R6SS-P25	R1LL-P35	10 meters
R6SS-P26	R7UL-P35	5 meters
R6SS-P27	R2LL-P1	10 meters
R6SS-P28	R3UL-P1	10 meters
R6SS-P29	R9LL-P32	10 meters
R6SS-P30	R7LL-P34	5 meters
R6SS-P31	R2UL-P35	10 meters
R6SS-P32	R6UL-P35	3 meters
R7SS-P5	R1UL-P33	10 meters
R7SS-P6	R2UL-P32	10 meters
R7SS-P7	R5UL-P32	5 meters
R7SS-P8	R6LL-P6	5 meters
R7SS-P9	R7UL-P30	3 meters
R7SS-P10	R4UL-P31	10 meters
R7SS-P11	R3UL-P31	10 meters
R7SS-P12	R8LL-P30	5 meters
R7SS-P13	R1LL-P6	10 meters
R7SS-P14	R2LL-P32	10 meters
R7SS-P15	R5LL-P5	5 meters
R7SS-P16	R6UL-P5	5 meters
R7SS-P17	R4LL-P32	10 meters
R7SS-P18	R7LL-P30	3 meters
R7SS-P19	R8UL-P30	5 meters
R7SS-P20	R3LL-P7	10 meters
R7SS-P21	R6LL-P2	5 meters
R7SS-P22	R8UL-P34	5 meters
R7SS-P23	R3LL-P1	10 meters
R7SS-P24	R9UL-P32	5 meters
R7SS-P25	R4UL-P36	10 meters
R7SS-P26	R7UL-P36	3 meters
R7SS-P27	R2LL-P34	10 meters
R7SS-P28	R3UL-P35	10 meters
R7SS-P29	R9LL-P33	5 meters
R7SS-P30	R7LL-P35	3 meters
R7SS-P31	R2UL-P34	10 meters
R7SS-P32	R8LL-P36	5 meters
R8SS-P5	R1UL-P7	10 meters
R8SS-P6	R2UL-P30	10 meters
R8SS-P7	R5UL-P31	10 meters
R8SS-P8	R6LL-P7	5 meters
R8SS-P9	R7UL-P32	5 meters
R8SS-P10	R4UL-P4	10 meters
R8SS-P11	R3UL-P33	10 meters
R8SS-P12	R7LL-P32	5 meters
R8SS-P13	R1LL-P33	10 meters
R8SS-P14	R2LL-P30	10 meters
R8SS-P15	R5LL-P32	10 meters
R8SS-P16	R6UL-P32	5 meters
R8SS-P17	R4LL-P33	10 meters
R8SS-P18	R8LL-P32	3 meters
R8SS-P19	R8UL-P32	3 meters
R8SS-P20	R3LL-P6	10 meters
R8SS-P21	R9UL-P33	5 meters
R8SS-P22	R8UL-P35	3 meters
R8SS-P23	R3LL-P36	10 meters
R8SS-P24	R9UL-P34	5 meters
R8SS-P25	R4UL-P1	10 meters
R8SS-P26	R7UL-P34	5 meters
R8SS-P27	R2LL-P36	10 meters
R8SS-P28	R3UL-P36	10 meters
R8SS-P29	R9LL-P34	5 meters
R8SS-P30	R7LL-P36	5 meters
R8SS-P31	R4LL-P36	10 meters
R8SS-P32	R8LL-P34	3 meters
R9SS-P5	R1UL-P36	10 meters
R9SS-P6	R2UL-P36	10 meters
R9SS-P7	R5UL-P35	10 meters
R9SS-P8	R6LL-P1	10 meters
R9SS-P9	R7UL-P2	5 meters
R9SS-P10	R4UL-P34	10 meters
R9SS-P11	R3UL-P2	10 meters
R9SS-P12	R7LL-P1	5 meters
R9SS-P13	R1LL-P36	10 meters
R9SS-P14	R2LL-P3	10 meters
R9SS-P15	R5LL-P1	10 meters
R9SS-P16	R6UL-P3	10 meters
R9SS-P17	R4LL-P1	10 meters
R9SS-P18	R8LL-P2	5 meters
R9SS-P19	R8UL-P1	5 meters
R9SS-P20	R3LL-P3	10 meters
R9SS-P21	R9UL-P35	3 meters
R9SS-P22	R8UL-P2	5 meters
R9SS-P23	R3LL-P34	10 meters
R9SS-P24	R9UL-P36	3 meters
R9SS-P25	R4UL-P35	10 meters
R9SS-P26	R9LL-P35	3 meters
R9SS-P27	R5UL-P36	10 meters
R9SS-P28	R3UL-P3	10 meters
R9SS-P29	R9LL-P36	3 meters
R9SS-P30	R7LL-P2	5 meters
R9SS-P31	R4LL-P35	10 meters
R9SS-P32	R8LL-P35	5 meters

4.11 Ten-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect ten racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, interconnecting 10 or more of these racks requires modification to the following cabling tables. Contact Oracle for further details.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a 10 rack system.

Table 4-53 Leaf Switch Connections for the First Rack in a 10 Rack System

Connection	Cable Length
R1UL-P1 to R3SS-P23	5 meters
R1UL-P2 to R4SS-P23	10 meters
R1UL-P3 to R1SS-P23	3 meters
R1UL-P4 to R4SS-P5	10 meters
R1UL-P5 to R1SS-P5	3 meters
R1UL-P6 to R3SS-P5	5 meters
R1UL-P7 to R8SS-P5	10 meters
R1UL-P30 to R5SS-P5	10 meters
R1UL-P31 to R2SS-P5	5 meters
R1UL-P32 to R6SS-P5	10 meters
R1UL-P33 to R7SS-P5	10 meters
R1UL-P34 to R2SS-P23	5 meters
R1UL-P35 to R10SS-P5	15 meters
R1UL-P36 to R9SS-P5	10 meters
R1LL-P1 to R2SS-P27	5 meters
R1LL-P2 to R3SS-P27	5 meters
R1LL-P3 to R5SS-P27	10 meters
R1LL-P4 to R3SS-P13	5 meters
R1LL-P5 to R1SS-P13	3 meters
R1LL-P6 to R7SS-P13	10 meters
R1LL-P7 to R5SS-P13	10 meters
R1LL-P30 to R4SS-P13	10 meters
R1LL-P31 to R2SS-P13	5 meters
R1LL-P32 to R6SS-P13	10 meters
R1LL-P33 to R8SS-P13	10 meters
R1LL-P34 to R4SS-P27	10 meters
R1LL-P35 to R10SS-P13	15 meters
R1LL-P36 to R9SS-P13	10 meters

Table 4-54 Leaf Switch Connections for the Second Rack in a 10 Rack System

Connection	Cable Length
R2UL-P1 to R5SS-P28	10 meters
R2UL-P2 to R3SS-P28	5 meters
R2UL-P3 to R4SS-P28	5 meters
R2UL-P4 to R4SS-P6	5 meters
R2UL-P5 to R1SS-P6	5 meters
R2UL-P6 to R3SS-P6	5 meters
R2UL-P7 to R5SS-P6	10 meters
R2UL-P30 to R8SS-P6	10 meters
R2UL-P31 to R2SS-P6	3 meters
R2UL-P32 to R7SS-P6	10 meters
R2UL-P33 to R6SS-P6	10 meters
R2UL-P34 to R10SS-P6	10 meters
R2UL-P35 to R6SS-P28	10 meters
R2UL-P36 to R9SS-P6	10 meters
R2LL-P1 to R6SS-P22	10 meters
R2LL-P2 to R4SS-P22	5 meters
R2LL-P3 to R9SS-P14	10 meters
R2LL-P4 to R4SS-P14	5 meters
R2LL-P5 to R1SS-P14	5 meters
R2LL-P6 to R3SS-P14	5 meters
R2LL-P7 to R6SS-P14	10 meters
R2LL-P30 to R8SS-P14	10 meters
R2LL-P31 to R2SS-P14	3 meters
R2LL-P32 to R7SS-P14	10 meters
R2LL-P33 to R5SS-P14	10 meters
R2LL-P34 to R7SS-P22	10 meters
R2LL-P35 to R5SS-P22	10 meters
R2LL-P36 to R10SS-P14	10 meters

Table 4-55 Leaf Switch Connections for the Third Rack in a 10 Rack System

Connection	Cable Length
R3UL-P1 to R6SS-P23	10 meters
R3UL-P2 to R9SS-P11	10 meters
R3UL-P3 to R10SS-P11	10 meters
R3UL-P4 to R4SS-P11	5 meters
R3UL-P5 to R1SS-P11	5 meters
R3UL-P6 to R2SS-P11	5 meters
R3UL-P7 to R6SS-P11	10 meters
R3UL-P30 to R3SS-P11	3 meters
R3UL-P31 to R7SS-P11	10 meters
R3UL-P32 to R5SS-P11	5 meters
R3UL-P33 to R8SS-P11	10 meters
R3UL-P34 to R5SS-P23	5 meters
R3UL-P35 to R7SS-P23	10 meters
R3UL-P36 to R8SS-P23	10 meters
R3LL-P1 to R7SS-P27	10 meters
R3LL-P2 to R10SS-P20	10 meters
R3LL-P3 to R9SS-P20	10 meters
R3LL-P4 to R1SS-P20	5 meters
R3LL-P5 to R5SS-P20	5 meters
R3LL-P6 to R8SS-P20	10 meters
R3LL-P7 to R7SS-P20	10 meters
R3LL-P30 to R6SS-P20	10 meters
R3LL-P31 to R2SS-P20	5 meters
R3LL-P32 to R3SS-P20	3 meters
R3LL-P33 to R4SS-P20	5 meters
R3LL-P34 to R9SS-P27	10 meters
R3LL-P35 to R6SS-P27	10 meters
R3LL-P36 to R8SS-P27	10 meters

Table 4-56 Leaf Switch Connections for the Fourth Rack in a 10 Rack System

Connection	Cable Length
R4UL-P1 to R8SS-P28	10 meters
R4UL-P2 to R10SS-P28	10 meters
R4UL-P3 to R10SS-P10	10 meters
R4UL-P4 to R8SS-P10	10 meters
R4UL-P5 to R5SS-P10	5 meters
R4UL-P6 to R2SS-P10	5 meters
R4UL-P7 to R1SS-P10	10 meters
R4UL-P30 to R6SS-P10	5 meters
R4UL-P31 to R7SS-P10	10 meters
R4UL-P32 to R4SS-P10	3 meters
R4UL-P33 to R3SS-P10	5 meters
R4UL-P34 to R9SS-P10	10 meters
R4UL-P35 to R9SS-P28	10 meters
R4UL-P36 to R7SS-P28	10 meters
R4LL-P1 to R9SS-P17	10 meters
R4LL-P2 to R10SS-P17	10 meters
R4LL-P3 to R1SS-P27	10 meters
R4LL-P4 to R2SS-P17	5 meters
R4LL-P5 to R1SS-P17	10 meters
R4LL-P6 to R6SS-P17	5 meters
R4LL-P7 to R5SS-P17	5 meters
R4LL-P30 to R4SS-P17	3 meters
R4LL-P31 to R3SS-P17	5 meters
R4LL-P32 to R7SS-P17	10 meters
R4LL-P33 to R8SS-P17	10 meters
R4LL-P34 to R10SS-P22	10 meters
R4LL-P35 to R9SS-P22	10 meters
R4LL-P36 to R8SS-P22	10 meters

Table 4-57 Leaf Switch Connections for the Fifth Rack in a 10 Rack System

Connection	Cable Length
R5UL-P1 to R10SS-P7	10 meters
R5UL-P2 to R2SS-P28	10 meters
R5UL-P3 to R1SS-P28	10 meters
R5UL-P4 to R2SS-P8	10 meters
R5UL-P5 to R1SS-P8	10 meters
R5UL-P6 to R3SS-P8	5 meters
R5UL-P7 to R6SS-P7	5 meters
R5UL-P30 to R5SS-P7	3 meters
R5UL-P31 to R8SS-P7	10 meters
R5UL-P32 to R7SS-P7	5 meters
R5UL-P33 to R4SS-P12	5 meters
R5UL-P34 to R10SS-P23	10 meters
R5UL-P35 to R9SS-P7	10 meters
R5UL-P36 to R9SS-P23	10 meters
R5LL-P1 to R9SS-P15	10 meters
R5LL-P2 to R1SS-P22	10 meters
R5LL-P3 to R2SS-P22	10 meters
R5LL-P4 to R6SS-P15	5 meters
R5LL-P5 to R7SS-P15	5 meters
R5LL-P6 to R2SS-P18	10 meters
R5LL-P7 to R1SS-P18	10 meters
R5LL-P30 to R5SS-P15	3 meters
R5LL-P31 to R3SS-P16	5 meters
R5LL-P32 to R8SS-P15	10 meters
R5LL-P33 to R4SS-P19	5 meters
R5LL-P34 to R3SS-P22	5 meters
R5LL-P35 to R10SS-P15	10 meters
R5LL-P36 to R10SS-P27	10 meters

Table 4-58 Leaf Switch Connections for the Sixth Rack in a 10 Rack System

Connection	Cable Length
R6UL-P1 to R4SS-P26	5 meters
R6UL-P2 to R3SS-P26	10 meters
R6UL-P3 to R9SS-P16	10 meters
R6UL-P4 to R2SS-P16	10 meters
R6UL-P5 to R7SS-P16	5 meters
R6UL-P6 to R3SS-P19	10 meters
R6UL-P7 to R1SS-P16	10 meters
R6UL-P30 to R6SS-P16	3 meters
R6UL-P31 to R4SS-P15	5 meters
R6UL-P32 to R8SS-P16	5 meters
R6UL-P33 to R5SS-P18	5 meters
R6UL-P34 to R1SS-P26	10 meters
R6UL-P35 to R10SS-P16	10 meters
R6UL-P36 to R2SS-P26	10 meters
R6LL-P1 to R9SS-P8	10 meters
R6LL-P2 to R10SS-P8	10 meters
R6LL-P3 to R3SS-P29	10 meters
R6LL-P4 to R2SS-P12	10 meters
R6LL-P5 to R1SS-P12	10 meters
R6LL-P6 to R7SS-P8	5 meters
R6LL-P7 to R8SS-P8	5 meters
R6LL-P30 to R5SS-P8	5 meters
R6LL-P31 to R3SS-P7	10 meters
R6LL-P32 to R6SS-P8	3 meters
R6LL-P33 to R4SS-P9	5 meters
R6LL-P34 to R4SS-P29	5 meters
R6LL-P35 to R5SS-P29	5 meters
R6LL-P36 to R2SS-P29	10 meters

Table 4-59 Leaf Switch Connections for the Seventh Rack in a 10 Rack System

Connection	Cable Length
R7UL-P1 to R5SS-P25	5 meters
R7UL-P2 to R9SS-P9	5 meters
R7UL-P3 to R4SS-P25	10 meters
R7UL-P4 to R3SS-P9	10 meters
R7UL-P5 to R1SS-P9	10 meters
R7UL-P6 to R4SS-P8	10 meters
R7UL-P7 to R2SS-P7	10 meters
R7UL-P30 to R7SS-P9	3 meters
R7UL-P31 to R5SS-P9	5 meters
R7UL-P32 to R8SS-P9	5 meters
R7UL-P33 to R6SS-P9	5 meters
R7UL-P34 to R3SS-P25	10 meters
R7UL-P35 to R6SS-P25	5 meters
R7UL-P36 to R10SS-P9	10 meters
R7LL-P1 to R9SS-P12	5 meters
R7LL-P2 to R10SS-P12	10 meters
R7LL-P3 to R5SS-P31	5 meters
R7LL-P4 to R3SS-P15	10 meters
R7LL-P5 to R1SS-P19	10 meters
R7LL-P6 to R4SS-P18	10 meters
R7LL-P7 to R2SS-P19	10 meters
R7LL-P30 to R7SS-P18	3 meters
R7LL-P31 to R5SS-P16	5 meters
R7LL-P32 to R8SS-P12	5 meters
R7LL-P33 to R6SS-P18	5 meters
R7LL-P34 to R6SS-P31	5 meters
R7LL-P35 to R7SS-P31	3 meters
R7LL-P36 to R4SS-P31	10 meters

Table 4-60 Leaf Switch Connections for the Eighth Rack in a 10 Rack System

Connection	Cable Length
R8UL-P1 to R9SS-P19	5 meters
R8UL-P2 to R10SS-P19	5 meters
R8UL-P3 to R5SS-P26	10 meters
R8UL-P4 to R3SS-P18	10 meters
R8UL-P5 to R1SS-P15	10 meters
R8UL-P6 to R4SS-P16	10 meters
R8UL-P7 to R2SS-P15	10 meters
R8UL-P30 to R7SS-P19	5 meters
R8UL-P31 to R5SS-P19	10 meters
R8UL-P32 to R8SS-P19	3 meters
R8UL-P33 to R6SS-P19	5 meters
R8UL-P34 to R7SS-P26	5 meters
R8UL-P35 to R8SS-P26	3 meters
R8UL-P36 to R6SS-P26	5 meters
R8LL-P1 to R7SS-P29	5 meters
R8LL-P2 to R9SS-P18	5 meters
R8LL-P3 to R6SS-P29	5 meters
R8LL-P4 to R3SS-P12	10 meters
R8LL-P5 to R1SS-P7	10 meters
R8LL-P6 to R4SS-P7	10 meters
R8LL-P7 to R2SS-P9	10 meters
R8LL-P30 to R7SS-P12	5 meters
R8LL-P31 to R5SS-P12	10 meters
R8LL-P32 to R8SS-P18	3 meters
R8LL-P33 to R6SS-P12	5 meters
R8LL-P34 to R8SS-P29	3 meters
R8LL-P35 to R9SS-P29	5 meters
R8LL-P36 to R10SS-P18	5 meters

Table 4-61 Leaf Switch Connections for the Ninth Rack in a 10 Rack System

Connection	Cable Length
R9UL-P1 to R1SS-P24	10 meters
R9UL-P2 to R7SS-P25	5 meters
R9UL-P3 to R2SS-P24	10 meters
R9UL-P4 to R10SS-P24	5 meters
R9UL-P5 to R3SS-P24	10 meters
R9UL-P6 to R10SS-P25	5 meters
R9UL-P7 to R4SS-P24	10 meters
R9UL-P30 to R5SS-P24	10 meters
R9UL-P31 to R6SS-P24	10 meters
R9UL-P32 to R7SS-P24	5 meters
R9UL-P33 to R8SS-P24	5 meters
R9UL-P34 to R8SS-P25	5 meters
R9UL-P35 to R9SS-P24	3 meters
R9UL-P36 to R9SS-P25	3 meters
R9LL-P1 to R1SS-P29	10 meters
R9LL-P2 to R1SS-P30	10 meters
R9LL-P3 to R2SS-P30	10 meters
R9LL-P4 to R8SS-P31	5 meters
R9LL-P5 to R3SS-P30	10 meters
R9LL-P6 to R10SS-P30	5 meters
R9LL-P7 to R4SS-P30	10 meters
R9LL-P30 to R10SS-P31	5 meters
R9LL-P31 to R5SS-P30	10 meters
R9LL-P32 to R6SS-P30	10 meters
R9LL-P33 to R7SS-P30	5 meters
R9LL-P34 to R8SS-P30	5 meters
R9LL-P35 to R9SS-P30	3 meters
R9LL-P36 to R9SS-P31	3 meters

Table 4-62 Leaf Switch Connections for the Tenth Rack in a 10 Rack System

Connection	Cable Length
R10UL-P1 to R1SS-P21	15 meters
R10UL-P2 to R1SS-P25	15 meters
R10UL-P3 to R2SS-P21	10 meters
R10UL-P4 to R10SS-P21	3 meters
R10UL-P5 to R3SS-P21	10 meters
R10UL-P6 to R10SS-P26	3 meters
R10UL-P7 to R4SS-P21	10 meters
R10UL-P30 to R5SS-P21	10 meters
R10UL-P31 to R6SS-P21	10 meters
R10UL-P32 to R7SS-P21	10 meters
R10UL-P33 to R8SS-P21	5 meters
R10UL-P34 to R2SS-P25	10 meters
R10UL-P35 to R9SS-P21	5 meters
R10UL-P36 to R9SS-P26	5 meters
R10LL-P1 to R1SS-P31	15 meters
R10LL-P2 to R1SS-P32	15 meters
R10LL-P3 to R2SS-P31	10 meters
R10LL-P4 to R2SS-P32	10 meters
R10LL-P5 to R3SS-P31	10 meters
R10LL-P6 to R10SS-P29	3 meters
R10LL-P7 to R4SS-P32	10 meters
R10LL-P30 to R10SS-P32	3 meters
R10LL-P31 to R5SS-P32	10 meters
R10LL-P32 to R6SS-P32	10 meters
R10LL-P33 to R7SS-P32	10 meters
R10LL-P34 to R8SS-P32	5 meters
R10LL-P35 to R9SS-P32	5 meters
R10LL-P36 to R3SS-P32	10 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-63 Ten-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R8LL-P5	10 meters
R1SS-P8	R5UL-P5	10 meters
R1SS-P9	R7UL-P5	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R6LL-P5	10 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R8UL-P5	10 meters
R1SS-P16	R6UL-P7	10 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R5LL-P7	10 meters
R1SS-P19	R7LL-P5	10 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R10UL-P1	15 meters
R1SS-P22	R5LL-P2	10 meters
R1SS-P23	R1UL-P3	3 meters
R1SS-P24	R9UL-P1	10 meters
R1SS-P25	R10UL-P2	15 meters
R1SS-P26	R6UL-P34	10 meters
R1SS-P27	R4LL-P3	10 meters
R1SS-P28	R5UL-P3	10 meters
R1SS-P29	R9LL-P1	10 meters
R1SS-P30	R9LL-P2	10 meters
R1SS-P31	R10LL-P1	15 meters
R1SS-P32	R10LL-P2	15 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R7UL-P7	10 meters
R2SS-P8	R5UL-P4	10 meters
R2SS-P9	R8LL-P7	10 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R6LL-P4	10 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R8UL-P7	10 meters
R2SS-P16	R6UL-P4	10 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R5LL-P6	10 meters
R2SS-P19	R7LL-P7	10 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R10UL-P3	10 meters
R2SS-P22	R5LL-P3	10 meters
R2SS-P23	R1UL-P34	5 meters
R2SS-P24	R9UL-P3	10 meters
R2SS-P25	R10UL-P34	10 meters
R2SS-P26	R6UL-P36	10 meters
R2SS-P27	R1LL-P1	5 meters
R2SS-P28	R5UL-P2	10 meters
R2SS-P29	R6LL-P36	10 meters
R2SS-P30	R9LL-P3	10 meters
R2SS-P31	R10LL-P3	10 meters
R2SS-P32	R10LL-P4	10 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R6LL-P31	10 meters
R3SS-P8	R5UL-P6	5 meters
R3SS-P9	R7UL-P4	10 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R8LL-P4	10 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R7LL-P4	10 meters
R3SS-P16	R5LL-P31	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R8UL-P4	10 meters
R3SS-P19	R6UL-P6	10 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R10UL-P5	10 meters
R3SS-P22	R5LL-P34	5 meters
R3SS-P23	R1UL-P1	5 meters
R3SS-P24	R9UL-P5	10 meters
R3SS-P25	R7UL-P34	10 meters
R3SS-P26	R6UL-P2	10 meters
R3SS-P27	R1LL-P2	5 meters
R3SS-P28	R2UL-P2	5 meters
R3SS-P29	R6LL-P3	10 meters
R3SS-P30	R9LL-P5	10 meters
R3SS-P31	R10LL-P5	10 meters
R3SS-P32	R10LL-P36	10 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R8LL-P6	10 meters
R4SS-P8	R7UL-P6	10 meters
R4SS-P9	R6LL-P33	5 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R5UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R6UL-P31	5 meters
R4SS-P16	R8UL-P6	10 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R7LL-P6	10 meters
R4SS-P19	R5LL-P33	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R10UL-P7	10 meters
R4SS-P22	R2LL-P2	5 meters
R4SS-P23	R1UL-P2	10 meters
R4SS-P24	R9UL-P7	10 meters
R4SS-P25	R7UL-P3	10 meters
R4SS-P26	R6UL-P1	5 meters
R4SS-P27	R1LL-P34	10 meters
R4SS-P28	R2UL-P3	5 meters
R4SS-P29	R6LL-P34	5 meters
R4SS-P30	R9LL-P7	10 meters
R4SS-P31	R7LL-P36	10 meters
R4SS-P32	R10LL-P7	10 meters
R5SS-P5	R1UL-P30	10 meters
R5SS-P6	R2UL-P7	10 meters
R5SS-P7	R5UL-P30	3 meters
R5SS-P8	R6LL-P30	5 meters
R5SS-P9	R7UL-P31	5 meters
R5SS-P10	R4UL-P5	5 meters
R5SS-P11	R3UL-P32	5 meters
R5SS-P12	R8LL-P31	10 meters
R5SS-P13	R1LL-P7	10 meters
R5SS-P14	R2LL-P33	10 meters
R5SS-P15	R5LL-P30	3 meters
R5SS-P16	R7LL-P31	5 meters
R5SS-P17	R4LL-P7	5 meters
R5SS-P18	R6UL-P33	5 meters
R5SS-P19	R8UL-P31	10 meters
R5SS-P20	R3LL-P5	5 meters
R5SS-P21	R10UL-P30	10 meters
R5SS-P22	R2LL-P35	10 meters
R5SS-P23	R3UL-P34	5 meters
R5SS-P24	R9UL-P30	10 meters
R5SS-P25	R7UL-P1	5 meters
R5SS-P26	R8UL-P3	10 meters
R5SS-P27	R1LL-P3	10 meters
R5SS-P28	R2UL-P1	10 meters
R5SS-P29	R6LL-P35	5 meters
R5SS-P30	R9LL-P31	10 meters
R5SS-P31	R7LL-P3	5 meters
R5SS-P32	R10LL-P31	10 meters
R6SS-P5	R1UL-P32	10 meters
R6SS-P6	R2UL-P33	10 meters
R6SS-P7	R5UL-P7	5 meters
R6SS-P8	R6LL-P32	3 meters
R6SS-P9	R7UL-P33	5 meters
R6SS-P10	R4UL-P30	5 meters
R6SS-P11	R3UL-P7	10 meters
R6SS-P12	R8LL-P33	5 meters
R6SS-P13	R1LL-P32	10 meters
R6SS-P14	R2LL-P7	10 meters
R6SS-P15	R5LL-P4	5 meters
R6SS-P16	R6UL-P30	3 meters
R6SS-P17	R4LL-P6	5 meters
R6SS-P18	R7LL-P33	5 meters
R6SS-P19	R8UL-P33	5 meters
R6SS-P20	R3LL-P30	10 meters
R6SS-P21	R10UL-P31	10 meters
R6SS-P22	R2LL-P1	10 meters
R6SS-P23	R3UL-P1	10 meters
R6SS-P24	R9UL-P31	10 meters
R6SS-P25	R7UL-P35	5 meters
R6SS-P26	R8UL-P36	5 meters
R6SS-P27	R3LL-P35	10 meters
R6SS-P28	R2UL-P35	10 meters
R6SS-P29	R8LL-P3	5 meters
R6SS-P30	R9LL-P32	10 meters
R6SS-P31	R7LL-P34	5 meters
R6SS-P32	R10LL-P32	10 meters
R7SS-P5	R1UL-P33	10 meters
R7SS-P6	R2UL-P32	10 meters
R7SS-P7	R5UL-P32	5 meters
R7SS-P8	R6LL-P6	5 meters
R7SS-P9	R7UL-P30	3 meters
R7SS-P10	R4UL-P31	10 meters
R7SS-P11	R3UL-P31	10 meters
R7SS-P12	R8LL-P30	5 meters
R7SS-P13	R1LL-P6	10 meters
R7SS-P14	R2LL-P32	10 meters
R7SS-P15	R5LL-P5	5 meters
R7SS-P16	R6UL-P5	5 meters
R7SS-P17	R4LL-P32	10 meters
R7SS-P18	R7LL-P30	3 meters
R7SS-P19	R8UL-P30	5 meters
R7SS-P20	R3LL-P7	10 meters
R7SS-P21	R10UL-P32	10 meters
R7SS-P22	R2LL-P34	10 meters
R7SS-P23	R3UL-P35	10 meters
R7SS-P24	R9UL-P32	5 meters
R7SS-P25	R9UL-P2	5 meters
R7SS-P26	R8UL-P34	5 meters
R7SS-P27	R3LL-P1	10 meters
R7SS-P28	R4UL-P36	10 meters
R7SS-P29	R8LL-P1	5 meters
R7SS-P30	R9LL-P33	5 meters
R7SS-P31	R7LL-P35	3 meters
R7SS-P32	R10LL-P33	10 meters
R8SS-P5	R1UL-P7	10 meters
R8SS-P6	R2UL-P30	10 meters
R8SS-P7	R5UL-P31	10 meters
R8SS-P8	R6LL-P7	5 meters
R8SS-P9	R7UL-P32	5 meters
R8SS-P10	R4UL-P4	10 meters
R8SS-P11	R3UL-P33	10 meters
R8SS-P12	R7LL-P32	5 meters
R8SS-P13	R1LL-P33	10 meters
R8SS-P14	R2LL-P30	10 meters
R8SS-P15	R5LL-P32	10 meters
R8SS-P16	R6UL-P32	5 meters
R8SS-P17	R4LL-P33	10 meters
R8SS-P18	R8LL-P32	3 meters
R8SS-P19	R8UL-P32	3 meters
R8SS-P20	R3LL-P6	10 meters
R8SS-P21	R10UL-P33	5 meters
R8SS-P22	R4LL-P36	10 meters
R8SS-P23	R3UL-P36	10 meters
R8SS-P24	R9UL-P33	5 meters
R8SS-P25	R9UL-P34	5 meters
R8SS-P26	R8UL-P35	3 meters
R8SS-P27	R3LL-P36	10 meters
R8SS-P28	R4UL-P1	10 meters
R8SS-P29	R8LL-P34	3 meters
R8SS-P30	R9LL-P34	5 meters
R8SS-P31	R9LL-P4	5 meters
R8SS-P32	R10LL-P34	5 meters
R9SS-P5	R1UL-P36	10 meters
R9SS-P6	R2UL-P36	10 meters
R9SS-P7	R5UL-P35	10 meters
R9SS-P8	R6LL-P1	10 meters
R9SS-P9	R7UL-P2	5 meters
R9SS-P10	R4UL-P34	10 meters
R9SS-P11	R3UL-P2	10 meters
R9SS-P12	R7LL-P1	5 meters
R9SS-P13	R1LL-P36	10 meters
R9SS-P14	R2LL-P3	10 meters
R9SS-P15	R5LL-P1	10 meters
R9SS-P16	R6UL-P3	10 meters
R9SS-P17	R4LL-P1	10 meters
R9SS-P18	R8LL-P2	5 meters
R9SS-P19	R8UL-P1	5 meters
R9SS-P20	R3LL-P3	10 meters
R9SS-P21	R10UL-P35	5 meters
R9SS-P22	R4LL-P35	10 meters
R9SS-P23	R5UL-P36	10 meters
R9SS-P24	R9UL-P35	3 meters
R9SS-P25	R9UL-P36	3 meters
R9SS-P26	R10UL-P36	5 meters
R9SS-P27	R3LL-P34	10 meters
R9SS-P28	R4UL-P35	10 meters
R9SS-P29	R8LL-P35	5 meters
R9SS-P30	R9LL-P35	3 meters
R9SS-P31	R9LL-P36	3 meters
R9SS-P32	R10LL-P35	5 meters
R10SS-P5	R1UL-P35	15 meters
R10SS-P6	R2UL-P34	10 meters
R10SS-P7	R5UL-P1	10 meters
R10SS-P8	R6LL-P2	10 meters
R10SS-P9	R7UL-P36	10 meters
R10SS-P10	R4UL-P3	10 meters
R10SS-P11	R3UL-P3	10 meters
R10SS-P12	R7LL-P2	10 meters
R10SS-P13	R1LL-P35	15 meters
R10SS-P14	R2LL-P36	10 meters
R10SS-P15	R5LL-P35	10 meters
R10SS-P16	R6UL-P35	10 meters
R10SS-P17	R4LL-P2	10 meters
R10SS-P18	R8LL-P36	5 meters
R10SS-P19	R8UL-P2	5 meters
R10SS-P20	R3LL-P2	10 meters
R10SS-P21	R10UL-P4	3 meters
R10SS-P22	R4LL-P34	10 meters
R10SS-P23	R5UL-P34	10 meters
R10SS-P24	R9UL-P4	5 meters
R10SS-P25	R9UL-P6	5 meters
R10SS-P26	R10UL-P6	3 meters
R10SS-P27	R5LL-P36	10 meters
R10SS-P28	R4UL-P2	10 meters
R10SS-P29	R10LL-P6	3 meters
R10SS-P30	R9LL-P6	5 meters
R10SS-P31	R9LL-P30	5 meters
R10SS-P32	R10LL-P30	3 meters

4.12 Eleven-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect eleven racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, interconnecting 10 or more of these racks requires modification to the following cabling tables. Contact Oracle for further details.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a 11 rack system.

Table 4-64 Leaf Switch Connections for the First Rack in a 11 Rack System

Connection	Cable Length
R1UL-P1 to R3SS-P23	5 meters
R1UL-P2 to R11SS-P5	15 meters
R1UL-P3 to R1SS-P23	3 meters
R1UL-P4 to R4SS-P5	10 meters
R1UL-P5 to R1SS-P5	3 meters
R1UL-P6 to R3SS-P5	5 meters
R1UL-P7 to R8SS-P5	10 meters
R1UL-P30 to R5SS-P5	10 meters
R1UL-P31 to R2SS-P5	5 meters
R1UL-P32 to R6SS-P5	10 meters
R1UL-P33 to R7SS-P5	10 meters
R1UL-P34 to R2SS-P23	5 meters
R1UL-P35 to R10SS-P5	15 meters
R1UL-P36 to R9SS-P5	10 meters
R1LL-P1 to R2SS-P22	5 meters
R1LL-P2 to R3SS-P22	5 meters
R1LL-P3 to R11SS-P13	15 meters
R1LL-P4 to R3SS-P13	5 meters
R1LL-P5 to R1SS-P13	3 meters
R1LL-P6 to R7SS-P13	10 meters
R1LL-P7 to R5SS-P13	10 meters
R1LL-P30 to R4SS-P13	10 meters
R1LL-P31 to R2SS-P13	5 meters
R1LL-P32 to R6SS-P13	10 meters
R1LL-P33 to R8SS-P13	10 meters
R1LL-P34 to R4SS-P22	10 meters
R1LL-P35 to R10SS-P13	15 meters
R1LL-P36 to R9SS-P13	10 meters

Table 4-65 Leaf Switch Connections for the Second Rack in a 11 Rack System

Connection	Cable Length
R2UL-P1 to R5SS-P26	10 meters
R2UL-P2 to R3SS-P26	5 meters
R2UL-P3 to R4SS-P26	5 meters
R2UL-P4 to R4SS-P6	5 meters
R2UL-P5 to R1SS-P6	5 meters
R2UL-P6 to R3SS-P6	5 meters
R2UL-P7 to R5SS-P6	10 meters
R2UL-P30 to R8SS-P6	10 meters
R2UL-P31 to R2SS-P6	3 meters
R2UL-P32 to R7SS-P6	10 meters
R2UL-P33 to R6SS-P6	10 meters
R2UL-P34 to R10SS-P6	10 meters
R2UL-P35 to R11SS-P6	15 meters
R2UL-P36 to R9SS-P6	10 meters
R2LL-P1 to R6SS-P23	10 meters
R2LL-P2 to R4SS-P23	5 meters
R2LL-P3 to R9SS-P14	10 meters
R2LL-P4 to R4SS-P14	5 meters
R2LL-P5 to R1SS-P14	5 meters
R2LL-P6 to R3SS-P14	5 meters
R2LL-P7 to R6SS-P14	10 meters
R2LL-P30 to R8SS-P14	10 meters
R2LL-P31 to R2SS-P14	3 meters
R2LL-P32 to R7SS-P14	10 meters
R2LL-P33 to R5SS-P14	10 meters
R2LL-P34 to R11SS-P14	15 meters
R2LL-P35 to R5SS-P23	10 meters
R2LL-P36 to R10SS-P14	10 meters

Table 4-66 Leaf Switch Connections for the Third Rack in a 11 Rack System

Connection	Cable Length
R3UL-P1 to R6SS-P22	10 meters
R3UL-P2 to R9SS-P11	10 meters
R3UL-P3 to R10SS-P11	10 meters
R3UL-P4 to R4SS-P11	5 meters
R3UL-P5 to R1SS-P11	5 meters
R3UL-P6 to R2SS-P11	5 meters
R3UL-P7 to R6SS-P11	10 meters
R3UL-P30 to R3SS-P11	3 meters
R3UL-P31 to R7SS-P11	10 meters
R3UL-P32 to R5SS-P11	5 meters
R3UL-P33 to R8SS-P11	10 meters
R3UL-P34 to R5SS-P22	5 meters
R3UL-P35 to R7SS-P22	10 meters
R3UL-P36 to R11SS-P11	10 meters
R3LL-P1 to R7SS-P26	10 meters
R3LL-P2 to R10SS-P20	10 meters
R3LL-P3 to R9SS-P20	10 meters
R3LL-P4 to R1SS-P20	5 meters
R3LL-P5 to R5SS-P20	5 meters
R3LL-P6 to R8SS-P20	10 meters
R3LL-P7 to R7SS-P20	10 meters
R3LL-P30 to R6SS-P20	10 meters
R3LL-P31 to R2SS-P20	5 meters
R3LL-P32 to R3SS-P20	3 meters
R3LL-P33 to R4SS-P20	5 meters
R3LL-P34 to R11SS-P20	10 meters
R3LL-P35 to R6SS-P26	10 meters
R3LL-P36 to R8SS-P26	10 meters

Table 4-67 Leaf Switch Connections for the Fourth Rack in a 11 Rack System

Connection	Cable Length
R4UL-P1 to R8SS-P23	10 meters
R4UL-P2 to R11SS-P10	10 meters
R4UL-P3 to R10SS-P10	10 meters
R4UL-P4 to R8SS-P10	10 meters
R4UL-P5 to R5SS-P10	5 meters
R4UL-P6 to R2SS-P10	5 meters
R4UL-P7 to R1SS-P10	10 meters
R4UL-P30 to R6SS-P10	5 meters
R4UL-P31 to R7SS-P10	10 meters
R4UL-P32 to R4SS-P10	3 meters
R4UL-P33 to R3SS-P10	5 meters
R4UL-P34 to R9SS-P10	10 meters
R4UL-P35 to R9SS-P23	10 meters
R4UL-P36 to R7SS-P23	10 meters
R4LL-P1 to R9SS-P17	10 meters
R4LL-P2 to R10SS-P17	10 meters
R4LL-P3 to R11SS-P17	10 meters
R4LL-P4 to R2SS-P17	5 meters
R4LL-P5 to R1SS-P17	10 meters
R4LL-P6 to R6SS-P17	5 meters
R4LL-P7 to R5SS-P17	5 meters
R4LL-P30 to R4SS-P17	3 meters
R4LL-P31 to R3SS-P17	5 meters
R4LL-P32 to R7SS-P17	10 meters
R4LL-P33 to R8SS-P17	10 meters
R4LL-P34 to R10SS-P22	10 meters
R4LL-P35 to R9SS-P22	10 meters
R4LL-P36 to R8SS-P22	10 meters

Table 4-68 Leaf Switch Connections for the Fifth Rack in a 11 Rack System

Connection	Cable Length
R5UL-P1 to R10SS-P7	10 meters
R5UL-P2 to R11SS-P26	10 meters
R5UL-P3 to R11SS-P7	10 meters
R5UL-P4 to R2SS-P8	10 meters
R5UL-P5 to R1SS-P8	10 meters
R5UL-P6 to R3SS-P8	5 meters
R5UL-P7 to R6SS-P7	5 meters
R5UL-P30 to R5SS-P7	3 meters
R5UL-P31 to R8SS-P7	10 meters
R5UL-P32 to R7SS-P7	5 meters
R5UL-P33 to R4SS-P12	5 meters
R5UL-P34 to R10SS-P26	10 meters
R5UL-P35 to R9SS-P7	10 meters
R5UL-P36 to R9SS-P26	10 meters
R5LL-P1 to R9SS-P15	10 meters
R5LL-P2 to R1SS-P22	10 meters
R5LL-P3 to R11SS-P15	10 meters
R5LL-P4 to R6SS-P15	5 meters
R5LL-P5 to R7SS-P15	5 meters
R5LL-P6 to R2SS-P18	10 meters
R5LL-P7 to R1SS-P18	10 meters
R5LL-P30 to R5SS-P15	3 meters
R5LL-P31 to R3SS-P16	5 meters
R5LL-P32 to R8SS-P15	10 meters
R5LL-P33 to R4SS-P19	5 meters
R5LL-P34 to R11SS-P23	10 meters
R5LL-P35 to R10SS-P15	10 meters
R5LL-P36 to R10SS-P23	10 meters

Table 4-69 Leaf Switch Connections for the Sixth Rack in a 11 Rack System

Connection	Cable Length
R6UL-P1 to R11SS-P22	10 meters
R6UL-P2 to R11SS-P16	10 meters
R6UL-P3 to R9SS-P16	10 meters
R6UL-P4 to R2SS-P16	10 meters
R6UL-P5 to R7SS-P16	5 meters
R6UL-P6 to R3SS-P19	10 meters
R6UL-P7 to R1SS-P16	10 meters
R6UL-P30 to R6SS-P16	3 meters
R6UL-P31 to R4SS-P15	5 meters
R6UL-P32 to R8SS-P16	5 meters
R6UL-P33 to R5SS-P18	5 meters
R6UL-P34 to R1SS-P26	10 meters
R6UL-P35 to R10SS-P16	10 meters
R6UL-P36 to R2SS-P26	10 meters
R6LL-P1 to R9SS-P8	10 meters
R6LL-P2 to R10SS-P8	10 meters
R6LL-P3 to R3SS-P31	10 meters
R6LL-P4 to R2SS-P12	10 meters
R6LL-P5 to R1SS-P12	10 meters
R6LL-P6 to R7SS-P8	5 meters
R6LL-P7 to R8SS-P8	5 meters
R6LL-P30 to R5SS-P8	5 meters
R6LL-P31 to R3SS-P7	10 meters
R6LL-P32 to R6SS-P8	3 meters
R6LL-P33 to R4SS-P9	5 meters
R6LL-P34 to R1SS-P31	10 meters
R6LL-P35 to R11SS-P8	10 meters
R6LL-P36 to R2SS-P31	10 meters

Table 4-70 Leaf Switch Connections for the Seventh Rack in a 11 Rack System

Connection	Cable Length
R7UL-P1 to R2SS-P27	10 meters
R7UL-P2 to R9SS-P9	5 meters
R7UL-P3 to R4SS-P27	10 meters
R7UL-P4 to R3SS-P9	10 meters
R7UL-P5 to R1SS-P9	10 meters
R7UL-P6 to R4SS-P8	10 meters
R7UL-P7 to R2SS-P7	10 meters
R7UL-P30 to R7SS-P9	3 meters
R7UL-P31 to R5SS-P9	5 meters
R7UL-P32 to R8SS-P9	5 meters
R7UL-P33 to R6SS-P9	5 meters
R7UL-P34 to R3SS-P27	10 meters
R7UL-P35 to R11SS-P9	10 meters
R7UL-P36 to R10SS-P9	10 meters
R7LL-P1 to R9SS-P12	5 meters
R7LL-P2 to R10SS-P12	10 meters
R7LL-P3 to R5SS-P30	5 meters
R7LL-P4 to R3SS-P15	10 meters
R7LL-P5 to R1SS-P19	10 meters
R7LL-P6 to R4SS-P18	10 meters
R7LL-P7 to R2SS-P19	10 meters
R7LL-P30 to R7SS-P18	3 meters
R7LL-P31 to R5SS-P16	5 meters
R7LL-P32 to R8SS-P12	5 meters
R7LL-P33 to R6SS-P18	5 meters
R7LL-P34 to R3SS-P30	10 meters
R7LL-P35 to R11SS-P12	10 meters
R7LL-P36 to R4SS-P30	10 meters

Table 4-71 Leaf Switch Connections for the Eighth Rack in a 11 Rack System

Connection	Cable Length
R8UL-P1 to R9SS-P19	5 meters
R8UL-P2 to R10SS-P19	5 meters
R8UL-P3 to R5SS-P31	10 meters
R8UL-P4 to R3SS-P18	10 meters
R8UL-P5 to R1SS-P15	10 meters
R8UL-P6 to R4SS-P16	10 meters
R8UL-P7 to R2SS-P15	10 meters
R8UL-P30 to R7SS-P19	5 meters
R8UL-P31 to R5SS-P19	10 meters
R8UL-P32 to R8SS-P19	3 meters
R8UL-P33 to R6SS-P19	5 meters
R8UL-P34 to R4SS-P31	10 meters
R8UL-P35 to R11SS-P19	10 meters
R8UL-P36 to R6SS-P31	5 meters
R8LL-P1 to R7SS-P27	5 meters
R8LL-P2 to R9SS-P18	5 meters
R8LL-P3 to R6SS-P27	5 meters
R8LL-P4 to R3SS-P12	10 meters
R8LL-P5 to R1SS-P7	10 meters
R8LL-P6 to R4SS-P7	10 meters
R8LL-P7 to R2SS-P9	10 meters
R8LL-P30 to R7SS-P12	5 meters
R8LL-P31 to R5SS-P12	10 meters
R8LL-P32 to R8SS-P18	3 meters
R8LL-P33 to R6SS-P12	5 meters
R8LL-P34 to R5SS-P27	10 meters
R8LL-P35 to R11SS-P18	10 meters
R8LL-P36 to R10SS-P18	5 meters

Table 4-72 Leaf Switch Connections for the Ninth Rack in a 11 Rack System

Connection	Cable Length
R9UL-P1 to R1SS-P24	10 meters
R9UL-P2 to R7SS-P30	5 meters
R9UL-P3 to R2SS-P24	10 meters
R9UL-P4 to R10SS-P24	5 meters
R9UL-P5 to R3SS-P24	10 meters
R9UL-P6 to R11SS-P24	5 meters
R9UL-P7 to R4SS-P24	10 meters
R9UL-P30 to R5SS-P24	10 meters
R9UL-P31 to R6SS-P24	10 meters
R9UL-P32 to R7SS-P24	5 meters
R9UL-P33 to R8SS-P24	5 meters
R9UL-P34 to R8SS-P30	5 meters
R9UL-P35 to R9SS-P24	3 meters
R9UL-P36 to R6SS-P30	10 meters
R9LL-P1 to R1SS-P29	10 meters
R9LL-P2 to R11SS-P29	5 meters
R9LL-P3 to R2SS-P29	10 meters
R9LL-P4 to R8SS-P31	5 meters
R9LL-P5 to R3SS-P29	10 meters
R9LL-P6 to R10SS-P29	5 meters
R9LL-P7 to R4SS-P29	10 meters
R9LL-P30 to R7SS-P31	5 meters
R9LL-P31 to R5SS-P29	10 meters
R9LL-P32 to R6SS-P29	10 meters
R9LL-P33 to R7SS-P29	5 meters
R9LL-P34 to R8SS-P29	5 meters
R9LL-P35 to R9SS-P29	3 meters
R9LL-P36 to R9SS-P31	3 meters

Table 4-73 Leaf Switch Connections for the Tenth Rack in a 11 Rack System

Connection	Cable Length
R10UL-P1 to R1SS-P21	15 meters
R10UL-P2 to R11SS-P21	5 meters
R10UL-P3 to R2SS-P21	10 meters
R10UL-P4 to R10SS-P21	3 meters
R10UL-P5 to R3SS-P21	10 meters
R10UL-P6 to R10SS-P27	3 meters
R10UL-P7 to R4SS-P21	10 meters
R10UL-P30 to R5SS-P21	10 meters
R10UL-P31 to R6SS-P21	10 meters
R10UL-P32 to R7SS-P21	10 meters
R10UL-P33 to R8SS-P21	5 meters
R10UL-P34 to R8SS-P27	5 meters
R10UL-P35 to R9SS-P21	5 meters
R10UL-P36 to R9SS-P27	5 meters
R10LL-P1 to R1SS-P32	15 meters
R10LL-P2 to R9SS-P30	5 meters
R10LL-P3 to R2SS-P32	10 meters
R10LL-P4 to R11SS-P30	5 meters
R10LL-P5 to R3SS-P32	10 meters
R10LL-P6 to R10SS-P30	3 meters
R10LL-P7 to R4SS-P32	10 meters
R10LL-P30 to R10SS-P32	3 meters
R10LL-P31 to R5SS-P32	10 meters
R10LL-P32 to R6SS-P32	10 meters
R10LL-P33 to R7SS-P32	10 meters
R10LL-P34 to R8SS-P32	5 meters
R10LL-P35 to R9SS-P32	5 meters
R10LL-P36 to R11SS-P32	5 meters

Table 4-74 Leaf Switch Connections for the Eleventh Rack in a 11 Rack System

Connection	Cable Length
R11UL-P1 to R1SS-P25	15 meters
R11UL-P2 to R11SS-P25	3 meters
R11UL-P3 to R2SS-P25	15 meters
R11UL-P4 to R10SS-P25	5 meters
R11UL-P5 to R3SS-P25	10 meters
R11UL-P6 to R10SS-P31	5 meters
R11UL-P7 to R4SS-P25	10 meters
R11UL-P30 to R5SS-P25	10 meters
R11UL-P31 to R6SS-P25	10 meters
R11UL-P32 to R7SS-P25	10 meters
R11UL-P33 to R8SS-P25	10 meters
R11UL-P34 to R11SS-P31	3 meters
R11UL-P35 to R9SS-P25	5 meters
R11UL-P36 to R1SS-P27	15 meters
R11LL-P1 to R1SS-P28	15 meters
R11LL-P2 to R1SS-P30	15 meters
R11LL-P3 to R2SS-P28	15 meters
R11LL-P4 to R11SS-P28	3 meters
R11LL-P5 to R3SS-P28	10 meters
R11LL-P6 to R10SS-P28	5 meters
R11LL-P7 to R4SS-P28	10 meters
R11LL-P30 to R2SS-P30	15 meters
R11LL-P31 to R5SS-P28	10 meters
R11LL-P32 to R6SS-P28	10 meters
R11LL-P33 to R7SS-P28	10 meters
R11LL-P34 to R8SS-P28	10 meters
R11LL-P35 to R9SS-P28	5 meters
R11LL-P36 to R11SS-P27	3 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-75 Eleven-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R8LL-P5	10 meters
R1SS-P8	R5UL-P5	10 meters
R1SS-P9	R7UL-P5	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R6LL-P5	10 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R8UL-P5	10 meters
R1SS-P16	R6UL-P7	10 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R5LL-P7	10 meters
R1SS-P19	R7LL-P5	10 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R10UL-P1	15 meters
R1SS-P22	R5LL-P2	10 meters
R1SS-P23	R1UL-P3	3 meters
R1SS-P24	R9UL-P1	10 meters
R1SS-P25	R11UL-P1	15 meters
R1SS-P26	R6UL-P34	10 meters
R1SS-P27	R11UL-P36	15 meters
R1SS-P28	R11LL-P1	15 meters
R1SS-P29	R9LL-P1	10 meters
R1SS-P30	R11LL-P2	15 meters
R1SS-P31	R6LL-P34	10 meters
R1SS-P32	R10LL-P1	15 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R7UL-P7	10 meters
R2SS-P8	R5UL-P4	10 meters
R2SS-P9	R8LL-P7	10 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R6LL-P4	10 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R8UL-P7	10 meters
R2SS-P16	R6UL-P4	10 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R5LL-P6	10 meters
R2SS-P19	R7LL-P7	10 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R10UL-P3	10 meters
R2SS-P22	R1LL-P1	5 meters
R2SS-P23	R1UL-P34	5 meters
R2SS-P24	R9UL-P3	10 meters
R2SS-P25	R11UL-P3	15 meters
R2SS-P26	R6UL-P36	10 meters
R2SS-P27	R7UL-P1	10 meters
R2SS-P28	R11LL-P3	15 meters
R2SS-P29	R9LL-P3	10 meters
R2SS-P30	R11LL-P30	15 meters
R2SS-P31	R6LL-P36	10 meters
R2SS-P32	R10LL-P3	10 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R6LL-P31	10 meters
R3SS-P8	R5UL-P6	5 meters
R3SS-P9	R7UL-P4	10 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R8LL-P4	10 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R7LL-P4	10 meters
R3SS-P16	R5LL-P31	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R8UL-P4	10 meters
R3SS-P19	R6UL-P6	10 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R10UL-P5	10 meters
R3SS-P22	R1LL-P2	5 meters
R3SS-P23	R1UL-P1	5 meters
R3SS-P24	R9UL-P5	10 meters
R3SS-P25	R11UL-P5	10 meters
R3SS-P26	R2UL-P2	5 meters
R3SS-P27	R7UL-P34	10 meters
R3SS-P28	R11LL-P5	10 meters
R3SS-P29	R9LL-P5	10 meters
R3SS-P30	R7LL-P34	10 meters
R3SS-P31	R6LL-P3	10 meters
R3SS-P32	R10LL-P5	10 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R8LL-P6	10 meters
R4SS-P8	R7UL-P6	10 meters
R4SS-P9	R6LL-P33	5 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R5UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R6UL-P31	5 meters
R4SS-P16	R8UL-P6	10 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R7LL-P6	10 meters
R4SS-P19	R5LL-P33	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R10UL-P7	10 meters
R4SS-P22	R1LL-P34	10 meters
R4SS-P23	R2LL-P2	5 meters
R4SS-P24	R9UL-P7	10 meters
R4SS-P25	R11UL-P7	10 meters
R4SS-P26	R2UL-P3	5 meters
R4SS-P27	R7UL-P3	10 meters
R4SS-P28	R11LL-P7	10 meters
R4SS-P29	R9LL-P7	10 meters
R4SS-P30	R7LL-P36	10 meters
R4SS-P31	R8UL-P34	10 meters
R4SS-P32	R10LL-P7	10 meters
R5SS-P5	R1UL-P30	10 meters
R5SS-P6	R2UL-P7	10 meters
R5SS-P7	R5UL-P30	3 meters
R5SS-P8	R6LL-P30	5 meters
R5SS-P9	R7UL-P31	5 meters
R5SS-P10	R4UL-P5	5 meters
R5SS-P11	R3UL-P32	5 meters
R5SS-P12	R8LL-P31	10 meters
R5SS-P13	R1LL-P7	10 meters
R5SS-P14	R2LL-P33	10 meters
R5SS-P15	R5LL-P30	3 meters
R5SS-P16	R7LL-P31	5 meters
R5SS-P17	R4LL-P7	5 meters
R5SS-P18	R6UL-P33	5 meters
R5SS-P19	R8UL-P31	10 meters
R5SS-P20	R3LL-P5	5 meters
R5SS-P21	R10UL-P30	10 meters
R5SS-P22	R3UL-P34	5 meters
R5SS-P23	R2LL-P35	10 meters
R5SS-P24	R9UL-P30	10 meters
R5SS-P25	R11UL-P30	10 meters
R5SS-P26	R2UL-P1	10 meters
R5SS-P27	R8LL-P34	10 meters
R5SS-P28	R11LL-P31	10 meters
R5SS-P29	R9LL-P31	10 meters
R5SS-P30	R7LL-P3	5 meters
R5SS-P31	R8UL-P3	10 meters
R5SS-P32	R10LL-P31	10 meters
R6SS-P5	R1UL-P32	10 meters
R6SS-P6	R2UL-P33	10 meters
R6SS-P7	R5UL-P7	5 meters
R6SS-P8	R6LL-P32	3 meters
R6SS-P9	R7UL-P33	5 meters
R6SS-P10	R4UL-P30	5 meters
R6SS-P11	R3UL-P7	10 meters
R6SS-P12	R8LL-P33	5 meters
R6SS-P13	R1LL-P32	10 meters
R6SS-P14	R2LL-P7	10 meters
R6SS-P15	R5LL-P4	5 meters
R6SS-P16	R6UL-P30	3 meters
R6SS-P17	R4LL-P6	5 meters
R6SS-P18	R7LL-P33	5 meters
R6SS-P19	R8UL-P33	5 meters
R6SS-P20	R3LL-P30	10 meters
R6SS-P21	R10UL-P31	10 meters
R6SS-P22	R3UL-P1	10 meters
R6SS-P23	R2LL-P1	10 meters
R6SS-P24	R9UL-P31	10 meters
R6SS-P25	R11UL-P31	10 meters
R6SS-P26	R3LL-P35	10 meters
R6SS-P27	R8LL-P3	5 meters
R6SS-P28	R11LL-P32	10 meters
R6SS-P29	R9LL-P32	10 meters
R6SS-P30	R9UL-P36	10 meters
R6SS-P31	R8UL-P36	5 meters
R6SS-P32	R10LL-P32	10 meters
R7SS-P5	R1UL-P33	10 meters
R7SS-P6	R2UL-P32	10 meters
R7SS-P7	R5UL-P32	5 meters
R7SS-P8	R6LL-P6	5 meters
R7SS-P9	R7UL-P30	3 meters
R7SS-P10	R4UL-P31	10 meters
R7SS-P11	R3UL-P31	10 meters
R7SS-P12	R8LL-P30	5 meters
R7SS-P13	R1LL-P6	10 meters
R7SS-P14	R2LL-P32	10 meters
R7SS-P15	R5LL-P5	5 meters
R7SS-P16	R6UL-P5	5 meters
R7SS-P17	R4LL-P32	10 meters
R7SS-P18	R7LL-P30	3 meters
R7SS-P19	R8UL-P30	5 meters
R7SS-P20	R3LL-P7	10 meters
R7SS-P21	R10UL-P32	10 meters
R7SS-P22	R3UL-P35	10 meters
R7SS-P23	R4UL-P36	10 meters
R7SS-P24	R9UL-P32	5 meters
R7SS-P25	R11UL-P32	10 meters
R7SS-P26	R3LL-P1	10 meters
R7SS-P27	R8LL-P1	5 meters
R7SS-P28	R11LL-P33	10 meters
R7SS-P29	R9LL-P33	5 meters
R7SS-P30	R9UL-P2	5 meters
R7SS-P31	R9LL-P30	5 meters
R7SS-P32	R10LL-P33	10 meters
R8SS-P5	R1UL-P7	10 meters
R8SS-P6	R2UL-P30	10 meters
R8SS-P7	R5UL-P31	10 meters
R8SS-P8	R6LL-P7	5 meters
R8SS-P9	R7UL-P32	5 meters
R8SS-P10	R4UL-P4	10 meters
R8SS-P11	R3UL-P33	10 meters
R8SS-P12	R7LL-P32	5 meters
R8SS-P13	R1LL-P33	10 meters
R8SS-P14	R2LL-P30	10 meters
R8SS-P15	R5LL-P32	10 meters
R8SS-P16	R6UL-P32	5 meters
R8SS-P17	R4LL-P33	10 meters
R8SS-P18	R8LL-P32	3 meters
R8SS-P19	R8UL-P32	3 meters
R8SS-P20	R3LL-P6	10 meters
R8SS-P21	R10UL-P33	5 meters
R8SS-P22	R4LL-P36	10 meters
R8SS-P23	R4UL-P1	10 meters
R8SS-P24	R9UL-P33	5 meters
R8SS-P25	R11UL-P33	10 meters
R8SS-P26	R3LL-P36	10 meters
R8SS-P27	R10UL-P34	5 meters
R8SS-P28	R11LL-P34	10 meters
R8SS-P29	R9LL-P34	5 meters
R8SS-P30	R9UL-P34	5 meters
R8SS-P31	R9LL-P4	5 meters
R8SS-P32	R10LL-P34	5 meters
R9SS-P5	R1UL-P36	10 meters
R9SS-P6	R2UL-P36	10 meters
R9SS-P7	R5UL-P35	10 meters
R9SS-P8	R6LL-P1	10 meters
R9SS-P9	R7UL-P2	5 meters
R9SS-P10	R4UL-P34	10 meters
R9SS-P11	R3UL-P2	10 meters
R9SS-P12	R7LL-P1	5 meters
R9SS-P13	R1LL-P36	10 meters
R9SS-P14	R2LL-P3	10 meters
R9SS-P15	R5LL-P1	10 meters
R9SS-P16	R6UL-P3	10 meters
R9SS-P17	R4LL-P1	10 meters
R9SS-P18	R8LL-P2	5 meters
R9SS-P19	R8UL-P1	5 meters
R9SS-P20	R3LL-P3	10 meters
R9SS-P21	R10UL-P35	5 meters
R9SS-P22	R4LL-P35	10 meters
R9SS-P23	R4UL-P35	10 meters
R9SS-P24	R9UL-P35	3 meters
R9SS-P25	R11UL-P35	5 meters
R9SS-P26	R5UL-P36	10 meters
R9SS-P27	R10UL-P36	5 meters
R9SS-P28	R11LL-P35	5 meters
R9SS-P29	R9LL-P35	3 meters
R9SS-P30	R10LL-P2	5 meters
R9SS-P31	R9LL-P36	3 meters
R9SS-P32	R10LL-P35	5 meters
R10SS-P5	R1UL-P35	15 meters
R10SS-P6	R2UL-P34	10 meters
R10SS-P7	R5UL-P1	10 meters
R10SS-P8	R6LL-P2	10 meters
R10SS-P9	R7UL-P36	10 meters
R10SS-P10	R4UL-P3	10 meters
R10SS-P11	R3UL-P3	10 meters
R10SS-P12	R7LL-P2	10 meters
R10SS-P13	R1LL-P35	15 meters
R10SS-P14	R2LL-P36	10 meters
R10SS-P15	R5LL-P35	10 meters
R10SS-P16	R6UL-P35	10 meters
R10SS-P17	R4LL-P2	10 meters
R10SS-P18	R8LL-P36	5 meters
R10SS-P19	R8UL-P2	5 meters
R10SS-P20	R3LL-P2	10 meters
R10SS-P21	R10UL-P4	3 meters
R10SS-P22	R4LL-P34	10 meters
R10SS-P23	R5LL-P36	10 meters
R10SS-P24	R9UL-P4	5 meters
R10SS-P25	R11UL-P4	5 meters
R10SS-P26	R5UL-P34	10 meters
R10SS-P27	R10UL-P6	3 meters
R10SS-P28	R11LL-P6	5 meters
R10SS-P29	R9LL-P6	5 meters
R10SS-P30	R10LL-P6	3 meters
R10SS-P31	R11UL-P6	5 meters
R10SS-P32	R10LL-P30	3 meters
R11SS-P5	R1UL-P2	15 meters
R11SS-P6	R2UL-P35	15 meters
R11SS-P7	R5UL-P3	10 meters
R11SS-P8	R6LL-P35	10 meters
R11SS-P9	R7UL-P35	10 meters
R11SS-P10	R4UL-P2	10 meters
R11SS-P11	R3UL-P36	10 meters
R11SS-P12	R7LL-P35	10 meters
R11SS-P13	R1LL-P3	15 meters
R11SS-P14	R2LL-P34	15 meters
R11SS-P15	R5LL-P3	10 meters
R11SS-P16	R6UL-P2	10 meters
R11SS-P17	R4LL-P3	10 meters
R11SS-P18	R8LL-P35	10 meters
R11SS-P19	R8UL-P35	10 meters
R11SS-P20	R3LL-P34	10 meters
R11SS-P21	R10UL-P2	5 meters
R11SS-P22	R6UL-P1	10 meters
R11SS-P23	R5LL-P34	10 meters
R11SS-P24	R9UL-P6	5 meters
R11SS-P25	R11UL-P2	3 meters
R11SS-P26	R5UL-P2	10 meters
R11SS-P27	R11LL-P36	3 meters
R11SS-P28	R11LL-P4	3 meters
R11SS-P29	R9LL-P2	5 meters
R11SS-P30	R10LL-P4	5 meters
R11SS-P31	R11UL-P34	3 meters
R11SS-P32	R10LL-P36	5 meters

4.13 Twelve-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect twelve racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, interconnecting 10 or more of these racks requires modification to the following cabling tables. Contact Oracle for further details.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a 12 rack system.

Table 4-76 Leaf Switch Connections for the First Rack in a 12 Rack System

Connection	Cable Length
R1UL-P1 to R12SS-P5	15 meters
R1UL-P2 to R11SS-P5	15 meters
R1UL-P3 to R1SS-P23	3 meters
R1UL-P4 to R4SS-P5	10 meters
R1UL-P5 to R1SS-P5	3 meters
R1UL-P6 to R3SS-P5	5 meters
R1UL-P7 to R8SS-P5	10 meters
R1UL-P30 to R5SS-P5	10 meters
R1UL-P31 to R2SS-P5	5 meters
R1UL-P32 to R6SS-P5	10 meters
R1UL-P33 to R7SS-P5	10 meters
R1UL-P34 to R2SS-P23	5 meters
R1UL-P35 to R10SS-P5	15 meters
R1UL-P36 to R9SS-P5	10 meters
R1LL-P1 to R2SS-P22	5 meters
R1LL-P2 to R3SS-P22	5 meters
R1LL-P3 to R11SS-P13	15 meters
R1LL-P4 to R3SS-P13	5 meters
R1LL-P5 to R1SS-P13	3 meters
R1LL-P6 to R7SS-P13	10 meters
R1LL-P7 to R5SS-P13	10 meters
R1LL-P30 to R4SS-P13	10 meters
R1LL-P31 to R2SS-P13	5 meters
R1LL-P32 to R6SS-P13	10 meters
R1LL-P33 to R8SS-P13	10 meters
R1LL-P34 to R12SS-P13	15 meters
R1LL-P35 to R10SS-P13	15 meters
R1LL-P36 to R9SS-P13	10 meters

Table 4-77 Leaf Switch Connections for the Second Rack in a 12 Rack System

Connection	Cable Length
R2UL-P1 to R12SS-P6	15 meters
R2UL-P2 to R3SS-P23	5 meters
R2UL-P3 to R4SS-P23	5 meters
R2UL-P4 to R4SS-P6	5 meters
R2UL-P5 to R1SS-P6	5 meters
R2UL-P6 to R3SS-P6	5 meters
R2UL-P7 to R5SS-P6	10 meters
R2UL-P30 to R8SS-P6	10 meters
R2UL-P31 to R2SS-P6	3 meters
R2UL-P32 to R7SS-P6	10 meters
R2UL-P33 to R6SS-P6	10 meters
R2UL-P34 to R10SS-P6	10 meters
R2UL-P35 to R11SS-P6	15 meters
R2UL-P36 to R9SS-P6	10 meters
R2LL-P1 to R12SS-P14	15 meters
R2LL-P2 to R4SS-P22	5 meters
R2LL-P3 to R9SS-P14	10 meters
R2LL-P4 to R4SS-P14	5 meters
R2LL-P5 to R1SS-P14	5 meters
R2LL-P6 to R3SS-P14	5 meters
R2LL-P7 to R6SS-P14	10 meters
R2LL-P30 to R8SS-P14	10 meters
R2LL-P31 to R2SS-P14	3 meters
R2LL-P32 to R7SS-P14	10 meters
R2LL-P33 to R5SS-P14	10 meters
R2LL-P34 to R11SS-P14	15 meters
R2LL-P35 to R5SS-P22	10 meters
R2LL-P36 to R10SS-P14	10 meters

Table 4-78 Leaf Switch Connections for the Third Rack in a 12 Rack System

Connection	Cable Length
R3UL-P1 to R6SS-P23	10 meters
R3UL-P2 to R9SS-P11	10 meters
R3UL-P3 to R10SS-P11	10 meters
R3UL-P4 to R4SS-P11	5 meters
R3UL-P5 to R1SS-P11	5 meters
R3UL-P6 to R2SS-P11	5 meters
R3UL-P7 to R6SS-P11	10 meters
R3UL-P30 to R3SS-P11	3 meters
R3UL-P31 to R7SS-P11	10 meters
R3UL-P32 to R5SS-P11	5 meters
R3UL-P33 to R8SS-P11	10 meters
R3UL-P34 to R5SS-P23	5 meters
R3UL-P35 to R12SS-P11	15 meters
R3UL-P36 to R11SS-P11	10 meters
R3LL-P1 to R7SS-P22	10 meters
R3LL-P2 to R10SS-P20	10 meters
R3LL-P3 to R9SS-P20	10 meters
R3LL-P4 to R1SS-P20	5 meters
R3LL-P5 to R5SS-P20	5 meters
R3LL-P6 to R8SS-P20	10 meters
R3LL-P7 to R7SS-P20	10 meters
R3LL-P30 to R6SS-P20	10 meters
R3LL-P31 to R2SS-P20	5 meters
R3LL-P32 to R3SS-P20	3 meters
R3LL-P33 to R4SS-P20	5 meters
R3LL-P34 to R11SS-P20	10 meters
R3LL-P35 to R6SS-P22	10 meters
R3LL-P36 to R12SS-P20	15 meters

Table 4-79 Leaf Switch Connections for the Fourth Rack in a 12 Rack System

Connection	Cable Length
R4UL-P1 to R8SS-P23	10 meters
R4UL-P2 to R11SS-P10	10 meters
R4UL-P3 to R10SS-P10	10 meters
R4UL-P4 to R8SS-P10	10 meters
R4UL-P5 to R5SS-P10	5 meters
R4UL-P6 to R2SS-P10	5 meters
R4UL-P7 to R1SS-P10	10 meters
R4UL-P30 to R6SS-P10	5 meters
R4UL-P31 to R7SS-P10	10 meters
R4UL-P32 to R4SS-P10	3 meters
R4UL-P33 to R3SS-P10	5 meters
R4UL-P34 to R9SS-P10	10 meters
R4UL-P35 to R12SS-P10	10 meters
R4UL-P36 to R7SS-P23	10 meters
R4LL-P1 to R9SS-P17	10 meters
R4LL-P2 to R10SS-P17	10 meters
R4LL-P3 to R11SS-P17	10 meters
R4LL-P4 to R2SS-P17	5 meters
R4LL-P5 to R1SS-P17	10 meters
R4LL-P6 to R6SS-P17	5 meters
R4LL-P7 to R5SS-P17	5 meters
R4LL-P30 to R4SS-P17	3 meters
R4LL-P31 to R3SS-P17	5 meters
R4LL-P32 to R7SS-P17	10 meters
R4LL-P33 to R8SS-P17	10 meters
R4LL-P34 to R12SS-P17	10 meters
R4LL-P35 to R9SS-P22	10 meters
R4LL-P36 to R8SS-P22	10 meters

Table 4-80 Leaf Switch Connections for the Fifth Rack in a 12 Rack System

Connection	Cable Length
R5UL-P1 to R10SS-P7	10 meters
R5UL-P2 to R12SS-P7	10 meters
R5UL-P3 to R11SS-P7	10 meters
R5UL-P4 to R2SS-P8	10 meters
R5UL-P5 to R1SS-P8	10 meters
R5UL-P6 to R3SS-P8	5 meters
R5UL-P7 to R6SS-P7	5 meters
R5UL-P30 to R5SS-P7	3 meters
R5UL-P31 to R8SS-P7	10 meters
R5UL-P32 to R7SS-P7	5 meters
R5UL-P33 to R4SS-P12	5 meters
R5UL-P34 to R10SS-P23	10 meters
R5UL-P35 to R9SS-P7	10 meters
R5UL-P36 to R9SS-P23	10 meters
R5LL-P1 to R9SS-P15	10 meters
R5LL-P2 to R12SS-P15	10 meters
R5LL-P3 to R11SS-P15	10 meters
R5LL-P4 to R6SS-P15	5 meters
R5LL-P5 to R7SS-P15	5 meters
R5LL-P6 to R2SS-P18	10 meters
R5LL-P7 to R1SS-P18	10 meters
R5LL-P30 to R5SS-P15	3 meters
R5LL-P31 to R3SS-P16	5 meters
R5LL-P32 to R8SS-P15	10 meters
R5LL-P33 to R4SS-P19	5 meters
R5LL-P34 to R11SS-P22	10 meters
R5LL-P35 to R10SS-P15	10 meters
R5LL-P36 to R10SS-P22	10 meters

Table 4-81 Leaf Switch Connections for the Sixth Rack in a 12 Rack System

Connection	Cable Length
R6UL-P1 to R11SS-P23	10 meters
R6UL-P2 to R11SS-P16	10 meters
R6UL-P3 to R9SS-P16	10 meters
R6UL-P4 to R2SS-P16	10 meters
R6UL-P5 to R7SS-P16	5 meters
R6UL-P6 to R3SS-P19	10 meters
R6UL-P7 to R1SS-P16	10 meters
R6UL-P30 to R6SS-P16	3 meters
R6UL-P31 to R4SS-P15	5 meters
R6UL-P32 to R8SS-P16	5 meters
R6UL-P33 to R5SS-P18	5 meters
R6UL-P34 to R12SS-P16	10 meters
R6UL-P35 to R10SS-P16	10 meters
R6UL-P36 to R12SS-P23	10 meters
R6LL-P1 to R9SS-P8	10 meters
R6LL-P2 to R10SS-P8	10 meters
R6LL-P3 to R1SS-P22	10 meters
R6LL-P4 to R2SS-P12	10 meters
R6LL-P5 to R1SS-P12	10 meters
R6LL-P6 to R7SS-P8	5 meters
R6LL-P7 to R8SS-P8	5 meters
R6LL-P30 to R5SS-P8	5 meters
R6LL-P31 to R3SS-P7	10 meters
R6LL-P32 to R6SS-P8	3 meters
R6LL-P33 to R4SS-P9	5 meters
R6LL-P34 to R12SS-P22	10 meters
R6LL-P35 to R11SS-P8	10 meters
R6LL-P36 to R12SS-P8	10 meters

Table 4-82 Leaf Switch Connections for the Seventh Rack in a 12 Rack System

Connection	Cable Length
R7UL-P1 to R2SS-P26	10 meters
R7UL-P2 to R9SS-P9	5 meters
R7UL-P3 to R1SS-P26	10 meters
R7UL-P4 to R3SS-P9	10 meters
R7UL-P5 to R1SS-P9	10 meters
R7UL-P6 to R4SS-P8	10 meters
R7UL-P7 to R2SS-P7	10 meters
R7UL-P30 to R7SS-P9	3 meters
R7UL-P31 to R5SS-P9	5 meters
R7UL-P32 to R8SS-P9	5 meters
R7UL-P33 to R6SS-P9	5 meters
R7UL-P34 to R12SS-P9	10 meters
R7UL-P35 to R11SS-P9	10 meters
R7UL-P36 to R10SS-P9	10 meters
R7LL-P1 to R9SS-P12	5 meters
R7LL-P2 to R10SS-P12	10 meters
R7LL-P3 to R3SS-P30	10 meters
R7LL-P4 to R3SS-P15	10 meters
R7LL-P5 to R1SS-P19	10 meters
R7LL-P6 to R4SS-P18	10 meters
R7LL-P7 to R2SS-P19	10 meters
R7LL-P30 to R7SS-P18	3 meters
R7LL-P31 to R5SS-P16	5 meters
R7LL-P32 to R8SS-P12	5 meters
R7LL-P33 to R6SS-P18	5 meters
R7LL-P34 to R12SS-P12	10 meters
R7LL-P35 to R11SS-P12	10 meters
R7LL-P36 to R2SS-P30	10 meters

Table 4-83 Leaf Switch Connections for the Eighth Rack in a 12 Rack System

Connection	Cable Length
R8UL-P1 to R9SS-P19	5 meters
R8UL-P2 to R10SS-P19	5 meters
R8UL-P3 to R3SS-P26	10 meters
R8UL-P4 to R3SS-P18	10 meters
R8UL-P5 to R1SS-P15	10 meters
R8UL-P6 to R4SS-P16	10 meters
R8UL-P7 to R2SS-P15	10 meters
R8UL-P30 to R7SS-P19	5 meters
R8UL-P31 to R5SS-P19	10 meters
R8UL-P32 to R8SS-P19	3 meters
R8UL-P33 to R6SS-P19	5 meters
R8UL-P34 to R12SS-P19	10 meters
R8UL-P35 to R11SS-P19	10 meters
R8UL-P36 to R4SS-P26	10 meters
R8LL-P1 to R5SS-P30	10 meters
R8LL-P2 to R9SS-P18	5 meters
R8LL-P3 to R4SS-P30	10 meters
R8LL-P4 to R3SS-P12	10 meters
R8LL-P5 to R1SS-P7	10 meters
R8LL-P6 to R4SS-P7	10 meters
R8LL-P7 to R2SS-P9	10 meters
R8LL-P30 to R7SS-P12	5 meters
R8LL-P31 to R5SS-P12	10 meters
R8LL-P32 to R8SS-P18	3 meters
R8LL-P33 to R6SS-P12	5 meters
R8LL-P34 to R12SS-P18	10 meters
R8LL-P35 to R11SS-P18	10 meters
R8LL-P36 to R10SS-P18	5 meters

Table 4-84 Leaf Switch Connections for the Ninth Rack in a 12 Rack System

Connection	Cable Length
R9UL-P1 to R1SS-P24	10 meters
R9UL-P2 to R5SS-P26	10 meters
R9UL-P3 to R2SS-P24	10 meters
R9UL-P4 to R10SS-P24	5 meters
R9UL-P5 to R3SS-P24	10 meters
R9UL-P6 to R11SS-P24	5 meters
R9UL-P7 to R4SS-P24	10 meters
R9UL-P30 to R5SS-P24	10 meters
R9UL-P31 to R6SS-P24	10 meters
R9UL-P32 to R7SS-P24	5 meters
R9UL-P33 to R8SS-P24	5 meters
R9UL-P34 to R6SS-P26	10 meters
R9UL-P35 to R9SS-P24	3 meters
R9UL-P36 to R12SS-P24	10 meters
R9LL-P1 to R1SS-P29	10 meters
R9LL-P2 to R11SS-P29	5 meters
R9LL-P3 to R2SS-P29	10 meters
R9LL-P4 to R6SS-P30	10 meters
R9LL-P5 to R3SS-P29	10 meters
R9LL-P6 to R10SS-P29	5 meters
R9LL-P7 to R4SS-P29	10 meters
R9LL-P30 to R12SS-P29	10 meters
R9LL-P31 to R5SS-P29	10 meters
R9LL-P32 to R6SS-P29	10 meters
R9LL-P33 to R7SS-P29	5 meters
R9LL-P34 to R8SS-P29	5 meters
R9LL-P35 to R9SS-P29	3 meters
R9LL-P36 to R7SS-P30	5 meters

Table 4-85 Leaf Switch Connections for the Tenth Rack in a 12 Rack System

Connection	Cable Length
R10UL-P1 to R1SS-P21	15 meters
R10UL-P2 to R11SS-P21	5 meters
R10UL-P3 to R2SS-P21	10 meters
R10UL-P4 to R10SS-P21	3 meters
R10UL-P5 to R3SS-P21	10 meters
R10UL-P6 to R8SS-P26	5 meters
R10UL-P7 to R4SS-P21	10 meters
R10UL-P30 to R5SS-P21	10 meters
R10UL-P31 to R6SS-P21	10 meters
R10UL-P32 to R7SS-P21	10 meters
R10UL-P33 to R8SS-P21	5 meters
R10UL-P34 to R12SS-P21	5 meters
R10UL-P35 to R9SS-P21	5 meters
R10UL-P36 to R7SS-P26	10 meters
R10LL-P1 to R1SS-P31	15 meters
R10LL-P2 to R12SS-P31	5 meters
R10LL-P3 to R2SS-P31	10 meters
R10LL-P4 to R11SS-P31	5 meters
R10LL-P5 to R3SS-P31	10 meters
R10LL-P6 to R10SS-P31	3 meters
R10LL-P7 to R4SS-P31	10 meters
R10LL-P30 to R8SS-P31	5 meters
R10LL-P31 to R5SS-P31	10 meters
R10LL-P32 to R6SS-P31	10 meters
R10LL-P33 to R7SS-P31	10 meters
R10LL-P34 to R8SS-P30	5 meters
R10LL-P35 to R9SS-P30	5 meters
R10LL-P36 to R9SS-P31	5 meters

Table 4-86 Leaf Switch Connections for the Eleventh Rack in a 12 Rack System

Connection	Cable Length
R11UL-P1 to R1SS-P25	15 meters
R11UL-P2 to R11SS-P25	3 meters
R11UL-P3 to R2SS-P25	15 meters
R11UL-P4 to R10SS-P25	5 meters
R11UL-P5 to R3SS-P25	10 meters
R11UL-P6 to R10SS-P26	5 meters
R11UL-P7 to R4SS-P25	10 meters
R11UL-P30 to R5SS-P25	10 meters
R11UL-P31 to R6SS-P25	10 meters
R11UL-P32 to R7SS-P25	10 meters
R11UL-P33 to R8SS-P25	10 meters
R11UL-P34 to R12SS-P25	5 meters
R11UL-P35 to R9SS-P25	5 meters
R11UL-P36 to R9SS-P26	5 meters
R11LL-P1 to R1SS-P28	15 meters
R11LL-P2 to R10SS-P30	5 meters
R11LL-P3 to R2SS-P28	15 meters
R11LL-P4 to R11SS-P28	3 meters
R11LL-P5 to R3SS-P28	10 meters
R11LL-P6 to R10SS-P28	5 meters
R11LL-P7 to R4SS-P28	10 meters
R11LL-P30 to R11SS-P30	3 meters
R11LL-P31 to R5SS-P28	10 meters
R11LL-P32 to R6SS-P28	10 meters
R11LL-P33 to R7SS-P28	10 meters
R11LL-P34 to R8SS-P28	10 meters
R11LL-P35 to R9SS-P28	5 meters
R11LL-P36 to R12SS-P28	5 meters

Table 4-87 Leaf Switch Connections for the Twelfth Rack in a 12 Rack System

Connection	Cable Length
R12UL-P1 to R1SS-P27	15 meters
R12UL-P2 to R11SS-P27	5 meters
R12UL-P3 to R2SS-P27	15 meters
R12UL-P4 to R10SS-P27	5 meters
R12UL-P5 to R3SS-P27	15 meters
R12UL-P6 to R11SS-P26	5 meters
R12UL-P7 to R4SS-P27	10 meters
R12UL-P30 to R5SS-P27	10 meters
R12UL-P31 to R6SS-P27	10 meters
R12UL-P32 to R7SS-P27	10 meters
R12UL-P33 to R8SS-P27	10 meters
R12UL-P34 to R12SS-P27	3 meters
R12UL-P35 to R9SS-P27	10 meters
R12UL-P36 to R12SS-P26	3 meters
R12LL-P1 to R1SS-P32	15 meters
R12LL-P2 to R1SS-P30	15 meters
R12LL-P3 to R2SS-P32	15 meters
R12LL-P4 to R11SS-P32	5 meters
R12LL-P5 to R3SS-P32	15 meters
R12LL-P6 to R10SS-P32	5 meters
R12LL-P7 to R4SS-P32	10 meters
R12LL-P30 to R12SS-P30	3 meters
R12LL-P31 to R5SS-P32	10 meters
R12LL-P32 to R6SS-P32	10 meters
R12LL-P33 to R7SS-P32	10 meters
R12LL-P34 to R8SS-P32	10 meters
R12LL-P35 to R9SS-P32	10 meters
R12LL-P36 to R12SS-P32	3 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-88 Twelve-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R8LL-P5	10 meters
R1SS-P8	R5UL-P5	10 meters
R1SS-P9	R7UL-P5	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R6LL-P5	10 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R8UL-P5	10 meters
R1SS-P16	R6UL-P7	10 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R5LL-P7	10 meters
R1SS-P19	R7LL-P5	10 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R10UL-P1	15 meters
R1SS-P22	R6LL-P3	10 meters
R1SS-P23	R1UL-P3	3 meters
R1SS-P24	R9UL-P1	10 meters
R1SS-P25	R11UL-P1	15 meters
R1SS-P26	R7UL-P3	10 meters
R1SS-P27	R12UL-P1	15 meters
R1SS-P28	R11LL-P1	15 meters
R1SS-P29	R9LL-P1	10 meters
R1SS-P30	R12LL-P2	15 meters
R1SS-P31	R10LL-P1	15 meters
R1SS-P32	R12LL-P1	15 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R7UL-P7	10 meters
R2SS-P8	R5UL-P4	10 meters
R2SS-P9	R8LL-P7	10 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R6LL-P4	10 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R8UL-P7	10 meters
R2SS-P16	R6UL-P4	10 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R5LL-P6	10 meters
R2SS-P19	R7LL-P7	10 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R10UL-P3	10 meters
R2SS-P22	R1LL-P1	5 meters
R2SS-P23	R1UL-P34	5 meters
R2SS-P24	R9UL-P3	10 meters
R2SS-P25	R11UL-P3	15 meters
R2SS-P26	R7UL-P1	10 meters
R2SS-P27	R12UL-P3	15 meters
R2SS-P28	R11LL-P3	15 meters
R2SS-P29	R9LL-P3	10 meters
R2SS-P30	R7LL-P36	10 meters
R2SS-P31	R10LL-P3	10 meters
R2SS-P32	R12LL-P3	15 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R6LL-P31	10 meters
R3SS-P8	R5UL-P6	5 meters
R3SS-P9	R7UL-P4	10 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R8LL-P4	10 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R7LL-P4	10 meters
R3SS-P16	R5LL-P31	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R8UL-P4	10 meters
R3SS-P19	R6UL-P6	10 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R10UL-P5	10 meters
R3SS-P22	R1LL-P2	5 meters
R3SS-P23	R2UL-P2	5 meters
R3SS-P24	R9UL-P5	10 meters
R3SS-P25	R11UL-P5	10 meters
R3SS-P26	R8UL-P3	10 meters
R3SS-P27	R12UL-P5	15 meters
R3SS-P28	R11LL-P5	10 meters
R3SS-P29	R9LL-P5	10 meters
R3SS-P30	R7LL-P3	10 meters
R3SS-P31	R10LL-P5	10 meters
R3SS-P32	R12LL-P5	15 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R8LL-P6	10 meters
R4SS-P8	R7UL-P6	10 meters
R4SS-P9	R6LL-P33	5 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R5UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R6UL-P31	5 meters
R4SS-P16	R8UL-P6	10 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R7LL-P6	10 meters
R4SS-P19	R5LL-P33	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R10UL-P7	10 meters
R4SS-P22	R2LL-P2	5 meters
R4SS-P23	R2UL-P3	5 meters
R4SS-P24	R9UL-P7	10 meters
R4SS-P25	R11UL-P7	10 meters
R4SS-P26	R8UL-P36	10 meters
R4SS-P27	R12UL-P7	10 meters
R4SS-P28	R11LL-P7	10 meters
R4SS-P29	R9LL-P7	10 meters
R4SS-P30	R8LL-P3	10 meters
R4SS-P31	R10LL-P7	10 meters
R4SS-P32	R12LL-P7	10 meters
R5SS-P5	R1UL-P30	10 meters
R5SS-P6	R2UL-P7	10 meters
R5SS-P7	R5UL-P30	3 meters
R5SS-P8	R6LL-P30	5 meters
R5SS-P9	R7UL-P31	5 meters
R5SS-P10	R4UL-P5	5 meters
R5SS-P11	R3UL-P32	5 meters
R5SS-P12	R8LL-P31	10 meters
R5SS-P13	R1LL-P7	10 meters
R5SS-P14	R2LL-P33	10 meters
R5SS-P15	R5LL-P30	3 meters
R5SS-P16	R7LL-P31	5 meters
R5SS-P17	R4LL-P7	5 meters
R5SS-P18	R6UL-P33	5 meters
R5SS-P19	R8UL-P31	10 meters
R5SS-P20	R3LL-P5	5 meters
R5SS-P21	R10UL-P30	10 meters
R5SS-P22	R2LL-P35	10 meters
R5SS-P23	R3UL-P34	5 meters
R5SS-P24	R9UL-P30	10 meters
R5SS-P25	R11UL-P30	10 meters
R5SS-P26	R9UL-P2	10 meters
R5SS-P27	R12UL-P30	10 meters
R5SS-P28	R11LL-P31	10 meters
R5SS-P29	R9LL-P31	10 meters
R5SS-P30	R8LL-P1	10 meters
R5SS-P31	R10LL-P31	10 meters
R5SS-P32	R12LL-P31	10 meters
R6SS-P5	R1UL-P32	10 meters
R6SS-P6	R2UL-P33	10 meters
R6SS-P7	R5UL-P7	5 meters
R6SS-P8	R6LL-P32	3 meters
R6SS-P9	R7UL-P33	5 meters
R6SS-P10	R4UL-P30	5 meters
R6SS-P11	R3UL-P7	10 meters
R6SS-P12	R8LL-P33	5 meters
R6SS-P13	R1LL-P32	10 meters
R6SS-P14	R2LL-P7	10 meters
R6SS-P15	R5LL-P4	5 meters
R6SS-P16	R6UL-P30	3 meters
R6SS-P17	R4LL-P6	5 meters
R6SS-P18	R7LL-P33	5 meters
R6SS-P19	R8UL-P33	5 meters
R6SS-P20	R3LL-P30	10 meters
R6SS-P21	R10UL-P31	10 meters
R6SS-P22	R3LL-P35	10 meters
R6SS-P23	R3UL-P1	10 meters
R6SS-P24	R9UL-P31	10 meters
R6SS-P25	R11UL-P31	10 meters
R6SS-P26	R9UL-P34	10 meters
R6SS-P27	R12UL-P31	10 meters
R6SS-P28	R11LL-P32	10 meters
R6SS-P29	R9LL-P32	10 meters
R6SS-P30	R9LL-P4	10 meters
R6SS-P31	R10LL-P32	10 meters
R6SS-P32	R12LL-P32	10 meters
R7SS-P5	R1UL-P33	10 meters
R7SS-P6	R2UL-P32	10 meters
R7SS-P7	R5UL-P32	5 meters
R7SS-P8	R6LL-P6	5 meters
R7SS-P9	R7UL-P30	3 meters
R7SS-P10	R4UL-P31	10 meters
R7SS-P11	R3UL-P31	10 meters
R7SS-P12	R8LL-P30	5 meters
R7SS-P13	R1LL-P6	10 meters
R7SS-P14	R2LL-P32	10 meters
R7SS-P15	R5LL-P5	5 meters
R7SS-P16	R6UL-P5	5 meters
R7SS-P17	R4LL-P32	10 meters
R7SS-P18	R7LL-P30	3 meters
R7SS-P19	R8UL-P30	5 meters
R7SS-P20	R3LL-P7	10 meters
R7SS-P21	R10UL-P32	10 meters
R7SS-P22	R3LL-P1	10 meters
R7SS-P23	R4UL-P36	10 meters
R7SS-P24	R9UL-P32	5 meters
R7SS-P25	R11UL-P32	10 meters
R7SS-P26	R10UL-P36	10 meters
R7SS-P27	R12UL-P32	10 meters
R7SS-P28	R11LL-P33	10 meters
R7SS-P29	R9LL-P33	5 meters
R7SS-P30	R9LL-P36	5 meters
R7SS-P31	R10LL-P33	10 meters
R7SS-P32	R12LL-P33	10 meters
R8SS-P5	R1UL-P7	10 meters
R8SS-P6	R2UL-P30	10 meters
R8SS-P7	R5UL-P31	10 meters
R8SS-P8	R6LL-P7	5 meters
R8SS-P9	R7UL-P32	5 meters
R8SS-P10	R4UL-P4	10 meters
R8SS-P11	R3UL-P33	10 meters
R8SS-P12	R7LL-P32	5 meters
R8SS-P13	R1LL-P33	10 meters
R8SS-P14	R2LL-P30	10 meters
R8SS-P15	R5LL-P32	10 meters
R8SS-P16	R6UL-P32	5 meters
R8SS-P17	R4LL-P33	10 meters
R8SS-P18	R8LL-P32	3 meters
R8SS-P19	R8UL-P32	3 meters
R8SS-P20	R3LL-P6	10 meters
R8SS-P21	R10UL-P33	5 meters
R8SS-P22	R4LL-P36	10 meters
R8SS-P23	R4UL-P1	10 meters
R8SS-P24	R9UL-P33	5 meters
R8SS-P25	R11UL-P33	10 meters
R8SS-P26	R10UL-P6	5 meters
R8SS-P27	R12UL-P33	10 meters
R8SS-P28	R11LL-P34	10 meters
R8SS-P29	R9LL-P34	5 meters
R8SS-P30	R10LL-P34	5 meters
R8SS-P31	R10LL-P30	5 meters
R8SS-P32	R12LL-P34	10 meters
R9SS-P5	R1UL-P36	10 meters
R9SS-P6	R2UL-P36	10 meters
R9SS-P7	R5UL-P35	10 meters
R9SS-P8	R6LL-P1	10 meters
R9SS-P9	R7UL-P2	5 meters
R9SS-P10	R4UL-P34	10 meters
R9SS-P11	R3UL-P2	10 meters
R9SS-P12	R7LL-P1	5 meters
R9SS-P13	R1LL-P36	10 meters
R9SS-P14	R2LL-P3	10 meters
R9SS-P15	R5LL-P1	10 meters
R9SS-P16	R6UL-P3	10 meters
R9SS-P17	R4LL-P1	10 meters
R9SS-P18	R8LL-P2	5 meters
R9SS-P19	R8UL-P1	5 meters
R9SS-P20	R3LL-P3	10 meters
R9SS-P21	R10UL-P35	5 meters
R9SS-P22	R4LL-P35	10 meters
R9SS-P23	R5UL-P36	10 meters
R9SS-P24	R9UL-P35	3 meters
R9SS-P25	R11UL-P35	5 meters
R9SS-P26	R11UL-P36	5 meters
R9SS-P27	R12UL-P35	10 meters
R9SS-P28	R11LL-P35	5 meters
R9SS-P29	R9LL-P35	3 meters
R9SS-P30	R10LL-P35	5 meters
R9SS-P31	R10LL-P36	5 meters
R9SS-P32	R12LL-P35	10 meters
R10SS-P5	R1UL-P35	15 meters
R10SS-P6	R2UL-P34	10 meters
R10SS-P7	R5UL-P1	10 meters
R10SS-P8	R6LL-P2	10 meters
R10SS-P9	R7UL-P36	10 meters
R10SS-P10	R4UL-P3	10 meters
R10SS-P11	R3UL-P3	10 meters
R10SS-P12	R7LL-P2	10 meters
R10SS-P13	R1LL-P35	15 meters
R10SS-P14	R2LL-P36	10 meters
R10SS-P15	R5LL-P35	10 meters
R10SS-P16	R6UL-P35	10 meters
R10SS-P17	R4LL-P2	10 meters
R10SS-P18	R8LL-P36	5 meters
R10SS-P19	R8UL-P2	5 meters
R10SS-P20	R3LL-P2	10 meters
R10SS-P21	R10UL-P4	3 meters
R10SS-P22	R5LL-P36	10 meters
R10SS-P23	R5UL-P34	10 meters
R10SS-P24	R9UL-P4	5 meters
R10SS-P25	R11UL-P4	5 meters
R10SS-P26	R11UL-P6	5 meters
R10SS-P27	R12UL-P4	5 meters
R10SS-P28	R11LL-P6	5 meters
R10SS-P29	R9LL-P6	5 meters
R10SS-P30	R11LL-P2	5 meters
R10SS-P31	R10LL-P6	3 meters
R10SS-P32	R12LL-P6	5 meters
R11SS-P5	R1UL-P2	15 meters
R11SS-P6	R2UL-P35	15 meters
R11SS-P7	R5UL-P3	10 meters
R11SS-P8	R6LL-P35	10 meters
R11SS-P9	R7UL-P35	10 meters
R11SS-P10	R4UL-P2	10 meters
R11SS-P11	R3UL-P36	10 meters
R11SS-P12	R7LL-P35	10 meters
R11SS-P13	R1LL-P3	15 meters
R11SS-P14	R2LL-P34	15 meters
R11SS-P15	R5LL-P3	10 meters
R11SS-P16	R6UL-P2	10 meters
R11SS-P17	R4LL-P3	10 meters
R11SS-P18	R8LL-P35	10 meters
R11SS-P19	R8UL-P35	10 meters
R11SS-P20	R3LL-P34	10 meters
R11SS-P21	R10UL-P2	5 meters
R11SS-P22	R5LL-P34	10 meters
R11SS-P23	R6UL-P1	10 meters
R11SS-P24	R9UL-P6	5 meters
R11SS-P25	R11UL-P2	3 meters
R11SS-P26	R12UL-P6	5 meters
R11SS-P27	R12UL-P2	5 meters
R11SS-P28	R11LL-P4	3 meters
R11SS-P29	R9LL-P2	5 meters
R11SS-P30	R11LL-P30	3 meters
R11SS-P31	R10LL-P4	5 meters
R11SS-P32	R12LL-P4	5 meters
R12SS-P5	R1UL-P1	15 meters
R12SS-P6	R2UL-P1	15 meters
R12SS-P7	R5UL-P2	10 meters
R12SS-P8	R6LL-P36	10 meters
R12SS-P9	R7UL-P34	10 meters
R12SS-P10	R4UL-P35	10 meters
R12SS-P11	R3UL-P35	15 meters
R12SS-P12	R7LL-P34	10 meters
R12SS-P13	R1LL-P34	15 meters
R12SS-P14	R2LL-P1	15 meters
R12SS-P15	R5LL-P2	10 meters
R12SS-P16	R6UL-P34	10 meters
R12SS-P17	R4LL-P34	10 meters
R12SS-P18	R8LL-P34	10 meters
R12SS-P19	R8UL-P34	10 meters
R12SS-P20	R3LL-P36	15 meters
R12SS-P21	R10UL-P34	5 meters
R12SS-P22	R6LL-P34	10 meters
R12SS-P23	R6UL-P36	10 meters
R12SS-P24	R9UL-P36	10 meters
R12SS-P25	R11UL-P34	5 meters
R12SS-P26	R12UL-P36	3 meters
R12SS-P27	R12UL-P34	3 meters
R12SS-P28	R11LL-P36	5 meters
R12SS-P29	R9LL-P30	10 meters
R12SS-P30	R12LL-P30	3 meters
R12SS-P31	R10LL-P2	5 meters
R12SS-P32	R12LL-P36	3 meters

4.14 Thirteen-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect thirteen racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, interconnecting 10 or more of these racks requires modification to the following cabling tables. Contact Oracle for further details.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a 13 rack system.

Table 4-89 Leaf Switch Connections for the First Rack in a 13 Rack System

Connection	Cable Length
R1UL-P1 to R12SS-P5	15 meters
R1UL-P2 to R11SS-P5	15 meters
R1UL-P3 to R1SS-P23	3 meters
R1UL-P4 to R4SS-P5	10 meters
R1UL-P5 to R1SS-P5	3 meters
R1UL-P6 to R3SS-P5	5 meters
R1UL-P7 to R8SS-P5	10 meters
R1UL-P30 to R5SS-P5	10 meters
R1UL-P31 to R2SS-P5	5 meters
R1UL-P32 to R6SS-P5	10 meters
R1UL-P33 to R7SS-P5	10 meters
R1UL-P34 to R13SS-P5	15 meters
R1UL-P35 to R10SS-P5	15 meters
R1UL-P36 to R9SS-P5	10 meters
R1LL-P1 to R2SS-P23	5 meters
R1LL-P2 to R13SS-P13	15 meters
R1LL-P3 to R11SS-P13	15 meters
R1LL-P4 to R3SS-P13	5 meters
R1LL-P5 to R1SS-P13	3 meters
R1LL-P6 to R7SS-P13	10 meters
R1LL-P7 to R5SS-P13	10 meters
R1LL-P30 to R4SS-P13	10 meters
R1LL-P31 to R2SS-P13	5 meters
R1LL-P32 to R6SS-P13	10 meters
R1LL-P33 to R8SS-P13	10 meters
R1LL-P34 to R12SS-P13	15 meters
R1LL-P35 to R10SS-P13	15 meters
R1LL-P36 to R9SS-P13	10 meters

Table 4-90 Leaf Switch Connections for the Second Rack in a 13 Rack System

Connection	Cable Length
R2UL-P1 to R12SS-P6	15 meters
R2UL-P2 to R3SS-P23	5 meters
R2UL-P3 to R13SS-P6	15 meters
R2UL-P4 to R4SS-P6	5 meters
R2UL-P5 to R1SS-P6	5 meters
R2UL-P6 to R3SS-P6	5 meters
R2UL-P7 to R5SS-P6	10 meters
R2UL-P30 to R8SS-P6	10 meters
R2UL-P31 to R2SS-P6	3 meters
R2UL-P32 to R7SS-P6	10 meters
R2UL-P33 to R6SS-P6	10 meters
R2UL-P34 to R10SS-P6	10 meters
R2UL-P35 to R11SS-P6	15 meters
R2UL-P36 to R9SS-P6	10 meters
R2LL-P1 to R12SS-P14	15 meters
R2LL-P2 to R4SS-P23	5 meters
R2LL-P3 to R9SS-P14	10 meters
R2LL-P4 to R4SS-P14	5 meters
R2LL-P5 to R1SS-P14	5 meters
R2LL-P6 to R3SS-P14	5 meters
R2LL-P7 to R6SS-P14	10 meters
R2LL-P30 to R8SS-P14	10 meters
R2LL-P31 to R2SS-P14	3 meters
R2LL-P32 to R7SS-P14	10 meters
R2LL-P33 to R5SS-P14	10 meters
R2LL-P34 to R11SS-P14	15 meters
R2LL-P35 to R13SS-P14	15 meters
R2LL-P36 to R10SS-P14	10 meters

Table 4-91 Leaf Switch Connections for the Third Rack in a 13 Rack System

Connection	Cable Length
R3UL-P1 to R13SS-P11	15 meters
R3UL-P2 to R9SS-P11	10 meters
R3UL-P3 to R10SS-P11	10 meters
R3UL-P4 to R4SS-P11	5 meters
R3UL-P5 to R1SS-P11	5 meters
R3UL-P6 to R2SS-P11	5 meters
R3UL-P7 to R6SS-P11	10 meters
R3UL-P30 to R3SS-P11	3 meters
R3UL-P31 to R7SS-P11	10 meters
R3UL-P32 to R5SS-P11	5 meters
R3UL-P33 to R8SS-P11	10 meters
R3UL-P34 to R5SS-P23	5 meters
R3UL-P35 to R12SS-P11	15 meters
R3UL-P36 to R11SS-P11	10 meters
R3LL-P1 to R13SS-P20	15 meters
R3LL-P2 to R10SS-P20	10 meters
R3LL-P3 to R9SS-P20	10 meters
R3LL-P4 to R1SS-P20	5 meters
R3LL-P5 to R5SS-P20	5 meters
R3LL-P6 to R8SS-P20	10 meters
R3LL-P7 to R7SS-P20	10 meters
R3LL-P30 to R6SS-P20	10 meters
R3LL-P31 to R2SS-P20	5 meters
R3LL-P32 to R3SS-P20	3 meters
R3LL-P33 to R4SS-P20	5 meters
R3LL-P34 to R11SS-P20	10 meters
R3LL-P35 to R6SS-P23	10 meters
R3LL-P36 to R12SS-P20	15 meters

Table 4-92 Leaf Switch Connections for the Fourth Rack in a 13 Rack System

Connection	Cable Length
R4UL-P1 to R13SS-P10	15 meters
R4UL-P2 to R11SS-P10	10 meters
R4UL-P3 to R10SS-P10	10 meters
R4UL-P4 to R8SS-P10	10 meters
R4UL-P5 to R5SS-P10	5 meters
R4UL-P6 to R2SS-P10	5 meters
R4UL-P7 to R1SS-P10	10 meters
R4UL-P30 to R6SS-P10	5 meters
R4UL-P31 to R7SS-P10	10 meters
R4UL-P32 to R4SS-P10	3 meters
R4UL-P33 to R3SS-P10	5 meters
R4UL-P34 to R9SS-P10	10 meters
R4UL-P35 to R12SS-P10	10 meters
R4UL-P36 to R7SS-P23	10 meters
R4LL-P1 to R9SS-P17	10 meters
R4LL-P2 to R10SS-P17	10 meters
R4LL-P3 to R11SS-P17	10 meters
R4LL-P4 to R2SS-P17	5 meters
R4LL-P5 to R1SS-P17	10 meters
R4LL-P6 to R6SS-P17	5 meters
R4LL-P7 to R5SS-P17	5 meters
R4LL-P30 to R4SS-P17	3 meters
R4LL-P31 to R3SS-P17	5 meters
R4LL-P32 to R7SS-P17	10 meters
R4LL-P33 to R8SS-P17	10 meters
R4LL-P34 to R12SS-P17	10 meters
R4LL-P35 to R13SS-P17	15 meters
R4LL-P36 to R8SS-P23	10 meters

Table 4-93 Leaf Switch Connections for the Fifth Rack in a 13 Rack System

Connection	Cable Length
R5UL-P1 to R10SS-P7	10 meters
R5UL-P2 to R12SS-P7	10 meters
R5UL-P3 to R11SS-P7	10 meters
R5UL-P4 to R2SS-P8	10 meters
R5UL-P5 to R1SS-P8	10 meters
R5UL-P6 to R3SS-P8	5 meters
R5UL-P7 to R6SS-P7	5 meters
R5UL-P30 to R5SS-P7	3 meters
R5UL-P31 to R8SS-P7	10 meters
R5UL-P32 to R7SS-P7	5 meters
R5UL-P33 to R4SS-P12	5 meters
R5UL-P34 to R13SS-P7	10 meters
R5UL-P35 to R9SS-P7	10 meters
R5UL-P36 to R9SS-P23	10 meters
R5LL-P1 to R9SS-P15	10 meters
R5LL-P2 to R12SS-P15	10 meters
R5LL-P3 to R11SS-P15	10 meters
R5LL-P4 to R6SS-P15	5 meters
R5LL-P5 to R7SS-P15	5 meters
R5LL-P6 to R2SS-P18	10 meters
R5LL-P7 to R1SS-P18	10 meters
R5LL-P30 to R5SS-P15	3 meters
R5LL-P31 to R3SS-P16	5 meters
R5LL-P32 to R8SS-P15	10 meters
R5LL-P33 to R4SS-P19	5 meters
R5LL-P34 to R13SS-P15	10 meters
R5LL-P35 to R10SS-P15	10 meters
R5LL-P36 to R10SS-P23	10 meters

Table 4-94 Leaf Switch Connections for the Sixth Rack in a 13 Rack System

Connection	Cable Length
R6UL-P1 to R11SS-P23	10 meters
R6UL-P2 to R11SS-P16	10 meters
R6UL-P3 to R9SS-P16	10 meters
R6UL-P4 to R2SS-P16	10 meters
R6UL-P5 to R7SS-P16	5 meters
R6UL-P6 to R3SS-P19	10 meters
R6UL-P7 to R1SS-P16	10 meters
R6UL-P30 to R6SS-P16	3 meters
R6UL-P31 to R4SS-P15	5 meters
R6UL-P32 to R8SS-P16	5 meters
R6UL-P33 to R5SS-P18	5 meters
R6UL-P34 to R12SS-P16	10 meters
R6UL-P35 to R10SS-P16	10 meters
R6UL-P36 to R13SS-P16	10 meters
R6LL-P1 to R9SS-P8	10 meters
R6LL-P2 to R10SS-P8	10 meters
R6LL-P3 to R13SS-P8	10 meters
R6LL-P4 to R2SS-P12	10 meters
R6LL-P5 to R1SS-P12	10 meters
R6LL-P6 to R7SS-P8	5 meters
R6LL-P7 to R8SS-P8	5 meters
R6LL-P30 to R5SS-P8	5 meters
R6LL-P31 to R3SS-P7	10 meters
R6LL-P32 to R6SS-P8	3 meters
R6LL-P33 to R4SS-P9	5 meters
R6LL-P34 to R12SS-P23	10 meters
R6LL-P35 to R11SS-P8	10 meters
R6LL-P36 to R12SS-P8	10 meters

Table 4-95 Leaf Switch Connections for the Seventh Rack in a 13 Rack System

Connection	Cable Length
R7UL-P1 to R13SS-P23	10 meters
R7UL-P2 to R9SS-P9	5 meters
R7UL-P3 to R13SS-P9	10 meters
R7UL-P4 to R3SS-P9	10 meters
R7UL-P5 to R1SS-P9	10 meters
R7UL-P6 to R4SS-P8	10 meters
R7UL-P7 to R2SS-P7	10 meters
R7UL-P30 to R7SS-P9	3 meters
R7UL-P31 to R5SS-P9	5 meters
R7UL-P32 to R8SS-P9	5 meters
R7UL-P33 to R6SS-P9	5 meters
R7UL-P34 to R12SS-P9	10 meters
R7UL-P35 to R11SS-P9	10 meters
R7UL-P36 to R10SS-P9	10 meters
R7LL-P1 to R9SS-P12	5 meters
R7LL-P2 to R10SS-P12	10 meters
R7LL-P3 to R1SS-P26	10 meters
R7LL-P4 to R3SS-P15	10 meters
R7LL-P5 to R1SS-P19	10 meters
R7LL-P6 to R4SS-P18	10 meters
R7LL-P7 to R2SS-P19	10 meters
R7LL-P30 to R7SS-P18	3 meters
R7LL-P31 to R5SS-P16	5 meters
R7LL-P32 to R8SS-P12	5 meters
R7LL-P33 to R6SS-P18	5 meters
R7LL-P34 to R12SS-P12	10 meters
R7LL-P35 to R11SS-P12	10 meters
R7LL-P36 to R13SS-P12	10 meters

Table 4-96 Leaf Switch Connections for the Eighth Rack in a 13 Rack System

Connection	Cable Length
R8UL-P1 to R9SS-P19	5 meters
R8UL-P2 to R10SS-P19	5 meters
R8UL-P3 to R2SS-P26	10 meters
R8UL-P4 to R3SS-P18	10 meters
R8UL-P5 to R1SS-P15	10 meters
R8UL-P6 to R4SS-P16	10 meters
R8UL-P7 to R2SS-P15	10 meters
R8UL-P30 to R7SS-P19	5 meters
R8UL-P31 to R5SS-P19	10 meters
R8UL-P32 to R8SS-P19	3 meters
R8UL-P33 to R6SS-P19	5 meters
R8UL-P34 to R12SS-P19	10 meters
R8UL-P35 to R11SS-P19	10 meters
R8UL-P36 to R13SS-P19	10 meters
R8LL-P1 to R13SS-P18	10 meters
R8LL-P2 to R9SS-P18	5 meters
R8LL-P3 to R3SS-P26	10 meters
R8LL-P4 to R3SS-P12	10 meters
R8LL-P5 to R1SS-P7	10 meters
R8LL-P6 to R4SS-P7	10 meters
R8LL-P7 to R2SS-P9	10 meters
R8LL-P30 to R7SS-P12	5 meters
R8LL-P31 to R5SS-P12	10 meters
R8LL-P32 to R8SS-P18	3 meters
R8LL-P33 to R6SS-P12	5 meters
R8LL-P34 to R12SS-P18	10 meters
R8LL-P35 to R11SS-P18	10 meters
R8LL-P36 to R10SS-P18	5 meters

Table 4-97 Leaf Switch Connections for the Ninth Rack in a 13 Rack System

Connection	Cable Length
R9UL-P1 to R1SS-P24	10 meters
R9UL-P2 to R4SS-P26	10 meters
R9UL-P3 to R2SS-P24	10 meters
R9UL-P4 to R10SS-P24	5 meters
R9UL-P5 to R3SS-P24	10 meters
R9UL-P6 to R11SS-P24	5 meters
R9UL-P7 to R4SS-P24	10 meters
R9UL-P30 to R5SS-P24	10 meters
R9UL-P31 to R6SS-P24	10 meters
R9UL-P32 to R7SS-P24	5 meters
R9UL-P33 to R8SS-P24	5 meters
R9UL-P34 to R13SS-P24	10 meters
R9UL-P35 to R9SS-P24	3 meters
R9UL-P36 to R12SS-P24	10 meters
R9LL-P1 to R1SS-P29	10 meters
R9LL-P2 to R11SS-P29	5 meters
R9LL-P3 to R2SS-P29	10 meters
R9LL-P4 to R13SS-P29	10 meters
R9LL-P5 to R3SS-P29	10 meters
R9LL-P6 to R10SS-P29	5 meters
R9LL-P7 to R4SS-P29	10 meters
R9LL-P30 to R12SS-P29	10 meters
R9LL-P31 to R5SS-P29	10 meters
R9LL-P32 to R6SS-P29	10 meters
R9LL-P33 to R7SS-P29	5 meters
R9LL-P34 to R8SS-P29	5 meters
R9LL-P35 to R9SS-P29	3 meters
R9LL-P36 to R5SS-P26	10 meters

Table 4-98 Leaf Switch Connections for the Tenth Rack in a 13 Rack System

Connection	Cable Length
R10UL-P1 to R1SS-P21	15 meters
R10UL-P2 to R11SS-P21	5 meters
R10UL-P3 to R2SS-P21	10 meters
R10UL-P4 to R10SS-P21	3 meters
R10UL-P5 to R3SS-P21	10 meters
R10UL-P6 to R13SS-P21	10 meters
R10UL-P7 to R4SS-P21	10 meters
R10UL-P30 to R5SS-P21	10 meters
R10UL-P31 to R6SS-P21	10 meters
R10UL-P32 to R7SS-P21	10 meters
R10UL-P33 to R8SS-P21	5 meters
R10UL-P34 to R12SS-P21	5 meters
R10UL-P35 to R9SS-P21	5 meters
R10UL-P36 to R6SS-P26	10 meters
R10LL-P1 to R1SS-P31	15 meters
R10LL-P2 to R12SS-P31	5 meters
R10LL-P3 to R2SS-P31	10 meters
R10LL-P4 to R11SS-P31	5 meters
R10LL-P5 to R3SS-P31	10 meters
R10LL-P6 to R10SS-P31	3 meters
R10LL-P7 to R4SS-P31	10 meters
R10LL-P30 to R7SS-P26	10 meters
R10LL-P31 to R5SS-P31	10 meters
R10LL-P32 to R6SS-P31	10 meters
R10LL-P33 to R7SS-P31	10 meters
R10LL-P34 to R8SS-P31	5 meters
R10LL-P35 to R9SS-P31	5 meters
R10LL-P36 to R13SS-P31	10 meters

Table 4-99 Leaf Switch Connections for the Eleventh Rack in a 13 Rack System

Connection	Cable Length
R11UL-P1 to R1SS-P25	15 meters
R11UL-P2 to R11SS-P25	3 meters
R11UL-P3 to R2SS-P25	15 meters
R11UL-P4 to R10SS-P25	5 meters
R11UL-P5 to R3SS-P25	10 meters
R11UL-P6 to R13SS-P25	5 meters
R11UL-P7 to R4SS-P25	10 meters
R11UL-P30 to R5SS-P25	10 meters
R11UL-P31 to R6SS-P25	10 meters
R11UL-P32 to R7SS-P25	10 meters
R11UL-P33 to R8SS-P25	10 meters
R11UL-P34 to R12SS-P25	5 meters
R11UL-P35 to R9SS-P25	5 meters
R11UL-P36 to R8SS-P26	10 meters
R11LL-P1 to R1SS-P28	15 meters
R11LL-P2 to R13SS-P28	5 meters
R11LL-P3 to R2SS-P28	15 meters
R11LL-P4 to R11SS-P28	3 meters
R11LL-P5 to R3SS-P28	10 meters
R11LL-P6 to R10SS-P28	5 meters
R11LL-P7 to R4SS-P28	10 meters
R11LL-P30 to R9SS-P26	5 meters
R11LL-P31 to R5SS-P28	10 meters
R11LL-P32 to R6SS-P28	10 meters
R11LL-P33 to R7SS-P28	10 meters
R11LL-P34 to R8SS-P28	10 meters
R11LL-P35 to R9SS-P28	5 meters
R11LL-P36 to R12SS-P28	5 meters

Table 4-100 Leaf Switch Connections for the Twelfth Rack in a 13 Rack System

Connection	Cable Length
R12UL-P1 to R1SS-P22	15 meters
R12UL-P2 to R11SS-P22	5 meters
R12UL-P3 to R2SS-P22	15 meters
R12UL-P4 to R10SS-P22	5 meters
R12UL-P5 to R3SS-P22	15 meters
R12UL-P6 to R10SS-P26	5 meters
R12UL-P7 to R4SS-P22	10 meters
R12UL-P30 to R5SS-P22	10 meters
R12UL-P31 to R6SS-P22	10 meters
R12UL-P32 to R7SS-P22	10 meters
R12UL-P33 to R8SS-P22	10 meters
R12UL-P34 to R12SS-P22	3 meters
R12UL-P35 to R9SS-P22	10 meters
R12UL-P36 to R13SS-P22	5 meters
R12LL-P1 to R1SS-P32	15 meters
R12LL-P2 to R11SS-P26	5 meters
R12LL-P3 to R2SS-P32	15 meters
R12LL-P4 to R11SS-P32	5 meters
R12LL-P5 to R3SS-P32	15 meters
R12LL-P6 to R10SS-P32	5 meters
R12LL-P7 to R4SS-P32	10 meters
R12LL-P30 to R13SS-P32	5 meters
R12LL-P31 to R5SS-P32	10 meters
R12LL-P32 to R6SS-P32	10 meters
R12LL-P33 to R7SS-P32	10 meters
R12LL-P34 to R8SS-P32	10 meters
R12LL-P35 to R9SS-P32	10 meters
R12LL-P36 to R12SS-P32	3 meters

Table 4-101 Leaf Switch Connections for the Thirteenth Rack in a 13 Rack System

Connection	Cable Length
R13UL-P1 to R1SS-P27	15 meters
R13UL-P2 to R11SS-P27	5 meters
R13UL-P3 to R2SS-P27	15 meters
R13UL-P4 to R10SS-P27	10 meters
R13UL-P5 to R3SS-P27	15 meters
R13UL-P6 to R12SS-P26	5 meters
R13UL-P7 to R4SS-P27	15 meters
R13UL-P30 to R5SS-P27	10 meters
R13UL-P31 to R6SS-P27	10 meters
R13UL-P32 to R7SS-P27	10 meters
R13UL-P33 to R8SS-P27	10 meters
R13UL-P34 to R12SS-P27	5 meters
R13UL-P35 to R9SS-P27	10 meters
R13UL-P36 to R13SS-P27	3 meters
R13LL-P1 to R1SS-P30	15 meters
R13LL-P2 to R13SS-P26	3 meters
R13LL-P3 to R2SS-P30	15 meters
R13LL-P4 to R11SS-P30	5 meters
R13LL-P5 to R3SS-P30	15 meters
R13LL-P6 to R10SS-P30	10 meters
R13LL-P7 to R4SS-P30	15 meters
R13LL-P30 to R13SS-P30	3 meters
R13LL-P31 to R5SS-P30	10 meters
R13LL-P32 to R6SS-P30	10 meters
R13LL-P33 to R7SS-P30	10 meters
R13LL-P34 to R8SS-P30	10 meters
R13LL-P35 to R9SS-P30	10 meters
R13LL-P36 to R12SS-P30	5 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-102 Thirteen-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R8LL-P5	10 meters
R1SS-P8	R5UL-P5	10 meters
R1SS-P9	R7UL-P5	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R6LL-P5	10 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R8UL-P5	10 meters
R1SS-P16	R6UL-P7	10 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R5LL-P7	10 meters
R1SS-P19	R7LL-P5	10 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R10UL-P1	15 meters
R1SS-P22	R12UL-P1	15 meters
R1SS-P23	R1UL-P3	3 meters
R1SS-P24	R9UL-P1	10 meters
R1SS-P25	R11UL-P1	15 meters
R1SS-P26	R7LL-P3	10 meters
R1SS-P27	R13UL-P1	15 meters
R1SS-P28	R11LL-P1	15 meters
R1SS-P29	R9LL-P1	10 meters
R1SS-P30	R13LL-P1	15 meters
R1SS-P31	R10LL-P1	15 meters
R1SS-P32	R12LL-P1	15 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R7UL-P7	10 meters
R2SS-P8	R5UL-P4	10 meters
R2SS-P9	R8LL-P7	10 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R6LL-P4	10 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R8UL-P7	10 meters
R2SS-P16	R6UL-P4	10 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R5LL-P6	10 meters
R2SS-P19	R7LL-P7	10 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R10UL-P3	10 meters
R2SS-P22	R12UL-P3	15 meters
R2SS-P23	R1LL-P1	5 meters
R2SS-P24	R9UL-P3	10 meters
R2SS-P25	R11UL-P3	15 meters
R2SS-P26	R8UL-P3	10 meters
R2SS-P27	R13UL-P3	15 meters
R2SS-P28	R11LL-P3	15 meters
R2SS-P29	R9LL-P3	10 meters
R2SS-P30	R13LL-P3	15 meters
R2SS-P31	R10LL-P3	10 meters
R2SS-P32	R12LL-P3	15 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R6LL-P31	10 meters
R3SS-P8	R5UL-P6	5 meters
R3SS-P9	R7UL-P4	10 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R8LL-P4	10 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R7LL-P4	10 meters
R3SS-P16	R5LL-P31	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R8UL-P4	10 meters
R3SS-P19	R6UL-P6	10 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R10UL-P5	10 meters
R3SS-P22	R12UL-P5	15 meters
R3SS-P23	R2UL-P2	5 meters
R3SS-P24	R9UL-P5	10 meters
R3SS-P25	R11UL-P5	10 meters
R3SS-P26	R8LL-P3	10 meters
R3SS-P27	R13UL-P5	15 meters
R3SS-P28	R11LL-P5	10 meters
R3SS-P29	R9LL-P5	10 meters
R3SS-P30	R13LL-P5	15 meters
R3SS-P31	R10LL-P5	10 meters
R3SS-P32	R12LL-P5	15 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R8LL-P6	10 meters
R4SS-P8	R7UL-P6	10 meters
R4SS-P9	R6LL-P33	5 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R5UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R6UL-P31	5 meters
R4SS-P16	R8UL-P6	10 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R7LL-P6	10 meters
R4SS-P19	R5LL-P33	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R10UL-P7	10 meters
R4SS-P22	R12UL-P7	10 meters
R4SS-P23	R2LL-P2	5 meters
R4SS-P24	R9UL-P7	10 meters
R4SS-P25	R11UL-P7	10 meters
R4SS-P26	R9UL-P2	10 meters
R4SS-P27	R13UL-P7	15 meters
R4SS-P28	R11LL-P7	10 meters
R4SS-P29	R9LL-P7	10 meters
R4SS-P30	R13LL-P7	15 meters
R4SS-P31	R10LL-P7	10 meters
R4SS-P32	R12LL-P7	10 meters
R5SS-P5	R1UL-P30	10 meters
R5SS-P6	R2UL-P7	10 meters
R5SS-P7	R5UL-P30	3 meters
R5SS-P8	R6LL-P30	5 meters
R5SS-P9	R7UL-P31	5 meters
R5SS-P10	R4UL-P5	5 meters
R5SS-P11	R3UL-P32	5 meters
R5SS-P12	R8LL-P31	10 meters
R5SS-P13	R1LL-P7	10 meters
R5SS-P14	R2LL-P33	10 meters
R5SS-P15	R5LL-P30	3 meters
R5SS-P16	R7LL-P31	5 meters
R5SS-P17	R4LL-P7	5 meters
R5SS-P18	R6UL-P33	5 meters
R5SS-P19	R8UL-P31	10 meters
R5SS-P20	R3LL-P5	5 meters
R5SS-P21	R10UL-P30	10 meters
R5SS-P22	R12UL-P30	10 meters
R5SS-P23	R3UL-P34	5 meters
R5SS-P24	R9UL-P30	10 meters
R5SS-P25	R11UL-P30	10 meters
R5SS-P26	R9LL-P36	10 meters
R5SS-P27	R13UL-P30	10 meters
R5SS-P28	R11LL-P31	10 meters
R5SS-P29	R9LL-P31	10 meters
R5SS-P30	R13LL-P31	10 meters
R5SS-P31	R10LL-P31	10 meters
R5SS-P32	R12LL-P31	10 meters
R6SS-P5	R1UL-P32	10 meters
R6SS-P6	R2UL-P33	10 meters
R6SS-P7	R5UL-P7	5 meters
R6SS-P8	R6LL-P32	3 meters
R6SS-P9	R7UL-P33	5 meters
R6SS-P10	R4UL-P30	5 meters
R6SS-P11	R3UL-P7	10 meters
R6SS-P12	R8LL-P33	5 meters
R6SS-P13	R1LL-P32	10 meters
R6SS-P14	R2LL-P7	10 meters
R6SS-P15	R5LL-P4	5 meters
R6SS-P16	R6UL-P30	3 meters
R6SS-P17	R4LL-P6	5 meters
R6SS-P18	R7LL-P33	5 meters
R6SS-P19	R8UL-P33	5 meters
R6SS-P20	R3LL-P30	10 meters
R6SS-P21	R10UL-P31	10 meters
R6SS-P22	R12UL-P31	10 meters
R6SS-P23	R3LL-P35	10 meters
R6SS-P24	R9UL-P31	10 meters
R6SS-P25	R11UL-P31	10 meters
R6SS-P26	R10UL-P36	10 meters
R6SS-P27	R13UL-P31	10 meters
R6SS-P28	R11LL-P32	10 meters
R6SS-P29	R9LL-P32	10 meters
R6SS-P30	R13LL-P32	10 meters
R6SS-P31	R10LL-P32	10 meters
R6SS-P32	R12LL-P32	10 meters
R7SS-P5	R1UL-P33	10 meters
R7SS-P6	R2UL-P32	10 meters
R7SS-P7	R5UL-P32	5 meters
R7SS-P8	R6LL-P6	5 meters
R7SS-P9	R7UL-P30	3 meters
R7SS-P10	R4UL-P31	10 meters
R7SS-P11	R3UL-P31	10 meters
R7SS-P12	R8LL-P30	5 meters
R7SS-P13	R1LL-P6	10 meters
R7SS-P14	R2LL-P32	10 meters
R7SS-P15	R5LL-P5	5 meters
R7SS-P16	R6UL-P5	5 meters
R7SS-P17	R4LL-P32	10 meters
R7SS-P18	R7LL-P30	3 meters
R7SS-P19	R8UL-P30	5 meters
R7SS-P20	R3LL-P7	10 meters
R7SS-P21	R10UL-P32	10 meters
R7SS-P22	R12UL-P32	10 meters
R7SS-P23	R4UL-P36	10 meters
R7SS-P24	R9UL-P32	5 meters
R7SS-P25	R11UL-P32	10 meters
R7SS-P26	R10LL-P30	10 meters
R7SS-P27	R13UL-P32	10 meters
R7SS-P28	R11LL-P33	10 meters
R7SS-P29	R9LL-P33	5 meters
R7SS-P30	R13LL-P33	10 meters
R7SS-P31	R10LL-P33	10 meters
R7SS-P32	R12LL-P33	10 meters
R8SS-P5	R1UL-P7	10 meters
R8SS-P6	R2UL-P30	10 meters
R8SS-P7	R5UL-P31	10 meters
R8SS-P8	R6LL-P7	5 meters
R8SS-P9	R7UL-P32	5 meters
R8SS-P10	R4UL-P4	10 meters
R8SS-P11	R3UL-P33	10 meters
R8SS-P12	R7LL-P32	5 meters
R8SS-P13	R1LL-P33	10 meters
R8SS-P14	R2LL-P30	10 meters
R8SS-P15	R5LL-P32	10 meters
R8SS-P16	R6UL-P32	5 meters
R8SS-P17	R4LL-P33	10 meters
R8SS-P18	R8LL-P32	3 meters
R8SS-P19	R8UL-P32	3 meters
R8SS-P20	R3LL-P6	10 meters
R8SS-P21	R10UL-P33	5 meters
R8SS-P22	R12UL-P33	10 meters
R8SS-P23	R4LL-P36	10 meters
R8SS-P24	R9UL-P33	5 meters
R8SS-P25	R11UL-P33	10 meters
R8SS-P26	R11UL-P36	10 meters
R8SS-P27	R13UL-P33	10 meters
R8SS-P28	R11LL-P34	10 meters
R8SS-P29	R9LL-P34	5 meters
R8SS-P30	R13LL-P34	10 meters
R8SS-P31	R10LL-P34	5 meters
R8SS-P32	R12LL-P34	10 meters
R9SS-P5	R1UL-P36	10 meters
R9SS-P6	R2UL-P36	10 meters
R9SS-P7	R5UL-P35	10 meters
R9SS-P8	R6LL-P1	10 meters
R9SS-P9	R7UL-P2	5 meters
R9SS-P10	R4UL-P34	10 meters
R9SS-P11	R3UL-P2	10 meters
R9SS-P12	R7LL-P1	5 meters
R9SS-P13	R1LL-P36	10 meters
R9SS-P14	R2LL-P3	10 meters
R9SS-P15	R5LL-P1	10 meters
R9SS-P16	R6UL-P3	10 meters
R9SS-P17	R4LL-P1	10 meters
R9SS-P18	R8LL-P2	5 meters
R9SS-P19	R8UL-P1	5 meters
R9SS-P20	R3LL-P3	10 meters
R9SS-P21	R10UL-P35	5 meters
R9SS-P22	R12UL-P35	10 meters
R9SS-P23	R5UL-P36	10 meters
R9SS-P24	R9UL-P35	3 meters
R9SS-P25	R11UL-P35	5 meters
R9SS-P26	R11LL-P30	5 meters
R9SS-P27	R13UL-P35	10 meters
R9SS-P28	R11LL-P35	5 meters
R9SS-P29	R9LL-P35	3 meters
R9SS-P30	R13LL-P35	10 meters
R9SS-P31	R10LL-P35	5 meters
R9SS-P32	R12LL-P35	10 meters
R10SS-P5	R1UL-P35	15 meters
R10SS-P6	R2UL-P34	10 meters
R10SS-P7	R5UL-P1	10 meters
R10SS-P8	R6LL-P2	10 meters
R10SS-P9	R7UL-P36	10 meters
R10SS-P10	R4UL-P3	10 meters
R10SS-P11	R3UL-P3	10 meters
R10SS-P12	R7LL-P2	10 meters
R10SS-P13	R1LL-P35	15 meters
R10SS-P14	R2LL-P36	10 meters
R10SS-P15	R5LL-P35	10 meters
R10SS-P16	R6UL-P35	10 meters
R10SS-P17	R4LL-P2	10 meters
R10SS-P18	R8LL-P36	5 meters
R10SS-P19	R8UL-P2	5 meters
R10SS-P20	R3LL-P2	10 meters
R10SS-P21	R10UL-P4	3 meters
R10SS-P22	R12UL-P4	5 meters
R10SS-P23	R5LL-P36	10 meters
R10SS-P24	R9UL-P4	5 meters
R10SS-P25	R11UL-P4	5 meters
R10SS-P26	R12UL-P6	5 meters
R10SS-P27	R13UL-P4	10 meters
R10SS-P28	R11LL-P6	5 meters
R10SS-P29	R9LL-P6	5 meters
R10SS-P30	R13LL-P6	10 meters
R10SS-P31	R10LL-P6	3 meters
R10SS-P32	R12LL-P6	5 meters
R11SS-P5	R1UL-P2	15 meters
R11SS-P6	R2UL-P35	15 meters
R11SS-P7	R5UL-P3	10 meters
R11SS-P8	R6LL-P35	10 meters
R11SS-P9	R7UL-P35	10 meters
R11SS-P10	R4UL-P2	10 meters
R11SS-P11	R3UL-P36	10 meters
R11SS-P12	R7LL-P35	10 meters
R11SS-P13	R1LL-P3	15 meters
R11SS-P14	R2LL-P34	15 meters
R11SS-P15	R5LL-P3	10 meters
R11SS-P16	R6UL-P2	10 meters
R11SS-P17	R4LL-P3	10 meters
R11SS-P18	R8LL-P35	10 meters
R11SS-P19	R8UL-P35	10 meters
R11SS-P20	R3LL-P34	10 meters
R11SS-P21	R10UL-P2	5 meters
R11SS-P22	R12UL-P2	5 meters
R11SS-P23	R6UL-P1	10 meters
R11SS-P24	R9UL-P6	5 meters
R11SS-P25	R11UL-P2	3 meters
R11SS-P26	R12LL-P2	5 meters
R11SS-P27	R13UL-P2	5 meters
R11SS-P28	R11LL-P4	3 meters
R11SS-P29	R9LL-P2	5 meters
R11SS-P30	R13LL-P4	5 meters
R11SS-P31	R10LL-P4	5 meters
R11SS-P32	R12LL-P4	5 meters
R12SS-P5	R1UL-P1	15 meters
R12SS-P6	R2UL-P1	15 meters
R12SS-P7	R5UL-P2	10 meters
R12SS-P8	R6LL-P36	10 meters
R12SS-P9	R7UL-P34	10 meters
R12SS-P10	R4UL-P35	10 meters
R12SS-P11	R3UL-P35	15 meters
R12SS-P12	R7LL-P34	10 meters
R12SS-P13	R1LL-P34	15 meters
R12SS-P14	R2LL-P1	15 meters
R12SS-P15	R5LL-P2	10 meters
R12SS-P16	R6UL-P34	10 meters
R12SS-P17	R4LL-P34	10 meters
R12SS-P18	R8LL-P34	10 meters
R12SS-P19	R8UL-P34	10 meters
R12SS-P20	R3LL-P36	15 meters
R12SS-P21	R10UL-P34	5 meters
R12SS-P22	R12UL-P34	3 meters
R12SS-P23	R6LL-P34	10 meters
R12SS-P24	R9UL-P36	10 meters
R12SS-P25	R11UL-P34	5 meters
R12SS-P26	R13UL-P6	5 meters
R12SS-P27	R13UL-P34	5 meters
R12SS-P28	R11LL-P36	5 meters
R12SS-P29	R9LL-P30	10 meters
R12SS-P30	R13LL-P36	5 meters
R12SS-P31	R10LL-P2	5 meters
R12SS-P32	R12LL-P36	3 meters
R13SS-P5	R1UL-P34	15 meters
R13SS-P6	R2UL-P3	15 meters
R13SS-P7	R5UL-P34	10 meters
R13SS-P8	R6LL-P3	10 meters
R13SS-P9	R7UL-P3	10 meters
R13SS-P10	R4UL-P1	15 meters
R13SS-P11	R3UL-P1	15 meters
R13SS-P12	R7LL-P36	10 meters
R13SS-P13	R1LL-P2	15 meters
R13SS-P14	R2LL-P35	15 meters
R13SS-P15	R5LL-P34	10 meters
R13SS-P16	R6UL-P36	10 meters
R13SS-P17	R4LL-P35	15 meters
R13SS-P18	R8LL-P1	10 meters
R13SS-P19	R8UL-P36	10 meters
R13SS-P20	R3LL-P1	15 meters
R13SS-P21	R10UL-P6	10 meters
R13SS-P22	R12UL-P36	5 meters
R13SS-P23	R7UL-P1	10 meters
R13SS-P24	R9UL-P34	10 meters
R13SS-P25	R11UL-P6	5 meters
R13SS-P26	R13LL-P2	3 meters
R13SS-P27	R13UL-P36	3 meters
R13SS-P28	R11LL-P2	5 meters
R13SS-P29	R9LL-P4	10 meters
R13SS-P30	R13LL-P30	3 meters
R13SS-P31	R10LL-P36	10 meters
R13SS-P32	R12LL-P30	5 meters

4.15 Fourteen-Rack Cabling for X9M and Later Model Racks

This section provides the cabling details for X9M and later models to connect fourteen racks using RoCE Network Fabric.

Note:

• The following conventions are used in the cabling notation for connecting multiple racks together:

  • The abbreviation for the first rack is R1, the second rack is R2, and so on.

  • LL identifies a lower leaf switch and UL identifies an upper leaf switch.

  • SS identifies the spine switch, which is located in U1 on all racks.

  • A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).

• The leaf switches are located as follows:

  • At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Oracle Exadata Rack X9M-2 and later models).

  • At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Oracle Exadata X9M-8).

• The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.

• Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.

• For X9M-8 systems with three database servers and 11 storage servers only, the database servers and storage server require 23 leaf switch ports, which leaves only 13 inter-switch links on each leaf switch. Consequently, these systems cannot support 14 interconnected racks.

The following tables contain details for all of the RoCE Network Fabric cabling connections in a 14 rack system.

Table 4-103 Leaf Switch Connections for the First Rack in a 14 Rack System

Connection	Cable Length
R1UL-P1 to R12SS-P5	15 meters
R1UL-P2 to R11SS-P5	15 meters
R1UL-P3 to R14SS-P5	15 meters
R1UL-P4 to R4SS-P5	10 meters
R1UL-P5 to R1SS-P5	3 meters
R1UL-P6 to R3SS-P5	5 meters
R1UL-P7 to R8SS-P5	10 meters
R1UL-P30 to R5SS-P5	10 meters
R1UL-P31 to R2SS-P5	5 meters
R1UL-P32 to R6SS-P5	10 meters
R1UL-P33 to R7SS-P5	10 meters
R1UL-P34 to R13SS-P5	15 meters
R1UL-P35 to R10SS-P5	15 meters
R1UL-P36 to R9SS-P5	10 meters
R1LL-P1 to R14SS-P13	15 meters
R1LL-P2 to R13SS-P13	15 meters
R1LL-P3 to R11SS-P13	15 meters
R1LL-P4 to R3SS-P13	5 meters
R1LL-P5 to R1SS-P13	3 meters
R1LL-P6 to R7SS-P13	10 meters
R1LL-P7 to R5SS-P13	10 meters
R1LL-P30 to R4SS-P13	10 meters
R1LL-P31 to R2SS-P13	5 meters
R1LL-P32 to R6SS-P13	10 meters
R1LL-P33 to R8SS-P13	10 meters
R1LL-P34 to R12SS-P13	15 meters
R1LL-P35 to R10SS-P13	15 meters
R1LL-P36 to R9SS-P13	10 meters

Table 4-104 Leaf Switch Connections for the Second Rack in a 14 Rack System

Connection	Cable Length
R2UL-P1 to R12SS-P6	15 meters
R2UL-P2 to R14SS-P6	15 meters
R2UL-P3 to R13SS-P6	15 meters
R2UL-P4 to R4SS-P6	5 meters
R2UL-P5 to R1SS-P6	5 meters
R2UL-P6 to R3SS-P6	5 meters
R2UL-P7 to R5SS-P6	10 meters
R2UL-P30 to R8SS-P6	10 meters
R2UL-P31 to R2SS-P6	3 meters
R2UL-P32 to R7SS-P6	10 meters
R2UL-P33 to R6SS-P6	10 meters
R2UL-P34 to R10SS-P6	10 meters
R2UL-P35 to R11SS-P6	15 meters
R2UL-P36 to R9SS-P6	10 meters
R2LL-P1 to R12SS-P14	15 meters
R2LL-P2 to R14SS-P14	15 meters
R2LL-P3 to R9SS-P14	10 meters
R2LL-P4 to R4SS-P14	5 meters
R2LL-P5 to R1SS-P14	5 meters
R2LL-P6 to R3SS-P14	5 meters
R2LL-P7 to R6SS-P14	10 meters
R2LL-P30 to R8SS-P14	10 meters
R2LL-P31 to R2SS-P14	3 meters
R2LL-P32 to R7SS-P14	10 meters
R2LL-P33 to R5SS-P14	10 meters
R2LL-P34 to R11SS-P14	15 meters
R2LL-P35 to R13SS-P14	15 meters
R2LL-P36 to R10SS-P14	10 meters

Table 4-105 Leaf Switch Connections for the Third Rack in a 14 Rack System

Connection	Cable Length
R3UL-P1 to R13SS-P11	15 meters
R3UL-P2 to R9SS-P11	10 meters
R3UL-P3 to R10SS-P11	10 meters
R3UL-P4 to R4SS-P11	5 meters
R3UL-P5 to R1SS-P11	5 meters
R3UL-P6 to R2SS-P11	5 meters
R3UL-P7 to R6SS-P11	10 meters
R3UL-P30 to R3SS-P11	3 meters
R3UL-P31 to R7SS-P11	10 meters
R3UL-P32 to R5SS-P11	5 meters
R3UL-P33 to R8SS-P11	10 meters
R3UL-P34 to R14SS-P11	15 meters
R3UL-P35 to R12SS-P11	15 meters
R3UL-P36 to R11SS-P11	10 meters
R3LL-P1 to R13SS-P20	15 meters
R3LL-P2 to R10SS-P20	10 meters
R3LL-P3 to R9SS-P20	10 meters
R3LL-P4 to R1SS-P20	5 meters
R3LL-P5 to R5SS-P20	5 meters
R3LL-P6 to R8SS-P20	10 meters
R3LL-P7 to R7SS-P20	10 meters
R3LL-P30 to R6SS-P20	10 meters
R3LL-P31 to R2SS-P20	5 meters
R3LL-P32 to R3SS-P20	3 meters
R3LL-P33 to R4SS-P20	5 meters
R3LL-P34 to R11SS-P20	10 meters
R3LL-P35 to R14SS-P20	15 meters
R3LL-P36 to R12SS-P20	15 meters

Table 4-106 Leaf Switch Connections for the Fourth Rack in a 14 Rack System

Connection	Cable Length
R4UL-P1 to R13SS-P10	15 meters
R4UL-P2 to R11SS-P10	10 meters
R4UL-P3 to R10SS-P10	10 meters
R4UL-P4 to R8SS-P10	10 meters
R4UL-P5 to R5SS-P10	5 meters
R4UL-P6 to R2SS-P10	5 meters
R4UL-P7 to R1SS-P10	10 meters
R4UL-P30 to R6SS-P10	5 meters
R4UL-P31 to R7SS-P10	10 meters
R4UL-P32 to R4SS-P10	3 meters
R4UL-P33 to R3SS-P10	5 meters
R4UL-P34 to R9SS-P10	10 meters
R4UL-P35 to R12SS-P10	10 meters
R4UL-P36 to R14SS-P10	15 meters
R4LL-P1 to R9SS-P17	10 meters
R4LL-P2 to R10SS-P17	10 meters
R4LL-P3 to R11SS-P17	10 meters
R4LL-P4 to R2SS-P17	5 meters
R4LL-P5 to R1SS-P17	10 meters
R4LL-P6 to R6SS-P17	5 meters
R4LL-P7 to R5SS-P17	5 meters
R4LL-P30 to R4SS-P17	3 meters
R4LL-P31 to R3SS-P17	5 meters
R4LL-P32 to R7SS-P17	10 meters
R4LL-P33 to R8SS-P17	10 meters
R4LL-P34 to R12SS-P17	10 meters
R4LL-P35 to R13SS-P17	15 meters
R4LL-P36 to R14SS-P17	15 meters

Table 4-107 Leaf Switch Connections for the Fifth Rack in a 14 Rack System

Connection	Cable Length
R5UL-P1 to R10SS-P7	10 meters
R5UL-P2 to R12SS-P7	10 meters
R5UL-P3 to R11SS-P7	10 meters
R5UL-P4 to R2SS-P8	10 meters
R5UL-P5 to R1SS-P8	10 meters
R5UL-P6 to R3SS-P8	5 meters
R5UL-P7 to R6SS-P7	5 meters
R5UL-P30 to R5SS-P7	3 meters
R5UL-P31 to R8SS-P7	10 meters
R5UL-P32 to R7SS-P7	5 meters
R5UL-P33 to R4SS-P12	5 meters
R5UL-P34 to R13SS-P7	10 meters
R5UL-P35 to R9SS-P7	10 meters
R5UL-P36 to R14SS-P7	15 meters
R5LL-P1 to R9SS-P15	10 meters
R5LL-P2 to R12SS-P15	10 meters
R5LL-P3 to R11SS-P15	10 meters
R5LL-P4 to R6SS-P15	5 meters
R5LL-P5 to R7SS-P15	5 meters
R5LL-P6 to R2SS-P18	10 meters
R5LL-P7 to R1SS-P18	10 meters
R5LL-P30 to R5SS-P15	3 meters
R5LL-P31 to R3SS-P16	5 meters
R5LL-P32 to R8SS-P15	10 meters
R5LL-P33 to R4SS-P19	5 meters
R5LL-P34 to R13SS-P15	10 meters
R5LL-P35 to R10SS-P15	10 meters
R5LL-P36 to R14SS-P15	15 meters

Table 4-108 Leaf Switch Connections for the Sixth Rack in a 14 Rack System

Connection	Cable Length
R6UL-P1 to R14SS-P16	10 meters
R6UL-P2 to R11SS-P16	10 meters
R6UL-P3 to R9SS-P16	10 meters
R6UL-P4 to R2SS-P16	10 meters
R6UL-P5 to R7SS-P16	5 meters
R6UL-P6 to R3SS-P19	10 meters
R6UL-P7 to R1SS-P16	10 meters
R6UL-P30 to R6SS-P16	3 meters
R6UL-P31 to R4SS-P15	5 meters
R6UL-P32 to R8SS-P16	5 meters
R6UL-P33 to R5SS-P18	5 meters
R6UL-P34 to R12SS-P16	10 meters
R6UL-P35 to R10SS-P16	10 meters
R6UL-P36 to R13SS-P16	10 meters
R6LL-P1 to R9SS-P8	10 meters
R6LL-P2 to R10SS-P8	10 meters
R6LL-P3 to R13SS-P8	10 meters
R6LL-P4 to R2SS-P12	10 meters
R6LL-P5 to R1SS-P12	10 meters
R6LL-P6 to R7SS-P8	5 meters
R6LL-P7 to R8SS-P8	5 meters
R6LL-P30 to R5SS-P8	5 meters
R6LL-P31 to R3SS-P7	10 meters
R6LL-P32 to R6SS-P8	3 meters
R6LL-P33 to R4SS-P9	5 meters
R6LL-P34 to R14SS-P8	10 meters
R6LL-P35 to R11SS-P8	10 meters
R6LL-P36 to R12SS-P8	10 meters

Table 4-109 Leaf Switch Connections for the Seventh Rack in a 14 Rack System

Connection	Cable Length
R7UL-P1 to R14SS-P9	10 meters
R7UL-P2 to R9SS-P9	5 meters
R7UL-P3 to R13SS-P9	10 meters
R7UL-P4 to R3SS-P9	10 meters
R7UL-P5 to R1SS-P9	10 meters
R7UL-P6 to R4SS-P8	10 meters
R7UL-P7 to R2SS-P7	10 meters
R7UL-P30 to R7SS-P9	3 meters
R7UL-P31 to R5SS-P9	5 meters
R7UL-P32 to R8SS-P9	5 meters
R7UL-P33 to R6SS-P9	5 meters
R7UL-P34 to R12SS-P9	10 meters
R7UL-P35 to R11SS-P9	10 meters
R7UL-P36 to R10SS-P9	10 meters
R7LL-P1 to R9SS-P12	5 meters
R7LL-P2 to R10SS-P12	10 meters
R7LL-P3 to R14SS-P12	10 meters
R7LL-P4 to R3SS-P15	10 meters
R7LL-P5 to R1SS-P19	10 meters
R7LL-P6 to R4SS-P18	10 meters
R7LL-P7 to R2SS-P19	10 meters
R7LL-P30 to R7SS-P18	3 meters
R7LL-P31 to R5SS-P16	5 meters
R7LL-P32 to R8SS-P12	5 meters
R7LL-P33 to R6SS-P18	5 meters
R7LL-P34 to R12SS-P12	10 meters
R7LL-P35 to R11SS-P12	10 meters
R7LL-P36 to R13SS-P12	10 meters

Table 4-110 Leaf Switch Connections for the Eighth Rack in a 14 Rack System

Connection	Cable Length
R8UL-P1 to R9SS-P19	5 meters
R8UL-P2 to R10SS-P19	5 meters
R8UL-P3 to R14SS-P19	10 meters
R8UL-P4 to R3SS-P18	10 meters
R8UL-P5 to R1SS-P15	10 meters
R8UL-P6 to R4SS-P16	10 meters
R8UL-P7 to R2SS-P15	10 meters
R8UL-P30 to R7SS-P19	5 meters
R8UL-P31 to R5SS-P19	10 meters
R8UL-P32 to R8SS-P19	3 meters
R8UL-P33 to R6SS-P19	5 meters
R8UL-P34 to R12SS-P19	10 meters
R8UL-P35 to R11SS-P19	10 meters
R8UL-P36 to R13SS-P19	10 meters
R8LL-P1 to R13SS-P18	10 meters
R8LL-P2 to R9SS-P18	5 meters
R8LL-P3 to R14SS-P18	10 meters
R8LL-P4 to R3SS-P12	10 meters
R8LL-P5 to R1SS-P7	10 meters
R8LL-P6 to R4SS-P7	10 meters
R8LL-P7 to R2SS-P9	10 meters
R8LL-P30 to R7SS-P12	5 meters
R8LL-P31 to R5SS-P12	10 meters
R8LL-P32 to R8SS-P18	3 meters
R8LL-P33 to R6SS-P12	5 meters
R8LL-P34 to R12SS-P18	10 meters
R8LL-P35 to R11SS-P18	10 meters
R8LL-P36 to R10SS-P18	5 meters

Table 4-111 Leaf Switch Connections for the Ninth Rack in a 14 Rack System

Connection	Cable Length
R9UL-P1 to R1SS-P21	10 meters
R9UL-P2 to R14SS-P21	10 meters
R9UL-P3 to R2SS-P21	10 meters
R9UL-P4 to R10SS-P21	5 meters
R9UL-P5 to R3SS-P21	10 meters
R9UL-P6 to R11SS-P21	5 meters
R9UL-P7 to R4SS-P21	10 meters
R9UL-P30 to R5SS-P21	10 meters
R9UL-P31 to R6SS-P21	10 meters
R9UL-P32 to R7SS-P21	5 meters
R9UL-P33 to R8SS-P21	5 meters
R9UL-P34 to R13SS-P21	10 meters
R9UL-P35 to R9SS-P21	3 meters
R9UL-P36 to R12SS-P21	10 meters
R9LL-P1 to R1SS-P22	10 meters
R9LL-P2 to R11SS-P22	5 meters
R9LL-P3 to R2SS-P22	10 meters
R9LL-P4 to R13SS-P22	10 meters
R9LL-P5 to R3SS-P22	10 meters
R9LL-P6 to R10SS-P22	5 meters
R9LL-P7 to R4SS-P22	10 meters
R9LL-P30 to R12SS-P22	10 meters
R9LL-P31 to R5SS-P22	10 meters
R9LL-P32 to R6SS-P22	10 meters
R9LL-P33 to R7SS-P22	5 meters
R9LL-P34 to R8SS-P22	5 meters
R9LL-P35 to R9SS-P22	3 meters
R9LL-P36 to R14SS-P22	10 meters

Table 4-112 Leaf Switch Connections for the Tenth Rack in a 14 Rack System

Connection	Cable Length
R10UL-P1 to R1SS-P23	15 meters
R10UL-P2 to R11SS-P23	5 meters
R10UL-P3 to R2SS-P23	10 meters
R10UL-P4 to R10SS-P23	3 meters
R10UL-P5 to R3SS-P23	10 meters
R10UL-P6 to R13SS-P23	10 meters
R10UL-P7 to R4SS-P23	10 meters
R10UL-P30 to R5SS-P23	10 meters
R10UL-P31 to R6SS-P23	10 meters
R10UL-P32 to R7SS-P23	10 meters
R10UL-P33 to R8SS-P23	5 meters
R10UL-P34 to R12SS-P23	5 meters
R10UL-P35 to R9SS-P23	5 meters
R10UL-P36 to R14SS-P23	10 meters
R10LL-P1 to R1SS-P24	15 meters
R10LL-P2 to R12SS-P24	5 meters
R10LL-P3 to R2SS-P24	10 meters
R10LL-P4 to R11SS-P24	5 meters
R10LL-P5 to R3SS-P24	10 meters
R10LL-P6 to R10SS-P24	3 meters
R10LL-P7 to R4SS-P24	10 meters
R10LL-P30 to R14SS-P24	10 meters
R10LL-P31 to R5SS-P24	10 meters
R10LL-P32 to R6SS-P24	10 meters
R10LL-P33 to R7SS-P24	10 meters
R10LL-P34 to R8SS-P24	5 meters
R10LL-P35 to R9SS-P24	5 meters
R10LL-P36 to R13SS-P24	10 meters

Table 4-113 Leaf Switch Connections for the Eleventh Rack in a 14 Rack System

Connection	Cable Length
R11UL-P1 to R1SS-P25	15 meters
R11UL-P2 to R11SS-P25	3 meters
R11UL-P3 to R2SS-P25	15 meters
R11UL-P4 to R10SS-P25	5 meters
R11UL-P5 to R3SS-P25	10 meters
R11UL-P6 to R13SS-P25	5 meters
R11UL-P7 to R4SS-P25	10 meters
R11UL-P30 to R5SS-P25	10 meters
R11UL-P31 to R6SS-P25	10 meters
R11UL-P32 to R7SS-P25	10 meters
R11UL-P33 to R8SS-P25	10 meters
R11UL-P34 to R12SS-P25	5 meters
R11UL-P35 to R9SS-P25	5 meters
R11UL-P36 to R14SS-P25	10 meters
R11LL-P1 to R1SS-P26	15 meters
R11LL-P2 to R13SS-P26	5 meters
R11LL-P3 to R2SS-P26	15 meters
R11LL-P4 to R11SS-P26	3 meters
R11LL-P5 to R3SS-P26	10 meters
R11LL-P6 to R10SS-P26	5 meters
R11LL-P7 to R4SS-P26	10 meters
R11LL-P30 to R14SS-P26	10 meters
R11LL-P31 to R5SS-P26	10 meters
R11LL-P32 to R6SS-P26	10 meters
R11LL-P33 to R7SS-P26	10 meters
R11LL-P34 to R8SS-P26	10 meters
R11LL-P35 to R9SS-P26	5 meters
R11LL-P36 to R12SS-P26	5 meters

Table 4-114 Leaf Switch Connections for the Twelfth Rack in a 14 Rack System

Connection	Cable Length
R12UL-P1 to R1SS-P27	15 meters
R12UL-P2 to R11SS-P27	5 meters
R12UL-P3 to R2SS-P27	15 meters
R12UL-P4 to R10SS-P27	5 meters
R12UL-P5 to R3SS-P27	15 meters
R12UL-P6 to R14SS-P27	5 meters
R12UL-P7 to R4SS-P27	10 meters
R12UL-P30 to R5SS-P27	10 meters
R12UL-P31 to R6SS-P27	10 meters
R12UL-P32 to R7SS-P27	10 meters
R12UL-P33 to R8SS-P27	10 meters
R12UL-P34 to R12SS-P27	3 meters
R12UL-P35 to R9SS-P27	10 meters
R12UL-P36 to R13SS-P27	5 meters
R12LL-P1 to R1SS-P28	15 meters
R12LL-P2 to R14SS-P28	5 meters
R12LL-P3 to R2SS-P28	15 meters
R12LL-P4 to R11SS-P28	5 meters
R12LL-P5 to R3SS-P28	15 meters
R12LL-P6 to R10SS-P28	5 meters
R12LL-P7 to R4SS-P28	10 meters
R12LL-P30 to R13SS-P28	5 meters
R12LL-P31 to R5SS-P28	10 meters
R12LL-P32 to R6SS-P28	10 meters
R12LL-P33 to R7SS-P28	10 meters
R12LL-P34 to R8SS-P28	10 meters
R12LL-P35 to R9SS-P28	10 meters
R12LL-P36 to R12SS-P28	3 meters

Table 4-115 Leaf Switch Connections for the Thirteenth Rack in a 14 Rack System

Connection	Cable Length
R13UL-P1 to R1SS-P29	15 meters
R13UL-P2 to R11SS-P29	5 meters
R13UL-P3 to R2SS-P29	15 meters
R13UL-P4 to R10SS-P29	10 meters
R13UL-P5 to R3SS-P29	15 meters
R13UL-P6 to R14SS-P29	5 meters
R13UL-P7 to R4SS-P29	15 meters
R13UL-P30 to R5SS-P29	10 meters
R13UL-P31 to R6SS-P29	10 meters
R13UL-P32 to R7SS-P29	10 meters
R13UL-P33 to R8SS-P29	10 meters
R13UL-P34 to R12SS-P29	5 meters
R13UL-P35 to R9SS-P29	10 meters
R13UL-P36 to R13SS-P29	3 meters
R13LL-P1 to R1SS-P30	15 meters
R13LL-P2 to R14SS-P30	5 meters
R13LL-P3 to R2SS-P30	15 meters
R13LL-P4 to R11SS-P30	5 meters
R13LL-P5 to R3SS-P30	15 meters
R13LL-P6 to R10SS-P30	10 meters
R13LL-P7 to R4SS-P30	15 meters
R13LL-P30 to R13SS-P30	3 meters
R13LL-P31 to R5SS-P30	10 meters
R13LL-P32 to R6SS-P30	10 meters
R13LL-P33 to R7SS-P30	10 meters
R13LL-P34 to R8SS-P30	10 meters
R13LL-P35 to R9SS-P30	10 meters
R13LL-P36 to R12SS-P30	5 meters

Table 4-116 Leaf Switch Connections for the Fourteenth Rack in a 14 Rack System

Connection	Cable Length
R14UL-P1 to R1SS-P31	15 meters
R14UL-P2 to R11SS-P31	10 meters
R14UL-P3 to R2SS-P31	15 meters
R14UL-P4 to R10SS-P31	10 meters
R14UL-P5 to R3SS-P31	15 meters
R14UL-P6 to R14SS-P31	3 meters
R14UL-P7 to R4SS-P31	15 meters
R14UL-P30 to R5SS-P31	15 meters
R14UL-P31 to R6SS-P31	10 meters
R14UL-P32 to R7SS-P31	10 meters
R14UL-P33 to R8SS-P31	10 meters
R14UL-P34 to R12SS-P31	5 meters
R14UL-P35 to R9SS-P31	10 meters
R14UL-P36 to R13SS-P31	5 meters
R14LL-P1 to R1SS-P32	15 meters
R14LL-P2 to R14SS-P32	3 meters
R14LL-P3 to R2SS-P32	15 meters
R14LL-P4 to R11SS-P32	10 meters
R14LL-P5 to R3SS-P32	15 meters
R14LL-P6 to R10SS-P32	10 meters
R14LL-P7 to R4SS-P32	15 meters
R14LL-P30 to R13SS-P32	5 meters
R14LL-P31 to R5SS-P32	15 meters
R14LL-P32 to R6SS-P32	10 meters
R14LL-P33 to R7SS-P32	10 meters
R14LL-P34 to R8SS-P32	10 meters
R14LL-P35 to R9SS-P32	10 meters
R14LL-P36 to R12SS-P32	5 meters

The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.

Table 4-117 Fourteen-Rack System Connections Sorted By The Spine Switch Port Location

Spine Switch Port	Leaf Switch Port	Cable Length
R1SS-P5	R1UL-P5	3 meters
R1SS-P6	R2UL-P5	5 meters
R1SS-P7	R8LL-P5	10 meters
R1SS-P8	R5UL-P5	10 meters
R1SS-P9	R7UL-P5	10 meters
R1SS-P10	R4UL-P7	10 meters
R1SS-P11	R3UL-P5	5 meters
R1SS-P12	R6LL-P5	10 meters
R1SS-P13	R1LL-P5	3 meters
R1SS-P14	R2LL-P5	5 meters
R1SS-P15	R8UL-P5	10 meters
R1SS-P16	R6UL-P7	10 meters
R1SS-P17	R4LL-P5	10 meters
R1SS-P18	R5LL-P7	10 meters
R1SS-P19	R7LL-P5	10 meters
R1SS-P20	R3LL-P4	5 meters
R1SS-P21	R9UL-P1	10 meters
R1SS-P22	R9LL-P1	10 meters
R1SS-P23	R10UL-P1	15 meters
R1SS-P24	R10LL-P1	15 meters
R1SS-P25	R11UL-P1	15 meters
R1SS-P26	R11LL-P1	15 meters
R1SS-P27	R12UL-P1	15 meters
R1SS-P28	R12LL-P1	15 meters
R1SS-P29	R13UL-P1	15 meters
R1SS-P30	R13LL-P1	15 meters
R1SS-P31	R14UL-P1	15 meters
R1SS-P32	R14LL-P1	15 meters
R2SS-P5	R1UL-P31	5 meters
R2SS-P6	R2UL-P31	3 meters
R2SS-P7	R7UL-P7	10 meters
R2SS-P8	R5UL-P4	10 meters
R2SS-P9	R8LL-P7	10 meters
R2SS-P10	R4UL-P6	5 meters
R2SS-P11	R3UL-P6	5 meters
R2SS-P12	R6LL-P4	10 meters
R2SS-P13	R1LL-P31	5 meters
R2SS-P14	R2LL-P31	3 meters
R2SS-P15	R8UL-P7	10 meters
R2SS-P16	R6UL-P4	10 meters
R2SS-P17	R4LL-P4	5 meters
R2SS-P18	R5LL-P6	10 meters
R2SS-P19	R7LL-P7	10 meters
R2SS-P20	R3LL-P31	5 meters
R2SS-P21	R9UL-P3	10 meters
R2SS-P22	R9LL-P3	10 meters
R2SS-P23	R10UL-P3	10 meters
R2SS-P24	R10LL-P3	10 meters
R2SS-P25	R11UL-P3	15 meters
R2SS-P26	R11LL-P3	15 meters
R2SS-P27	R12UL-P3	15 meters
R2SS-P28	R12LL-P3	15 meters
R2SS-P29	R13UL-P3	15 meters
R2SS-P30	R13LL-P3	15 meters
R2SS-P31	R14UL-P3	15 meters
R2SS-P32	R14LL-P3	15 meters
R3SS-P5	R1UL-P6	5 meters
R3SS-P6	R2UL-P6	5 meters
R3SS-P7	R6LL-P31	10 meters
R3SS-P8	R5UL-P6	5 meters
R3SS-P9	R7UL-P4	10 meters
R3SS-P10	R4UL-P33	5 meters
R3SS-P11	R3UL-P30	3 meters
R3SS-P12	R8LL-P4	10 meters
R3SS-P13	R1LL-P4	5 meters
R3SS-P14	R2LL-P6	5 meters
R3SS-P15	R7LL-P4	10 meters
R3SS-P16	R5LL-P31	5 meters
R3SS-P17	R4LL-P31	5 meters
R3SS-P18	R8UL-P4	10 meters
R3SS-P19	R6UL-P6	10 meters
R3SS-P20	R3LL-P32	3 meters
R3SS-P21	R9UL-P5	10 meters
R3SS-P22	R9LL-P5	10 meters
R3SS-P23	R10UL-P5	10 meters
R3SS-P24	R10LL-P5	10 meters
R3SS-P25	R11UL-P5	10 meters
R3SS-P26	R11LL-P5	10 meters
R3SS-P27	R12UL-P5	15 meters
R3SS-P28	R12LL-P5	15 meters
R3SS-P29	R13UL-P5	15 meters
R3SS-P30	R13LL-P5	15 meters
R3SS-P31	R14UL-P5	15 meters
R3SS-P32	R14LL-P5	15 meters
R4SS-P5	R1UL-P4	10 meters
R4SS-P6	R2UL-P4	5 meters
R4SS-P7	R8LL-P6	10 meters
R4SS-P8	R7UL-P6	10 meters
R4SS-P9	R6LL-P33	5 meters
R4SS-P10	R4UL-P32	3 meters
R4SS-P11	R3UL-P4	5 meters
R4SS-P12	R5UL-P33	5 meters
R4SS-P13	R1LL-P30	10 meters
R4SS-P14	R2LL-P4	5 meters
R4SS-P15	R6UL-P31	5 meters
R4SS-P16	R8UL-P6	10 meters
R4SS-P17	R4LL-P30	3 meters
R4SS-P18	R7LL-P6	10 meters
R4SS-P19	R5LL-P33	5 meters
R4SS-P20	R3LL-P33	5 meters
R4SS-P21	R9UL-P7	10 meters
R4SS-P22	R9LL-P7	10 meters
R4SS-P23	R10UL-P7	10 meters
R4SS-P24	R10LL-P7	10 meters
R4SS-P25	R11UL-P7	10 meters
R4SS-P26	R11LL-P7	10 meters
R4SS-P27	R12UL-P7	10 meters
R4SS-P28	R12LL-P7	10 meters
R4SS-P29	R13UL-P7	15 meters
R4SS-P30	R13LL-P7	15 meters
R4SS-P31	R14UL-P7	15 meters
R4SS-P32	R14LL-P7	15 meters
R5SS-P5	R1UL-P30	10 meters
R5SS-P6	R2UL-P7	10 meters
R5SS-P7	R5UL-P30	3 meters
R5SS-P8	R6LL-P30	5 meters
R5SS-P9	R7UL-P31	5 meters
R5SS-P10	R4UL-P5	5 meters
R5SS-P11	R3UL-P32	5 meters
R5SS-P12	R8LL-P31	10 meters
R5SS-P13	R1LL-P7	10 meters
R5SS-P14	R2LL-P33	10 meters
R5SS-P15	R5LL-P30	3 meters
R5SS-P16	R7LL-P31	5 meters
R5SS-P17	R4LL-P7	5 meters
R5SS-P18	R6UL-P33	5 meters
R5SS-P19	R8UL-P31	10 meters
R5SS-P20	R3LL-P5	5 meters
R5SS-P21	R9UL-P30	10 meters
R5SS-P22	R9LL-P31	10 meters
R5SS-P23	R10UL-P30	10 meters
R5SS-P24	R10LL-P31	10 meters
R5SS-P25	R11UL-P30	10 meters
R5SS-P26	R11LL-P31	10 meters
R5SS-P27	R12UL-P30	10 meters
R5SS-P28	R12LL-P31	10 meters
R5SS-P29	R13UL-P30	10 meters
R5SS-P30	R13LL-P31	10 meters
R5SS-P31	R14UL-P30	15 meters
R5SS-P32	R14LL-P31	15 meters
R6SS-P5	R1UL-P32	10 meters
R6SS-P6	R2UL-P33	10 meters
R6SS-P7	R5UL-P7	5 meters
R6SS-P8	R6LL-P32	3 meters
R6SS-P9	R7UL-P33	5 meters
R6SS-P10	R4UL-P30	5 meters
R6SS-P11	R3UL-P7	10 meters
R6SS-P12	R8LL-P33	5 meters
R6SS-P13	R1LL-P32	10 meters
R6SS-P14	R2LL-P7	10 meters
R6SS-P15	R5LL-P4	5 meters
R6SS-P16	R6UL-P30	3 meters
R6SS-P17	R4LL-P6	5 meters
R6SS-P18	R7LL-P33	5 meters
R6SS-P19	R8UL-P33	5 meters
R6SS-P20	R3LL-P30	10 meters
R6SS-P21	R9UL-P31	10 meters
R6SS-P22	R9LL-P32	10 meters
R6SS-P23	R10UL-P31	10 meters
R6SS-P24	R10LL-P32	10 meters
R6SS-P25	R11UL-P31	10 meters
R6SS-P26	R11LL-P32	10 meters
R6SS-P27	R12UL-P31	10 meters
R6SS-P28	R12LL-P32	10 meters
R6SS-P29	R13UL-P31	10 meters
R6SS-P30	R13LL-P32	10 meters
R6SS-P31	R14UL-P31	10 meters
R6SS-P32	R14LL-P32	10 meters
R7SS-P5	R1UL-P33	10 meters
R7SS-P6	R2UL-P32	10 meters
R7SS-P7	R5UL-P32	5 meters
R7SS-P8	R6LL-P6	5 meters
R7SS-P9	R7UL-P30	3 meters
R7SS-P10	R4UL-P31	10 meters
R7SS-P11	R3UL-P31	10 meters
R7SS-P12	R8LL-P30	5 meters
R7SS-P13	R1LL-P6	10 meters
R7SS-P14	R2LL-P32	10 meters
R7SS-P15	R5LL-P5	5 meters
R7SS-P16	R6UL-P5	5 meters
R7SS-P17	R4LL-P32	10 meters
R7SS-P18	R7LL-P30	3 meters
R7SS-P19	R8UL-P30	5 meters
R7SS-P20	R3LL-P7	10 meters
R7SS-P21	R9UL-P32	5 meters
R7SS-P22	R9LL-P33	5 meters
R7SS-P23	R10UL-P32	10 meters
R7SS-P24	R10LL-P33	10 meters
R7SS-P25	R11UL-P32	10 meters
R7SS-P26	R11LL-P33	10 meters
R7SS-P27	R12UL-P32	10 meters
R7SS-P28	R12LL-P33	10 meters
R7SS-P29	R13UL-P32	10 meters
R7SS-P30	R13LL-P33	10 meters
R7SS-P31	R14UL-P32	10 meters
R7SS-P32	R14LL-P33	10 meters
R8SS-P5	R1UL-P7	10 meters
R8SS-P6	R2UL-P30	10 meters
R8SS-P7	R5UL-P31	10 meters
R8SS-P8	R6LL-P7	5 meters
R8SS-P9	R7UL-P32	5 meters
R8SS-P10	R4UL-P4	10 meters
R8SS-P11	R3UL-P33	10 meters
R8SS-P12	R7LL-P32	5 meters
R8SS-P13	R1LL-P33	10 meters
R8SS-P14	R2LL-P30	10 meters
R8SS-P15	R5LL-P32	10 meters
R8SS-P16	R6UL-P32	5 meters
R8SS-P17	R4LL-P33	10 meters
R8SS-P18	R8LL-P32	3 meters
R8SS-P19	R8UL-P32	3 meters
R8SS-P20	R3LL-P6	10 meters
R8SS-P21	R9UL-P33	5 meters
R8SS-P22	R9LL-P34	5 meters
R8SS-P23	R10UL-P33	5 meters
R8SS-P24	R10LL-P34	5 meters
R8SS-P25	R11UL-P33	10 meters
R8SS-P26	R11LL-P34	10 meters
R8SS-P27	R12UL-P33	10 meters
R8SS-P28	R12LL-P34	10 meters
R8SS-P29	R13UL-P33	10 meters
R8SS-P30	R13LL-P34	10 meters
R8SS-P31	R14UL-P33	10 meters
R8SS-P32	R14LL-P34	10 meters
R9SS-P5	R1UL-P36	10 meters
R9SS-P6	R2UL-P36	10 meters
R9SS-P7	R5UL-P35	10 meters
R9SS-P8	R6LL-P1	10 meters
R9SS-P9	R7UL-P2	5 meters
R9SS-P10	R4UL-P34	10 meters
R9SS-P11	R3UL-P2	10 meters
R9SS-P12	R7LL-P1	5 meters
R9SS-P13	R1LL-P36	10 meters
R9SS-P14	R2LL-P3	10 meters
R9SS-P15	R5LL-P1	10 meters
R9SS-P16	R6UL-P3	10 meters
R9SS-P17	R4LL-P1	10 meters
R9SS-P18	R8LL-P2	5 meters
R9SS-P19	R8UL-P1	5 meters
R9SS-P20	R3LL-P3	10 meters
R9SS-P21	R9UL-P35	3 meters
R9SS-P22	R9LL-P35	3 meters
R9SS-P23	R10UL-P35	5 meters
R9SS-P24	R10LL-P35	5 meters
R9SS-P25	R11UL-P35	5 meters
R9SS-P26	R11LL-P35	5 meters
R9SS-P27	R12UL-P35	10 meters
R9SS-P28	R12LL-P35	10 meters
R9SS-P29	R13UL-P35	10 meters
R9SS-P30	R13LL-P35	10 meters
R9SS-P31	R14UL-P35	10 meters
R9SS-P32	R14LL-P35	10 meters
R10SS-P5	R1UL-P35	15 meters
R10SS-P6	R2UL-P34	10 meters
R10SS-P7	R5UL-P1	10 meters
R10SS-P8	R6LL-P2	10 meters
R10SS-P9	R7UL-P36	10 meters
R10SS-P10	R4UL-P3	10 meters
R10SS-P11	R3UL-P3	10 meters
R10SS-P12	R7LL-P2	10 meters
R10SS-P13	R1LL-P35	15 meters
R10SS-P14	R2LL-P36	10 meters
R10SS-P15	R5LL-P35	10 meters
R10SS-P16	R6UL-P35	10 meters
R10SS-P17	R4LL-P2	10 meters
R10SS-P18	R8LL-P36	5 meters
R10SS-P19	R8UL-P2	5 meters
R10SS-P20	R3LL-P2	10 meters
R10SS-P21	R9UL-P4	5 meters
R10SS-P22	R9LL-P6	5 meters
R10SS-P23	R10UL-P4	3 meters
R10SS-P24	R10LL-P6	3 meters
R10SS-P25	R11UL-P4	5 meters
R10SS-P26	R11LL-P6	5 meters
R10SS-P27	R12UL-P4	5 meters
R10SS-P28	R12LL-P6	5 meters
R10SS-P29	R13UL-P4	10 meters
R10SS-P30	R13LL-P6	10 meters
R10SS-P31	R14UL-P4	10 meters
R10SS-P32	R14LL-P6	10 meters
R11SS-P5	R1UL-P2	15 meters
R11SS-P6	R2UL-P35	15 meters
R11SS-P7	R5UL-P3	10 meters
R11SS-P8	R6LL-P35	10 meters
R11SS-P9	R7UL-P35	10 meters
R11SS-P10	R4UL-P2	10 meters
R11SS-P11	R3UL-P36	10 meters
R11SS-P12	R7LL-P35	10 meters
R11SS-P13	R1LL-P3	15 meters
R11SS-P14	R2LL-P34	15 meters
R11SS-P15	R5LL-P3	10 meters
R11SS-P16	R6UL-P2	10 meters
R11SS-P17	R4LL-P3	10 meters
R11SS-P18	R8LL-P35	10 meters
R11SS-P19	R8UL-P35	10 meters
R11SS-P20	R3LL-P34	10 meters
R11SS-P21	R9UL-P6	5 meters
R11SS-P22	R9LL-P2	5 meters
R11SS-P23	R10UL-P2	5 meters
R11SS-P24	R10LL-P4	5 meters
R11SS-P25	R11UL-P2	3 meters
R11SS-P26	R11LL-P4	3 meters
R11SS-P27	R12UL-P2	5 meters
R11SS-P28	R12LL-P4	5 meters
R11SS-P29	R13UL-P2	5 meters
R11SS-P30	R13LL-P4	5 meters
R11SS-P31	R14UL-P2	10 meters
R11SS-P32	R14LL-P4	10 meters
R12SS-P5	R1UL-P1	15 meters
R12SS-P6	R2UL-P1	15 meters
R12SS-P7	R5UL-P2	10 meters
R12SS-P8	R6LL-P36	10 meters
R12SS-P9	R7UL-P34	10 meters
R12SS-P10	R4UL-P35	10 meters
R12SS-P11	R3UL-P35	15 meters
R12SS-P12	R7LL-P34	10 meters
R12SS-P13	R1LL-P34	15 meters
R12SS-P14	R2LL-P1	15 meters
R12SS-P15	R5LL-P2	10 meters
R12SS-P16	R6UL-P34	10 meters
R12SS-P17	R4LL-P34	10 meters
R12SS-P18	R8LL-P34	10 meters
R12SS-P19	R8UL-P34	10 meters
R12SS-P20	R3LL-P36	15 meters
R12SS-P21	R9UL-P36	10 meters
R12SS-P22	R9LL-P30	10 meters
R12SS-P23	R10UL-P34	5 meters
R12SS-P24	R10LL-P2	5 meters
R12SS-P25	R11UL-P34	5 meters
R12SS-P26	R11LL-P36	5 meters
R12SS-P27	R12UL-P34	3 meters
R12SS-P28	R12LL-P36	3 meters
R12SS-P29	R13UL-P34	5 meters
R12SS-P30	R13LL-P36	5 meters
R12SS-P31	R14UL-P34	5 meters
R12SS-P32	R14LL-P36	5 meters
R13SS-P5	R1UL-P34	15 meters
R13SS-P6	R2UL-P3	15 meters
R13SS-P7	R5UL-P34	10 meters
R13SS-P8	R6LL-P3	10 meters
R13SS-P9	R7UL-P3	10 meters
R13SS-P10	R4UL-P1	15 meters
R13SS-P11	R3UL-P1	15 meters
R13SS-P12	R7LL-P36	10 meters
R13SS-P13	R1LL-P2	15 meters
R13SS-P14	R2LL-P35	15 meters
R13SS-P15	R5LL-P34	10 meters
R13SS-P16	R6UL-P36	10 meters
R13SS-P17	R4LL-P35	15 meters
R13SS-P18	R8LL-P1	10 meters
R13SS-P19	R8UL-P36	10 meters
R13SS-P20	R3LL-P1	15 meters
R13SS-P21	R9UL-P34	10 meters
R13SS-P22	R9LL-P4	10 meters
R13SS-P23	R10UL-P6	10 meters
R13SS-P24	R10LL-P36	10 meters
R13SS-P25	R11UL-P6	5 meters
R13SS-P26	R11LL-P2	5 meters
R13SS-P27	R12UL-P36	5 meters
R13SS-P28	R12LL-P30	5 meters
R13SS-P29	R13UL-P36	3 meters
R13SS-P30	R13LL-P30	3 meters
R13SS-P31	R14UL-P36	5 meters
R13SS-P32	R14LL-P30	5 meters
R14SS-P5	R1UL-P3	15 meters
R14SS-P6	R2UL-P2	15 meters
R14SS-P7	R5UL-P36	15 meters
R14SS-P8	R6LL-P34	10 meters
R14SS-P9	R7UL-P1	10 meters
R14SS-P10	R4UL-P36	15 meters
R14SS-P11	R3UL-P34	15 meters
R14SS-P12	R7LL-P3	10 meters
R14SS-P13	R1LL-P1	15 meters
R14SS-P14	R2LL-P2	15 meters
R14SS-P15	R5LL-P36	15 meters
R14SS-P16	R6UL-P1	10 meters
R14SS-P17	R4LL-P36	15 meters
R14SS-P18	R8LL-P3	10 meters
R14SS-P19	R8UL-P3	10 meters
R14SS-P20	R3LL-P35	15 meters
R14SS-P21	R9UL-P2	10 meters
R14SS-P22	R9LL-P36	10 meters
R14SS-P23	R10UL-P36	10 meters
R14SS-P24	R10LL-P30	10 meters
R14SS-P25	R11UL-P36	10 meters
R14SS-P26	R11LL-P30	10 meters
R14SS-P27	R12UL-P6	5 meters
R14SS-P28	R12LL-P2	5 meters
R14SS-P29	R13UL-P6	5 meters
R14SS-P30	R13LL-P2	5 meters
R14SS-P31	R14UL-P6	3 meters
R14SS-P32	R14LL-P2	3 meters