22 Multi-Rack Cabling Tables for Recovery Appliance RA21 and Later Models
This section contains multi-rack cabling tables for Recovery Appliance RA21 and later models, which use RoCE Network Fabric.
Understanding Multi-Rack Cabling for RA21 and Later Model Racks
Up to 14 racks (RA21 and later models) can be cabled together without external RDMA Network Fabric switches.
To interconnect multiple racks, each rack must contain three RDMA Network Fabric switches.
Two of the switches, known as leaf switches, connect to all of the database servers and storage servers in the rack. The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (Recovery Appliance X9M and later models).
The third switch, known as the spine switch, interconnects the leaf switches in a multi-rack configuration. The spine switch is located at rack unit 1 (U1). If any rack does not include a spine switch, then order the expansion switch kit.
The procedures in this section assume the racks are adjacent to each other, standard routing in raised floor is used, and there are no obstacles in the raised floor. If these assumptions are not correct for your environment, then longer cables may be required for the connections.
Note:
By default, Oracle Exadata Database Machine racks do not include spare cables or a third RoCE Network Fabric switch. To extend these racks, you must order the required cables and RoCE Network Fabric switch.The following diagram shows the default RDMA Network Fabric architecture for a single-rack system. Each rack has two leaf switches, with eight connections between the leaf switches. The database servers and storage servers are each connected to both leaf switches. Each server contains a dual-port RDMA Network Fabric card, with port 1 connected to the lower leaf switch and port 2 connected to the upper leaf switch.
To connect up to 14 racks (RA21 and later models) together, use the following general approach:
-
Remove the eight existing inter-switch connections between the leaf switches on each rack.
-
From each leaf switch, evenly distribute 14 connections to the spine switches in all of the interconnected racks.
The 14 connections use the 8 ports that were previously used for the inter-switch connections and 6 additional free ports on each leaf switch.
Note:
For X9M-8 systems with three database servers and 11 storage servers only, the database servers and storage server require 23 leaf switch ports, which leaves only 13 inter-switch links on each leaf switch. Consequently, these systems are limited to a maximum of 13 interconnected racks.
The resulting RoCE Network Fabric for a typical 2 rack system is illustrated in the following diagram:
As shown in the preceding diagram, every leaf switch has 7 connections to every spine switch. The leaf switches are not directly interconnected with other leaf switches, and the spine switches are not directly interconnected with each other.
As the number of racks increases, the inter-switch connections from every leaf switch are evenly distributed to all of spine switches.
Preparing for Multi-Rack Cabling with RA21 and Later Model Racks
Racks can be added together to increase system capacity and performance. When cabling racks together, note the following:
-
The cable lengths shown in this document assume the racks are adjacent to each other. If the racks are not adjacent, or there are obstacles in the raised floor, or if you use overhead cabling, then longer cables may be required. For optical cables, the maximum supported cable length is 100 meters. For copper cables, the maximum supported cable length is 5 meters.
-
Oracle recommends that the names for the servers include the rack unit number. This helps identify the server during diagnostics.
-
When completing Oracle Exadata Deployment Assistant (OEDA) for the additional rack, you are prompted for SCAN addresses. However, these SCAN addresses are not used because the SCAN address from the original rack are used. Manually remove the new SCAN addresses from the generated installation files.
-
The software owner account names and group names, as well as their identifiers, must match the names and identifiers of the original rack.
-
If the additional grid disks are used with existing disk groups, then ensure the grid disk sizes for the new rack are the same as the original rack.
-
For multi-rack configurations containing up to 14 racks, a spine switch must exist in each rack in order to interconnect the RoCE Network Fabric.
Perform the following tasks before cabling racks together:
-
Determine the number of racks that will be cabled together.
-
Order the parts needed to connect the racks.
To extend Recovery Appliance racks with RoCE Network Fabric, for each rack being added you must order extra cables, transceivers for longer cables, and a RoCE Network Fabric spine switch, if one is required.
When connecting four or more racks, or if you need longer cables for your environment, you must purchase additional 10 meter or 15 meter fiber cables with two QSFP28 SR transceivers to connect each end. The QSFP28 SR transceivers are needed for fiber cables over 5 meters in length.
For multi-rack configurations containing up to 14 racks, the following table outlines the cables needed to interconnect the racks:
Number of Racks 3 Meter Cables Required 5 Meter Cables Required 10 Meter Cables Required 15 Meter Cables Required 2
28
28
0
0
3
28
56
0
0
4
28
71
13
0
5
28
78
34
0
6
28
87
53
0
7
28
88
80
0
8
28
91
105
0
9
28
94
130
0
10
28
95
151
6
11
28
97
168
15
12
28
99
184
25
13
28
100
196
40
14
28
100
204
60
-
Gather the following tools:
- Pen
- Note pad
- Flashlight
- Labels for cables and rack
- Cable ties (Oracle recommends hook and loop straps)
-
Determine a naming method for the rack prefixes. For example, if the original rack has the prefix
dbm01
, then use the prefixdbm02
for the second rack, the prefixdbm03
for the third rack, and so on. -
Verify that the racks have unique host names and IP addresses. All servers interconnected in the racks must have unique names and IP addresses.
Server name and IP address conventions may differ in the following cases:
-
Initial installation of all Recovery Appliance Racks: System address assignments and host names should be complete.
-
New Recovery Appliance Racks are added to an existing cluster: The new rack configuration should require unique host names and IP addresses for the new Recovery Appliance. The IP addresses on the same subnet cannot conflict with the existing systems.
-
Two existing Recovery Appliance Racks are clustered together: You can assign host names and IP addresses only if Recovery Appliance racks are already assigned unique host names and IP addresses, or the entire cluster must be reconfigured. The machines must be on the same subnet and not have conflicting IP addresses.
-
-
Ensure the IP addresses for the new servers are in the same subnet, and do not overlap with the currently-installed servers.
-
Check that the firmware on the original switches is at the same level as the new switches by using the
sh ver
command.It is highly recommended, though not mandatory, to use the same firmware version on all of the switches. If the firmware is not at the same level, you can apply a firmware patch to bring the switches up to the same firmware level.
The remaining topics in this section provide detailed cabling information for cabling up to 14 racks together.
Two-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect two racks, both of which use RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a two-rack system.
Table 22-1 Leaf Switch Connections for the First Rack in a Two-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R1UL to R1SS |
R1UL-P1 to R1SS-P21 R1UL-P2 to R1SS-P23 R1UL-P3 to R1SS-P25 R1UL-P4 to R1SS-P9 R1UL-P5 to R1SS-P5 R1UL-P6 to R1SS-P11 R1UL-P7 to R1SS-P7 |
3 meters |
R1UL to R2SS |
R1UL-P30 to R2SS-P9 R1UL-P31 to R2SS-P5 R1UL-P32 to R2SS-P11 R1UL-P33 to R2SS-P7 R1UL-P34 to R2SS-P21 R1UL-P35 to R2SS-P23 R1UL-P36 to R2SS-P25 |
5 meters |
R1LL to R1SS |
R1LL-P1 to R1SS-P27 R1LL-P2 to R1SS-P29 R1LL-P3 to R1SS-P31 R1LL-P4 to R1SS-P17 R1LL-P5 to R1SS-P13 R1LL-P6 to R1SS-P19 R1LL-P7 to R1SS-P15 |
3 meters |
R1LL to R2SS |
R1LL-P30 to R2SS-P17 R1LL-P31 to R2SS-P13 R1LL-P32 to R2SS-P19 R1LL-P33 to R2SS-P15 R1LL-P34 to R2SS-P27 R1LL-P35 to R2SS-P29 R1LL-P36 to R2SS-P31 |
5 meters |
Table 22-2 Leaf Switch Connections for the Second Rack in a Two-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R2UL to R1SS |
R2UL-P1 to R1SS-P22 R2UL-P2 to R1SS-P24 R2UL-P3 to R1SS-P26 R2UL-P4 to R1SS-P10 R2UL-P5 to R1SS-P6 R2UL-P6 to R1SS-P12 R2UL-P7 to R1SS-P8 |
5 meters |
R2UL to R2SS |
R2UL-P30 to R2SS-P10 R2UL-P31 to R2SS-P6 R2UL-P32 to R2SS-P12 R2UL-P33 to R2SS-P8 R2UL-P34 to R2SS-P22 R2UL-P35 to R2SS-P24 R2UL-P36 to R2SS-P26 |
3 meters |
R2LL to R1SS |
R2LL-P1 to R1SS-P28 R2LL-P2 to R1SS-P30 R2LL-P3 to R1SS-P32 R2LL-P4 to R1SS-P18 R2LL-P5 to R1SS-P14 R2LL-P6 to R1SS-P20 R2LL-P7 to R1SS-P16 |
5 meters |
R2LL to R2SS |
R2LL-P30 to R2SS-P18 R2LL-P31 to R2SS-P14 R2LL-P32 to R2SS-P20 R2LL-P33 to R2SS-P16 R2LL-P34 to R2SS-P28 R2LL-P35 to R2SS-P30 R2LL-P36 to R2SS-P32 |
3 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-3 Two-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R1UL-P7 | 3 meters |
R1SS-P8 | R2UL-P7 | 5 meters |
R1SS-P9 | R1UL-P4 | 3 meters |
R1SS-P10 | R2UL-P4 | 5 meters |
R1SS-P11 | R1UL-P6 | 3 meters |
R1SS-P12 | R2UL-P6 | 5 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R1LL-P7 | 3 meters |
R1SS-P16 | R2LL-P7 | 5 meters |
R1SS-P17 | R1LL-P4 | 3 meters |
R1SS-P18 | R2LL-P4 | 5 meters |
R1SS-P19 | R1LL-P6 | 3 meters |
R1SS-P20 | R2LL-P6 | 5 meters |
R1SS-P21 | R1UL-P1 | 3 meters |
R1SS-P22 | R2UL-P1 | 5 meters |
R1SS-P23 | R1UL-P2 | 3 meters |
R1SS-P24 | R2UL-P2 | 5 meters |
R1SS-P25 | R1UL-P3 | 3 meters |
R1SS-P26 | R2UL-P3 | 5 meters |
R1SS-P27 | R1LL-P1 | 3 meters |
R1SS-P28 | R2LL-P1 | 5 meters |
R1SS-P29 | R1LL-P2 | 3 meters |
R1SS-P30 | R2LL-P2 | 5 meters |
R1SS-P31 | R1LL-P3 | 3 meters |
R1SS-P32 | R2LL-P3 | 5 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R1UL-P33 | 5 meters |
R2SS-P8 | R2UL-P33 | 3 meters |
R2SS-P9 | R1UL-P30 | 5 meters |
R2SS-P10 | R2UL-P30 | 3 meters |
R2SS-P11 | R1UL-P32 | 5 meters |
R2SS-P12 | R2UL-P32 | 3 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R1LL-P33 | 5 meters |
R2SS-P16 | R2LL-P33 | 3 meters |
R2SS-P17 | R1LL-P30 | 5 meters |
R2SS-P18 | R2LL-P30 | 3 meters |
R2SS-P19 | R1LL-P32 | 5 meters |
R2SS-P20 | R2LL-P32 | 3 meters |
R2SS-P21 | R1UL-P34 | 5 meters |
R2SS-P22 | R2UL-P34 | 3 meters |
R2SS-P23 | R1UL-P35 | 5 meters |
R2SS-P24 | R2UL-P35 | 3 meters |
R2SS-P25 | R1UL-P36 | 5 meters |
R2SS-P26 | R2UL-P36 | 3 meters |
R2SS-P27 | R1LL-P34 | 5 meters |
R2SS-P28 | R2LL-P34 | 3 meters |
R2SS-P29 | R1LL-P35 | 5 meters |
R2SS-P30 | R2LL-P35 | 3 meters |
R2SS-P31 | R1LL-P36 | 5 meters |
R2SS-P32 | R2LL-P36 | 3 meters |
Three-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect three racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a three-rack system.
Table 22-4 Leaf Switch Connections for the First Rack in a Three-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R1UL to R1SS |
R1UL-P2 to R1SS-P21 R1UL-P3 to R1SS-P23 R1UL-P4 to R1SS-P9 R1UL-P5 to R1SS-P5 R1UL-P7 to R1SS-P7 |
3 meters |
R1UL to R2SS |
R1UL-P30 to R2SS-P9 R1UL-P31 to R2SS-P5 R1UL-P33 to R2SS-P7 R1UL-P34 to R2SS-P21 R1UL-P35 to R2SS-P23 |
5 meters |
R1UL to R3SS |
R1UL-P1 to R3SS-P21 R1UL-P6 to R3SS-P5 R1UL-P32 to R3SS-P7 R1UL-P36 to R3SS-P23 |
5 meters |
R1LL to R1SS |
R1LL-P2 to R1SS-P27 R1LL-P3 to R1SS-P29 R1LL-P5 to R1SS-P13 R1LL-P7 to R1SS-P15 |
3 meters |
R1LL to R2SS |
R1LL-P30 to R2SS-P17 R1LL-P31 to R2SS-P13 R1LL-P33 to R2SS-P15 R1LL-P34 to R2SS-P27 R1LL-P35 to R2SS-P29 |
5 meters |
R1LL to R3SS |
R1LL-P1 to R3SS-P27 R1LL-P4 to R3SS-P13 R1LL-P6 to R3SS-P15 R1LL-P32 to R3SS-P17 R1LL-P36 to R3SS-P29 |
5 meters |
Table 22-5 Leaf Switch Connections for the Second Rack in a Three-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R2UL to R1SS |
R2UL-P2 to R1SS-P22 R2UL-P3 to R1SS-P24 R2UL-P4 to R1SS-P10 R2UL-P5 to R1SS-P6 R2UL-P7 to R1SS-P8 |
5 meters |
R2UL to R2SS |
R2UL-P31 to R2SS-P6 R2UL-P33 to R2SS-P8 R2UL-P34 to R2SS-P22 R2UL-P35 to R2SS-P24 |
3 meters |
R2UL to R3SS |
R2UL-P1 to R3SS-P22 R2UL-P6 to R3SS-P6 R2UL-P30 to R3SS-P8 R2UL-P32 to R3SS-P10 R2UL-P36 to R3SS-P24 |
5 meters |
R2LL to R1SS |
R2LL-P2 to R1SS-P28 R2LL-P3 to R1SS-P30 R2LL-P4 to R1SS-P18 R2LL-P5 to R1SS-P14 R2LL-P7 to R1SS-P16 |
5 meters |
R2LL to R2SS |
R2LL-P30 to R2SS-P18 R2LL-P31 to R2SS-P14 R2LL-P33 to R2SS-P16 R2LL-P34 to R2SS-P28 R2LL-P35 to R2SS-P30 |
3 meters |
R2LL to R3 |
R2LL-P1 to R3SS-P28 R2LL-P6 to R3SS-P14 R2LL-P32 to R3SS-P16 R2LL-P36 to R3SS-P30 |
5 meters |
Table 22-6 Leaf Switch Connections for the Third Rack in a Three-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R3UL to R1SS |
R3UL-P2 to R1SS-P25 R3UL-P3 to R1SS-P31 R3UL-P5 to R1SS-P11 R3UL-P7 to R1SS-P12 |
5 meters |
R3UL to R2SS |
R3UL-P4 to R2SS-P10 R3UL-P6 to R2SS-P11 R3UL-P31 to R2SS-P12 R3UL-P34 to R2SS-P25 R3UL-P35 to R2SS-P31 |
5 meters |
R3UL to R3SS |
R3UL-P1 to R3SS-P25 R3UL-P30 to R3SS-P11 R3UL-P32 to R3SS-P12 R3UL-P33 to R3SS-P9 R3UL-P36 to R3SS-P31 |
3 meters |
R3LL to R1SS |
R3LL-P2 to R1SS-P26 R3LL-P3 to R1SS-P32 R3LL-P4 to R1SS-P20 R3LL-P5 to R1SS-P17 R3LL-P7 to R1SS-P19 |
5 meters |
R3LL to R2SS |
R3LL-P6 to R2SS-P19 R3LL-P31 to R2SS-P20 R3LL-P34 to R2SS-P26 R3LL-P35 to R2SS-P32 |
5 meters |
R3LL to R3SS |
R3LL-P1 to R3SS-P26 R3LL-P30 to R3SS-P19 R3LL-P32 to R3SS-P20 R3LL-P33 to R3SS-P18 R3LL-P36 to R3SS-P32 |
3 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-7 Three-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R1UL-P7 | 3 meters |
R1SS-P8 | R2UL-P7 | 5 meters |
R1SS-P9 | R1UL-P4 | 3 meters |
R1SS-P10 | R2UL-P4 | 5 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R3UL-P7 | 5 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R1LL-P7 | 3 meters |
R1SS-P16 | R2LL-P7 | 5 meters |
R1SS-P17 | R3LL-P5 | 5 meters |
R1SS-P18 | R2LL-P4 | 5 meters |
R1SS-P19 | R3LL-P7 | 5 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R1UL-P2 | 3 meters |
R1SS-P22 | R2UL-P2 | 5 meters |
R1SS-P23 | R1UL-P3 | 3 meters |
R1SS-P24 | R2UL-P3 | 5 meters |
R1SS-P25 | R3UL-P2 | 5 meters |
R1SS-P26 | R3LL-P2 | 5 meters |
R1SS-P27 | R1LL-P2 | 3 meters |
R1SS-P28 | R2LL-P2 | 5 meters |
R1SS-P29 | R1LL-P3 | 3 meters |
R1SS-P30 | R2LL-P3 | 5 meters |
R1SS-P31 | R3UL-P3 | 5 meters |
R1SS-P32 | R3LL-P3 | 5 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R1UL-P33 | 5 meters |
R2SS-P8 | R2UL-P33 | 3 meters |
R2SS-P9 | R1UL-P30 | 5 meters |
R2SS-P10 | R3UL-P4 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R3UL-P31 | 5 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R1LL-P33 | 5 meters |
R2SS-P16 | R2LL-P33 | 3 meters |
R2SS-P17 | R1LL-P30 | 5 meters |
R2SS-P18 | R2LL-P30 | 3 meters |
R2SS-P19 | R3LL-P6 | 5 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R1UL-P34 | 5 meters |
R2SS-P22 | R2UL-P34 | 3 meters |
R2SS-P23 | R1UL-P35 | 5 meters |
R2SS-P24 | R2UL-P35 | 3 meters |
R2SS-P25 | R3UL-P34 | 5 meters |
R2SS-P26 | R3LL-P34 | 5 meters |
R2SS-P27 | R1LL-P34 | 5 meters |
R2SS-P28 | R2LL-P34 | 3 meters |
R2SS-P29 | R1LL-P35 | 5 meters |
R2SS-P30 | R2LL-P35 | 3 meters |
R2SS-P31 | R3UL-P35 | 5 meters |
R2SS-P32 | R3LL-P35 | 5 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R1UL-P32 | 5 meters |
R3SS-P8 | R2UL-P30 | 5 meters |
R3SS-P9 | R3UL-P33 | 3 meters |
R3SS-P10 | R2UL-P32 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R3UL-P32 | 3 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R1LL-P6 | 5 meters |
R3SS-P16 | R2LL-P32 | 5 meters |
R3SS-P17 | R1LL-P32 | 5 meters |
R3SS-P18 | R3LL-P33 | 3 meters |
R3SS-P19 | R3LL-P30 | 3 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R1UL-P1 | 5 meters |
R3SS-P22 | R2UL-P1 | 5 meters |
R3SS-P23 | R1UL-P36 | 5 meters |
R3SS-P24 | R2UL-P36 | 5 meters |
R3SS-P25 | R3UL-P1 | 3 meters |
R3SS-P26 | R3LL-P1 | 3 meters |
R3SS-P27 | R1LL-P1 | 5 meters |
R3SS-P28 | R2LL-P1 | 5 meters |
R3SS-P29 | R1LL-P36 | 5 meters |
R3SS-P30 | R2LL-P36 | 5 meters |
R3SS-P31 | R3UL-P36 | 3 meters |
R3SS-P32 | R3LL-P36 | 3 meters |
Four-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect four racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a four-rack system.
Table 22-8 Leaf Switch Connections for the First Rack in a Four-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R1UL to R1SS |
R1UL-P2 to R1SS-P21 R1UL-P3 to R1SS-P23 R1UL-P5 to R1SS-P5 R1UL-P7 to R1SS-P7 |
3 meters |
R1UL to R2SS |
R1UL-P31 to R2SS-P5 R1UL-P33 to R2SS-P7 R1UL-P34 to R2SS-P21 R1UL-P35 to R2SS-P23 |
5 meters |
R1UL to R3SS |
R1UL-P1 to R3SS-P21 R1UL-P6 to R3SS-P5 R1UL-P32 to R3SS-P7 |
5 meters |
R1UL to R4SS |
R1UL-P4 to R4SS-P5 R1UL-P30 to R4SS-P7 R1UL-P36 to R4SS-P21 |
10 meters |
R1LL to R1SS |
R1LL-P3 to R1SS-P27 R1LL-P5 to R1SS-P13 R1LL-P7 to R1SS-P15 |
3 meters |
R1LL to R2SS |
R1LL-P31 to R2SS-P13 R1LL-P33 to R2SS-P15 R1LL-P34 to R2SS-P27 R1LL-P35 to R2SS-P29 |
5 meters |
R1LL to R3SS |
R1LL-P1 to R3SS-P27 R1LL-P2 to R3SS-P29 R1LL-P4 to R3SS-P13 R1LL-P6 to R3SS-P15 |
5 meters |
R1LL to R4SS |
R1LL-P30 to R4SS-P13 R1LL-P32 to R4SS-P15 R1LL-P36 to R4SS-P27 |
10 meters |
Table 22-9 Leaf Switch Connections for the Second Rack in a Four-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R2UL to R1SS |
R2UL-P3 to R1SS-P22 R2UL-P5 to R1SS-P6 R2UL-P7 to R1SS-P8 |
5 meters |
R2UL to R2SS |
R2UL-P31 to R2SS-P6 R2UL-P33 to R2SS-P8 R2UL-P35 to R2SS-P22 |
3 meters |
R2UL to R3SS |
R2UL-P1 to R3SS-P22 R2UL-P2 to R3SS-P24 R2UL-P6 to R3SS-P6 R2UL-P30 to R3SS-P8 |
5 meters |
R2UL to R4SS |
R2UL-P4 to R4SS-P6 R2UL-P32 to R4SS-P8 R2UL-P34 to R4SS-P22 R2UL-P36 to R4SS-P24 |
5 meters |
R2LL to R1SS |
R2LL-P1 to R1SS-P24 R2LL-P3 to R1SS-P28 R2LL-P5 to R1SS-P14 R2LL-P7 to R1SS-P16 |
5 meters |
R2LL to R2SS |
R2LL-P31 to R2SS-P14 R2LL-P33 to R2SS-P16 R2LL-P35 to R2SS-P28 |
3 meters |
R2LL to R3SS |
R2LL-P6 to R3SS-P14 R2LL-P32 to R3SS-P16 R2LL-P34 to R3SS-P28 |
5 meters |
R2LL to R4SS |
R2LL-P2 to R4SS-P28 R2LL-P4 to R4SS-P14 R2LL-P30 to R4SS-P16 R2LL-P36 to R4SS-P30 |
5 meters |
Table 22-10 Leaf Switch Connections for the Third Rack in a Four-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R3UL to R1SS |
R3UL-P1 to R1SS-P25 R3UL-P3 to R1SS-P29 R3UL-P5 to R1SS-P11 R3UL-P7 to R1SS-P12 |
5 meters |
R3UL to R2SS |
R3UL-P2 to R2SS-P25 R3UL-P6 to R2SS-P11 R3UL-P31 to R2SS-P12 R3UL-P35 to R2SS-P31 |
5 meters |
R3UL to R3SS |
R3UL-P30 to R3SS-P11 R3UL-P32 to R3SS-P12 R3UL-P34 to R3SS-P25 |
3 meters |
R3UL to R4SS |
R3UL-P4 to R4SS-P11 R3UL-P33 to R4SS-P12 R3UL-P36 to R4SS-P25 |
5 meters |
R3LL to R1SS |
R3LL-P3 to R1SS-P26 R3LL-P4 to R1SS-P20 R3LL-P7 to R1SS-P19 |
5 meters |
R3LL to R2SS |
R3LL-P2 to R2SS-P24 R3LL-P6 to R2SS-P19 R3LL-P31 to R2SS-P20 R3LL-P35 to R2SS-P26 |
5 meters |
R3LL to R3SS |
R3LL-P1 to R3SS-P26 R3LL-P30 to R3SS-P19 R3LL-P32 to R3SS-P20 R3LL-P34 to R3SS-P23 |
3 meters |
R3LL to R4SS |
R3LL-P5 to R4SS-P19 R3LL-P33 to R4SS-P20 R3LL-P36 to R4SS-P26 |
5 meters |
Table 22-11 Leaf Switch Connections for the Fourth Rack in a Four-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R4UL to R1SS |
R4UL-P3 to R1SS-P31 R4UL-P5 to R1SS-P9 R4UL-P7 to R1SS-P10 |
10 meters |
R4UL to R2SS |
R4UL-P2 to R2SS-P30 R4UL-P4 to R2SS-P9 R4UL-P6 to R2SS-P10 |
5 meters |
R4UL to R3SS |
R4UL-P31 to R3SS-P9 R4UL-P33 to R3SS-P10 R4UL-P34 to R3SS-P30 R4UL-P35 to R3SS-P31 |
5 meters |
R4UL to R4SS |
R4UL-P1 to R4SS-P23 R4UL-P30 to R4SS-P9 R4UL-P32 to R4SS-P10 R4UL-P36 to R4SS-P29 |
3 meters |
R4LL to R1SS |
R4LL-P1 to R1SS-P32 R4LL-P3 to R1SS-P30 R4LL-P5 to R1SS-P17 R4LL-P7 to R1SS-P18 |
10 meters |
R4LL to R2SS |
R4LL-P2 to R2SS-P32 R4LL-P4 to R2SS-P17 R4LL-P6 to R2SS-P18 |
5 meters |
R4LL to R3SS |
R4LL-P31 to R3SS-P17 R4LL-P33 to R3SS-P18 R4LL-P34 to R3SS-P32 |
5 meters |
R4LL to R4SS |
R4LL-P30 to R4SS-P17 R4LL-P32 to R4SS-P18 R4LL-P35 to R4SS-P31 R4LL-P36 to R4SS-P32 |
3 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-12 Four-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R1UL-P7 | 3 meters |
R1SS-P8 | R2UL-P7 | 5 meters |
R1SS-P9 | R4UL-P5 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R3UL-P7 | 5 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R1LL-P7 | 3 meters |
R1SS-P16 | R2LL-P7 | 5 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R4LL-P7 | 10 meters |
R1SS-P19 | R3LL-P7 | 5 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R1UL-P2 | 3 meters |
R1SS-P22 | R2UL-P3 | 5 meters |
R1SS-P23 | R1UL-P3 | 3 meters |
R1SS-P24 | R2LL-P1 | 5 meters |
R1SS-P25 | R3UL-P1 | 5 meters |
R1SS-P26 | R3LL-P3 | 5 meters |
R1SS-P27 | R1LL-P3 | 3 meters |
R1SS-P28 | R2LL-P3 | 5 meters |
R1SS-P29 | R3UL-P3 | 5 meters |
R1SS-P30 | R4LL-P3 | 10 meters |
R1SS-P31 | R4UL-P3 | 10 meters |
R1SS-P32 | R4LL-P1 | 10 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R1UL-P33 | 5 meters |
R2SS-P8 | R2UL-P33 | 3 meters |
R2SS-P9 | R4UL-P4 | 5 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R3UL-P31 | 5 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R1LL-P33 | 5 meters |
R2SS-P16 | R2LL-P33 | 3 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R4LL-P6 | 5 meters |
R2SS-P19 | R3LL-P6 | 5 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R1UL-P34 | 5 meters |
R2SS-P22 | R2UL-P35 | 3 meters |
R2SS-P23 | R1UL-P35 | 5 meters |
R2SS-P24 | R3LL-P2 | 5 meters |
R2SS-P25 | R3UL-P2 | 5 meters |
R2SS-P26 | R3LL-P35 | 5 meters |
R2SS-P27 | R1LL-P34 | 5 meters |
R2SS-P28 | R2LL-P35 | 3 meters |
R2SS-P29 | R1LL-P35 | 5 meters |
R2SS-P30 | R4UL-P2 | 5 meters |
R2SS-P31 | R3UL-P35 | 5 meters |
R2SS-P32 | R4LL-P2 | 5 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R1UL-P32 | 5 meters |
R3SS-P8 | R2UL-P30 | 5 meters |
R3SS-P9 | R4UL-P31 | 5 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R3UL-P32 | 3 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R1LL-P6 | 5 meters |
R3SS-P16 | R2LL-P32 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R4LL-P33 | 5 meters |
R3SS-P19 | R3LL-P30 | 3 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R1UL-P1 | 5 meters |
R3SS-P22 | R2UL-P1 | 5 meters |
R3SS-P23 | R3LL-P34 | 3 meters |
R3SS-P24 | R2UL-P2 | 5 meters |
R3SS-P25 | R3UL-P34 | 3 meters |
R3SS-P26 | R3LL-P1 | 3 meters |
R3SS-P27 | R1LL-P1 | 5 meters |
R3SS-P28 | R2LL-P34 | 5 meters |
R3SS-P29 | R1LL-P2 | 5 meters |
R3SS-P30 | R4UL-P34 | 5 meters |
R3SS-P31 | R4UL-P35 | 5 meters |
R3SS-P32 | R4LL-P34 | 5 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R1UL-P30 | 10 meters |
R4SS-P8 | R2UL-P32 | 5 meters |
R4SS-P9 | R4UL-P30 | 3 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R3UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R1LL-P32 | 10 meters |
R4SS-P16 | R2LL-P30 | 5 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R4LL-P32 | 3 meters |
R4SS-P19 | R3LL-P5 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R1UL-P36 | 10 meters |
R4SS-P22 | R2UL-P34 | 5 meters |
R4SS-P23 | R4UL-P1 | 3 meters |
R4SS-P24 | R2UL-P36 | 5 meters |
R4SS-P25 | R3UL-P36 | 5 meters |
R4SS-P26 | R3LL-P36 | 5 meters |
R4SS-P27 | R1LL-P36 | 10 meters |
R4SS-P28 | R2LL-P2 | 5 meters |
R4SS-P29 | R4UL-P36 | 3 meters |
R4SS-P30 | R2LL-P36 | 5 meters |
R4SS-P31 | R4LL-P35 | 3 meters |
R4SS-P32 | R4LL-P36 | 3 meters |
Five-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect five racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a five-rack system.
Table 22-13 Leaf Switch Connections for the First Rack in a Five-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R1UL to R1SS |
R1UL-P3 to R1SS-P21 R1UL-P5 to R1SS-P5 R1UL-P7 to R1SS-P7 |
3 meters |
R1UL to R2SS |
R1UL-P31 to R2SS-P5 R1UL-P33 to R2SS-P7 R1UL-P35 to R2SS-P21 |
5 meters |
R1UL to R3SS |
R1UL-P1 to R3SS-P21 R1UL-P6 to R3SS-P5 R1UL-P32 to R3SS-P7 |
5 meters |
R1UL to R4SS |
R1UL-P2 to R4SS-P21 R1UL-P4 to R4SS-P5 R1UL-P34 to R4SS-P23 |
10 meters |
R1UL to R5SS |
R1UL-P30 to R5SS-P5 R1UL-P36 to R5SS-P21 |
10 meters |
R1LL to R1SS |
R1LL-P3 to R1SS-P27 R1LL-P5 to R1SS-P13 |
3 meters |
R1LL to R2SS |
R1LL-P31 to R2SS-P13 R1LL-P33 to R2SS-P15 R1LL-P35 to R2SS-P27 |
5 meters |
R1LL to R3SS |
R1LL-P2 to R3SS-P27 R1LL-P4 to R3SS-P13 R1LL-P6 to R3SS-P15 |
5 meters |
R1LL to R4SS |
R1LL-P30 to R4SS-P13 R1LL-P32 to R4SS-P15 R1LL-P34 to R4SS-P27 |
10 meters |
R1LL to R5SS |
R1LL-P1 to R5SS-P25 R1LL-P7 to R5SS-P13 R1LL-P36 to R5SS-P27 |
10 meters |
Table 22-14 Leaf Switch Connections for the Second Rack in a Five-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R2UL to R1SS |
R2UL-P1 to R1SS-P24 R2UL-P3 to R1SS-P22 R2UL-P5 to R1SS-P6 |
5 meters |
R2UL to R2SS |
R2UL-P31 to R2SS-P6 R2UL-P35 to R2SS-P22 |
3 meters |
R2UL to R3SS |
R2UL-P2 to R3SS-P22 R2UL-P6 to R3SS-P6 R2UL-P30 to R3SS-P8 |
5 meters |
R2UL to R4SS |
R2UL-P4 to R4SS-P6 R2UL-P32 to R4SS-P8 R2UL-P34 to R4SS-P22 |
5 meters |
R2UL to R5SS |
R2UL-P7 to R5SS-P6 R2UL-P33 to R5SS-P8 R2UL-P36 to R5SS-P22 |
10 meters |
R2LL to R1SS |
R2LL-P3 to R1SS-P28 R2LL-P5 to R1SS-P14 R2LL-P7 to R1SS-P16 |
5 meters |
R2LL to R2SS |
R2LL-P31 to R2SS-P14 R2LL-P34 to R2SS-P24 R2LL-P35 to R2SS-P28 |
3 meters |
R2LL to R3SS |
R2LL-P1 to R3SS-P28 R2LL-P6 to R3SS-P14 |
5 meters |
R2LL to R4SS |
R2LL-P2 to R4SS-P28 R2LL-P4 to R4SS-P14 R2LL-P30 to R4SS-P16 |
5 meters |
R2LL to R5SS |
R2LL-P32 to R5SS-P16 R2LL-P33 to R5SS-P14 R2LL-P36 to R5SS-P28 |
10 meters |
Table 22-15 Leaf Switch Connections for the Third Rack in a Five-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R3UL to R1SS |
R3UL-P3 to R1SS-P25 R3UL-P5 to R1SS-P11 R3UL-P7 to R1SS-P12 |
5 meters |
R3UL to R2SS |
R3UL-P2 to R2SS-P25 R3UL-P6 to R2SS-P11 R3UL-P31 to R2SS-P12 |
5 meters |
R3UL to R3SS |
R3UL-P30 to R3SS-P11 R3UL-P34 to R3SS-P25 R3UL-P36 to R3SS-P24 |
3 meters |
R3UL to R4SS |
R3UL-P1 to R4SS-P25 R3UL-P4 to R4SS-P11 |
5 meters |
R3UL to R5SS |
R3UL-P32 to R5SS-P11 R3UL-P33 to R5SS-P12 R3UL-P35 to R5SS-P24 |
5 meters |
R3LL to R1SS |
R3LL-P3 to R1SS-P26 R3LL-P4 to R1SS-P20 R3LL-P7 to R1SS-P19 |
5 meters |
R3LL to R2SS |
R3LL-P2 to R2SS-P26 R3LL-P6 to R2SS-P19 R3LL-P31 to R2SS-P20 |
5 meters |
R3LL to R3SS |
R3LL-P30 to R3SS-P19 R3LL-P32 to R3SS-P20 R3LL-P34 to R3SS-P26 |
3 meters |
R3LL to R4SS |
R3LL-P33 to R4SS-P20 R3LL-P35 to R4SS-P24 R3LL-P36 to R4SS-P26 |
5 meters |
R3LL to R5SS |
R3LL-P1 to R5SS-P26 R3LL-P5 to R5SS-P20 |
5 meters |
Table 22-16 Leaf Switch Connections for the Fourth Rack in a Five-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R4UL to R1SS |
R4UL-P3 to R1SS-P31 R4UL-P7 to R1SS-P10 |
10 meters |
R4UL to R2SS |
R4UL-P2 to R2SS-P31 R4UL-P4 to R2SS-P9 R4UL-P6 to R2SS-P10 |
5 meters |
R4UL to R3SS |
R4UL-P31 to R3SS-P9 R4UL-P33 to R3SS-P10 R4UL-P35 to R3SS-P31 |
5 meters |
R4UL to R4SS |
R4UL-P30 to R4SS-P9 R4UL-P32 to R4SS-P10 R4UL-P34 to R4SS-P31 |
3 meters |
R4UL to R5SS |
R4UL-P1 to R5SS-P31 R4UL-P5 to R5SS-P10 R4UL-P36 to R5SS-P32 |
5 meters |
R4LL to R1SS |
R4LL-P1 to R1SS-P32 R4LL-P3 to R1SS-P30 R4LL-P5 to R1SS-P17 |
10 meters |
R4LL to R2SS |
R4LL-P2 to R2SS-P30 R4LL-P4 to R2SS-P17 |
5 meters |
R4LL to R3SS |
R4LL-P31 to R3SS-P17 R4LL-P33 to R3SS-P18 R4LL-P35 to R3SS-P30 |
5 meters |
R4LL to R4SS |
R4LL-P30 to R4SS-P17 R4LL-P32 to R4SS-P18 R4LL-P34 to R4SS-P30 |
3 meters |
R4LL to R5SS |
R4LL-P7 to R5SS-P17 R4LL-P6 to R5SS-P18 R4LL-P36 to R5SS-P30 |
5 meters |
Table 22-17 Leaf Switch Connections for the Fifth Rack in a Five-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R5UL to R1SS |
R5UL-P3 to R1SS-P23 R5UL-P5 to R1SS-P8 R5UL-P7 to R1SS-P9 |
10 meters |
R5UL to R2SS |
R5UL-P1 to R2SS-P32 R5UL-P2 to R2SS-P23 R5UL-P4 to R2SS-P8 |
10 meters |
R5UL to R3SS |
R5UL-P6 to R3SS-P12 R5UL-P34 to R3SS-P23 |
5 meters |
R5UL to R4SS |
R5UL-P31 to R4SS-P7 R5UL-P33 to R4SS-P12 R5UL-P35 to R4SS-P32 |
5 meters |
R5UL to R5SS |
R5UL-P30 to R5SS-P7 R5UL-P32 to R5SS-P9 R5UL-P36 to R5SS-P23 |
3 meters |
R5LL to R1SS |
R5LL-P3 to R1SS-P29 R5LL-P5 to R1SS-P15 R5LL-P7 to R1SS-P18 |
10 meters |
R5LL to R2SS |
R5LL-P2 to R2SS-P29 R5LL-P4 to R2SS-P16 R5LL-P6 to R2SS-P18 |
10 meters |
R5LL to R3SS |
R5LL-P1 to R3SS-P32 R5LL-P31 to R3SS-P16 R5LL-P35 to R3SS-P29 |
5 meters |
R5LL to R4SS |
R5LL-P33 to R4SS-P19 R5LL-P34 to R4SS-P29 |
5 meters |
R5LL to R5SS |
R5LL-P30 to R5SS-P15 R5LL-P32 to R5SS-P19 R5LL-P36 to R5SS-P29 |
3 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-18 Five-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R1UL-P7 | 3 meters |
R1SS-P8 | R5UL-P5 | 10 meters |
R1SS-P9 | R5UL-P7 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R3UL-P7 | 5 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R5LL-P5 | 10 meters |
R1SS-P16 | R2LL-P7 | 5 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R5LL-P7 | 10 meters |
R1SS-P19 | R3LL-P7 | 5 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R1UL-P3 | 3 meters |
R1SS-P22 | R2UL-P3 | 5 meters |
R1SS-P23 | R5UL-P3 | 10 meters |
R1SS-P24 | R2UL-P1 | 5 meters |
R1SS-P25 | R3UL-P3 | 5 meters |
R1SS-P26 | R3LL-P3 | 5 meters |
R1SS-P27 | R1LL-P3 | 3 meters |
R1SS-P28 | R2LL-P3 | 5 meters |
R1SS-P29 | R5LL-P3 | 10 meters |
R1SS-P30 | R4LL-P3 | 10 meters |
R1SS-P31 | R4UL-P3 | 10 meters |
R1SS-P32 | R4LL-P1 | 10 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R1UL-P33 | 5 meters |
R2SS-P8 | R5UL-P4 | 10 meters |
R2SS-P9 | R4UL-P4 | 5 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R3UL-P31 | 5 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R1LL-P33 | 5 meters |
R2SS-P16 | R5LL-P4 | 10 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R5LL-P6 | 10 meters |
R2SS-P19 | R3LL-P6 | 5 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R1UL-P35 | 5 meters |
R2SS-P22 | R2UL-P35 | 3 meters |
R2SS-P23 | R5UL-P2 | 10 meters |
R2SS-P24 | R2LL-P34 | 3 meters |
R2SS-P25 | R3UL-P2 | 5 meters |
R2SS-P26 | R3LL-P2 | 5 meters |
R2SS-P27 | R1LL-P35 | 5 meters |
R2SS-P28 | R2LL-P35 | 3 meters |
R2SS-P29 | R5LL-P2 | 10 meters |
R2SS-P30 | R4LL-P2 | 5 meters |
R2SS-P31 | R4UL-P2 | 5 meters |
R2SS-P32 | R5UL-P1 | 10 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R1UL-P32 | 5 meters |
R3SS-P8 | R2UL-P30 | 5 meters |
R3SS-P9 | R4UL-P31 | 5 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R5UL-P6 | 5 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R1LL-P6 | 5 meters |
R3SS-P16 | R5LL-P31 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R4LL-P33 | 5 meters |
R3SS-P19 | R3LL-P30 | 3 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R1UL-P1 | 5 meters |
R3SS-P22 | R2UL-P2 | 5 meters |
R3SS-P23 | R5UL-P34 | 5 meters |
R3SS-P24 | R3UL-P36 | 3 meters |
R3SS-P25 | R3UL-P34 | 3 meters |
R3SS-P26 | R3LL-P34 | 3 meters |
R3SS-P27 | R1LL-P2 | 5 meters |
R3SS-P28 | R2LL-P1 | 5 meters |
R3SS-P29 | R5LL-P35 | 5 meters |
R3SS-P30 | R4LL-P35 | 5 meters |
R3SS-P31 | R4UL-P35 | 5 meters |
R3SS-P32 | R5LL-P1 | 5 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R5UL-P31 | 5 meters |
R4SS-P8 | R2UL-P32 | 5 meters |
R4SS-P9 | R4UL-P30 | 3 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R5UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R1LL-P32 | 10 meters |
R4SS-P16 | R2LL-P30 | 5 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R4LL-P32 | 3 meters |
R4SS-P19 | R5LL-P33 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R1UL-P2 | 10 meters |
R4SS-P22 | R2UL-P34 | 5 meters |
R4SS-P23 | R1UL-P34 | 10 meters |
R4SS-P24 | R3LL-P35 | 5 meters |
R4SS-P25 | R3UL-P1 | 5 meters |
R4SS-P26 | R3LL-P36 | 5 meters |
R4SS-P27 | R1LL-P34 | 10 meters |
R4SS-P28 | R2LL-P2 | 5 meters |
R4SS-P29 | R5LL-P34 | 5 meters |
R4SS-P30 | R4LL-P34 | 3 meters |
R4SS-P31 | R4UL-P34 | 3 meters |
R4SS-P32 | R5UL-P35 | 5 meters |
R5SS-P5 | R1UL-P30 | 10 meters |
R5SS-P6 | R2UL-P7 | 10 meters |
R5SS-P7 | R5UL-P30 | 3 meters |
R5SS-P8 | R2UL-P33 | 10 meters |
R5SS-P9 | R5UL-P32 | 3 meters |
R5SS-P10 | R4UL-P5 | 5 meters |
R5SS-P11 | R3UL-P32 | 5 meters |
R5SS-P12 | R3UL-P33 | 5 meters |
R5SS-P13 | R1LL-P7 | 10 meters |
R5SS-P14 | R2LL-P33 | 10 meters |
R5SS-P15 | R5LL-P30 | 3 meters |
R5SS-P16 | R2LL-P32 | 10 meters |
R5SS-P17 | R4LL-P7 | 5 meters |
R5SS-P18 | R4LL-P6 | 5 meters |
R5SS-P19 | R5LL-P32 | 3 meters |
R5SS-P20 | R3LL-P5 | 5 meters |
R5SS-P21 | R1UL-P36 | 10 meters |
R5SS-P22 | R2UL-P36 | 10 meters |
R5SS-P23 | R5UL-P36 | 3 meters |
R5SS-P24 | R3UL-P35 | 5 meters |
R5SS-P25 | R1LL-P1 | 10 meters |
R5SS-P26 | R3LL-P1 | 5 meters |
R5SS-P27 | R1LL-P36 | 10 meters |
R5SS-P28 | R2LL-P36 | 10 meters |
R5SS-P29 | R5LL-P36 | 3 meters |
R5SS-P30 | R4LL-P36 | 5 meters |
R5SS-P31 | R4UL-P1 | 5 meters |
R5SS-P32 | R4UL-P36 | 5 meters |
Six-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect six racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a six-rack system.
Table 22-19 Leaf Switch Connections for the First Rack in a Six-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R1UL to R1SS |
R1UL-P3 to R1SS-P21 R1UL-P5 to R1SS-P5 R1UL-P7 to R1SS-P7 |
3 meters |
R1UL to R2SS |
R1UL-P31 to R2SS-P5 R1UL-P33 to R2SS-P7 R1UL-P35 to R2SS-P21 |
5 meters |
R1UL to R3SS |
R1UL-P1 to R3SS-P21 R1UL-P6 to R3SS-P5 |
5 meters |
R1UL to R4SS |
R1UL-P2 to R4SS-P21 R1UL-P4 to R4SS-P5 |
10 meters |
R1UL to R5SS |
R1UL-P30 to R5SS-P5 R1UL-P34 to R5SS-P21 |
10 meters |
R1UL to R6SS |
R1UL-P32 to R6SS-P5 R1UL-P36 to R6SS-P21 |
10 meters |
R1LL to R1SS |
R1LL-P3 to R1SS-P27 R1LL-P5 to R1SS-P13 |
3 meters |
R1LL to R2SS |
R1LL-P31 to R2SS-P13 R1LL-P33 to R2SS-P15 R1LL-P35 to R2SS-P27 |
5 meters |
R1LL to R3SS |
R1LL-P2 to R3SS-P27 R1LL-P4 to R3SS-P13 R1LL-P6 to R3SS-P15 |
5 meters |
R1LL to R4SS |
R1LL-P30 to R4SS-P13 R1LL-P34 to R4SS-P27 |
10 meters |
R1LL to R5SS |
R1LL-P7 to R5SS-P13 R1LL-P1 to R5SS-P27 |
10 meters |
R1LL to R6SS |
R1LL-P32 to R6SS-P13 R1LL-P36 to R6SS-P27 |
10 meters |
Table 22-20 Leaf Switch Connections for the Second Rack in a Six-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R2UL to R1SS |
R2UL-P3 to R1SS-P22 R2UL-P5 to R1SS-P6 |
5 meters |
R2UL to R2SS |
R2UL-P31 to R2SS-P6 R2UL-P35 to R2SS-P22 |
3 meters |
R2UL to R3SS |
R2UL-P6 to R3SS-P6 R2UL-P30 to R3SS-P8 R2UL-P2 to R3SS-P22 |
5 meters |
R2UL to R4SS |
R2UL-P4 to R4SS-P6 R2UL-P32 to R4SS-P8 R2UL-P34 to R4SS-P22 |
5 meters |
R2UL to R5SS |
R2UL-P1 to R5SS-P22 R2UL-P7 to R5SS-P6 |
10 meters |
R2UL to R6SS |
R2UL-P33 to R6SS-P6 R2UL-P36 to R6SS-P22 |
10 meters |
R2LL to R1SS |
R2LL-P3 to R1SS-P28 R2LL-P5 to R1SS-P14 |
5 meters |
R2LL to R2SS |
R2LL-P31 to R2SS-P14 R2LL-P35 to R2SS-P28 |
3 meters |
R2LL to R3SS |
R2LL-P2 to R3SS-P28 R2LL-P6 to R3SS-P14 |
5 meters |
R2LL to R4SS |
R2LL-P4 to R4SS-P14 R2LL-P30 to R4SS-P16 R2LL-P34 to R4SS-P28 |
5 meters |
R2LL to R5SS |
R2LL-P32 to R5SS-P16 R2LL-P33 to R5SS-P14 R2LL-P36 to R5SS-P28 |
10 meters |
R2LL to R6SS |
R2LL-P1 to R6SS-P28 R2LL-P7 to R6SS-P14 |
10 meters |
Table 22-21 Leaf Switch Connections for the Third Rack in a Six-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R3UL to R1SS |
R3UL-P3 to R1SS-P25 R3UL-P5 to R1SS-P11 |
5 meters |
R3UL to R2SS |
R3UL-P2 to R2SS-P25 R3UL-P6 to R2SS-P11 |
5 meters |
R3UL to R3SS |
R3UL-P30 to R3SS-P11 R3UL-P34 to R3SS-P25 |
3 meters |
R3UL to R4SS |
R3UL-P1 to R4SS-P25 R3UL-P4 to R4SS-P11 |
5 meters |
R3UL to R5SS |
R3UL-P32 to R5SS-P11 R3UL-P33 to R5SS-P12 R3UL-P35 to R5SS-P25 |
5 meters |
R3UL to R6SS |
R3UL-P7 to R6SS-P11 R3UL-P31 to R6SS-P12 R3UL-P36 to R6SS-P25 |
10 meters |
R3LL to R1SS |
R3LL-P3 to R1SS-P26 R3LL-P4 to R1SS-P20 R3LL-P7 to R1SS-P19 |
5 meters |
R3LL to R2SS |
R3LL-P31 to R2SS-P20 R3LL-P35 to R2SS-P26 |
5 meters |
R3LL to R3SS |
R3LL-P32 to R3SS-P20 R3LL-P34 to R3SS-P26 |
3 meters |
R3LL to R4SS |
R3LL-P33 to R4SS-P20 R3LL-P36 to R4SS-P26 |
5 meters |
R3LL to R5SS |
R3LL-P1 to R5SS-P26 R3LL-P5 to R5SS-P20 |
5 meters |
R3LL to R6SS |
R3LL-P2 to R6SS-P26 R3LL-P6 to R6SS-P19 R3LL-P30 to R6SS-P20 |
10 meters |
Table 22-22 Leaf Switch Connections for the Fourth Rack in a Six-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R4UL to R1SS |
R4UL-P1 to R1SS-P32 R4UL-P3 to R1SS-P31 R4UL-P7 to R1SS-P10 |
10 meters |
R4UL to R2SS |
R4UL-P2 to R2SS-P31 R4UL-P4 to R2SS-P9 R4UL-P6 to R2SS-P10 |
5 meters |
R4UL to R3SS |
R4UL-P31 to R3SS-P9 R4UL-P33 to R3SS-P10 |
5 meters |
R4UL to R4SS |
R4UL-P32 to R4SS-P10 R4UL-P34 to R4SS-P31 |
3 meters |
R4UL to R5SS |
R4UL-P5 to R5SS-P10 R4UL-P35 to R5SS-P31 |
5 meters |
R4UL to R6SS |
R4UL-P30 to R6SS-P10 R4UL-P36 to R6SS-P31 |
5 meters |
R4LL to R1SS |
R4LL-P3 to R1SS-P30 R4LL-P5 to R1SS-P17 |
10 meters |
R4LL to R2SS |
R4LL-P1 to R2SS-P32 R4LL-P2 to R2SS-P30 R4LL-P4 to R2SS-P17 |
5 meters |
R4LL to R3SS |
R4LL-P31 to R3SS-P17 R4LL-P33 to R3SS-P18 R4LL-P35 to R3SS-P30 |
5 meters |
R4LL to R4SS |
R4LL-P30 to R4SS-P17 R4LL-P32 to R4SS-P18 |
3 meters |
R4LL to R5SS |
R4LL-P7 to R5SS-P17 R4LL-P34 to R5SS-P30 |
5 meters |
R4LL to R6SS |
R4LL-P6 to R6SS-P17 R4LL-P36 to R6SS-P30 |
5 meters |
Table 22-23 Leaf Switch Connections for the Fifth Rack in a Six-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R5UL to R1SS |
R5UL-P3 to R1SS-P23 R5UL-P5 to R1SS-P8 |
10 meters |
R5UL to R2SS |
R5UL-P2 to R2SS-P23 R5UL-P4 to R2SS-P8 |
10 meters |
R5UL to R3SS |
R5UL-P6 to R3SS-P12 R5UL-P1 to R3SS-P23 R5UL-P34 to R3SS-P24 |
5 meters |
R5UL to R4SS |
R5UL-P31 to R4SS-P7 R5UL-P33 to R4SS-P12 R5UL-P35 to R4SS-P23 |
5 meters |
R5UL to R5SS |
R5UL-P30 to R5SS-P7 R5UL-P32 to R5SS-P9 |
3 meters |
R5UL to R6SS |
R5UL-P7 to R6SS-P7 R5UL-P36 to R6SS-P23 |
5 meters |
R5LL to R1SS |
R5LL-P3 to R1SS-P29 R5LL-P7 to R1SS-P18 |
10 meters |
R5LL to R2SS |
R5LL-P6 to R2SS-P18 R5LL-P34 to R2SS-P29 |
10 meters |
R5LL to R3SS |
R5LL-P31 to R3SS-P16 R5LL-P35 to R3SS-P29 |
5 meters |
R5LL to R4SS |
R5LL-P1 to R4SS-P29 R5LL-P2 to R4SS-P30 R5LL-P33 to R4SS-P19 |
5 meters |
R5LL to R5SS |
R5LL-P30 to R5SS-P15 R5LL-P32 to R5SS-P19 R5LL-P36 to R5SS-P29 |
3 meters |
R5LL to R6SS |
R5LL-P4 to R6SS-P15 R5LL-P5 to R6SS-P9 |
5 meters |
Table 22-24 Leaf Switch Connections for the Sixth Rack in a Six-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R6UL to R1SS |
R6UL-P5 to R1SS-P9 R6UL-P7 to R1SS-P16 |
10 meters |
R6UL to R2SS |
R6UL-P2 to R2SS-P24 R6UL-P4 to R2SS-P16 |
10 meters |
R6UL to R3SS |
R6UL-P3 to R3SS-P31 R6UL-P6 to R3SS-P19 |
10 meters |
R6UL to R4SS |
R6UL-P1 to R4SS-P32 R6UL-P31 to R4SS-P15 |
5 meters |
R6UL to R5SS |
R6UL-P33 to R5SS-P18 R6UL-P34 to R5SS-P24 R6UL-P35 to R5SS-P23 |
5 meters |
R6UL to R6SS |
R6UL-P30 to R6SS-P16 R6UL-P32 to R6SS-P18 R6UL-P36 to R6SS-P24 |
3 meters |
R6LL to R1SS |
R6LL-P3 to R1SS-P24 R6LL-P5 to R1SS-P12 R6LL-P7 to R1SS-P15 |
10 meters |
R6LL to R2SS |
R6LL-P4 to R2SS-P12 R6LL-P6 to R2SS-P19 |
10 meters |
R6LL to R3SS |
R6LL-P1 to R3SS-P32 R6LL-P31 to R3SS-P7 |
10 meters |
R6LL to R4SS |
R6LL-P2 to R4SS-P24 R6LL-P33 to R4SS-P9 |
5 meters |
R6LL to R5SS |
R6LL-P30 to R5SS-P8 R6LL-P34 to R5SS-P32 |
5 meters |
R6LL to R6SS |
R6LL-P32 to R6SS-P8 R6LL-P35 to R6SS-P29 R6LL-P36 to R6SS-P32 |
3 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-25 Six-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R1UL-P7 | 3 meters |
R1SS-P8 | R5UL-P5 | 10 meters |
R1SS-P9 | R6UL-P5 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R6LL-P5 | 10 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R6LL-P7 | 10 meters |
R1SS-P16 | R6UL-P7 | 10 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R5LL-P7 | 10 meters |
R1SS-P19 | R3LL-P7 | 5 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R1UL-P3 | 3 meters |
R1SS-P22 | R2UL-P3 | 5 meters |
R1SS-P23 | R5UL-P3 | 10 meters |
R1SS-P24 | R6LL-P3 | 10 meters |
R1SS-P25 | R3UL-P3 | 5 meters |
R1SS-P26 | R3LL-P3 | 5 meters |
R1SS-P27 | R1LL-P3 | 3 meters |
R1SS-P28 | R2LL-P3 | 5 meters |
R1SS-P29 | R5LL-P3 | 10 meters |
R1SS-P30 | R4LL-P3 | 10 meters |
R1SS-P31 | R4UL-P3 | 10 meters |
R1SS-P32 | R4UL-P1 | 10 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R1UL-P33 | 5 meters |
R2SS-P8 | R5UL-P4 | 10 meters |
R2SS-P9 | R4UL-P4 | 5 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R6LL-P4 | 10 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R1LL-P33 | 5 meters |
R2SS-P16 | R6UL-P4 | 10 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R5LL-P6 | 10 meters |
R2SS-P19 | R6LL-P6 | 10 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R1UL-P35 | 5 meters |
R2SS-P22 | R2UL-P35 | 3 meters |
R2SS-P23 | R5UL-P2 | 10 meters |
R2SS-P24 | R6UL-P2 | 10 meters |
R2SS-P25 | R3UL-P2 | 5 meters |
R2SS-P26 | R3LL-P35 | 5 meters |
R2SS-P27 | R1LL-P35 | 5 meters |
R2SS-P28 | R2LL-P35 | 3 meters |
R2SS-P29 | R5LL-P34 | 10 meters |
R2SS-P30 | R4LL-P2 | 5 meters |
R2SS-P31 | R4UL-P2 | 5 meters |
R2SS-P32 | R4LL-P1 | 5 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R6LL-P31 | 10 meters |
R3SS-P8 | R2UL-P30 | 5 meters |
R3SS-P9 | R4UL-P31 | 5 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R5UL-P6 | 5 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R1LL-P6 | 5 meters |
R3SS-P16 | R5LL-P31 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R4LL-P33 | 5 meters |
R3SS-P19 | R6UL-P6 | 10 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R1UL-P1 | 5 meters |
R3SS-P22 | R2UL-P2 | 5 meters |
R3SS-P23 | R5UL-P1 | 5 meters |
R3SS-P24 | R5UL-P34 | 5 meters |
R3SS-P25 | R3UL-P34 | 3 meters |
R3SS-P26 | R3LL-P34 | 3 meters |
R3SS-P27 | R1LL-P2 | 5 meters |
R3SS-P28 | R2LL-P2 | 5 meters |
R3SS-P29 | R5LL-P35 | 5 meters |
R3SS-P30 | R4LL-P35 | 5 meters |
R3SS-P31 | R6UL-P3 | 10 meters |
R3SS-P32 | R6LL-P1 | 10 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R5UL-P31 | 5 meters |
R4SS-P8 | R2UL-P32 | 5 meters |
R4SS-P9 | R6LL-P33 | 5 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R5UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R6UL-P31 | 5 meters |
R4SS-P16 | R2LL-P30 | 5 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R4LL-P32 | 3 meters |
R4SS-P19 | R5LL-P33 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R1UL-P2 | 10 meters |
R4SS-P22 | R2UL-P34 | 5 meters |
R4SS-P23 | R5UL-P35 | 5 meters |
R4SS-P24 | R6LL-P2 | 5 meters |
R4SS-P25 | R3UL-P1 | 5 meters |
R4SS-P26 | R3LL-P36 | 5 meters |
R4SS-P27 | R1LL-P34 | 10 meters |
R4SS-P28 | R2LL-P34 | 5 meters |
R4SS-P29 | R5LL-P1 | 5 meters |
R4SS-P30 | R5LL-P2 | 5 meters |
R4SS-P31 | R4UL-P34 | 3 meters |
R4SS-P32 | R6UL-P1 | 5 meters |
R5SS-P5 | R1UL-P30 | 10 meters |
R5SS-P6 | R2UL-P7 | 10 meters |
R5SS-P7 | R5UL-P30 | 3 meters |
R5SS-P8 | R6LL-P30 | 5 meters |
R5SS-P9 | R5UL-P32 | 3 meters |
R5SS-P10 | R4UL-P5 | 5 meters |
R5SS-P11 | R3UL-P32 | 5 meters |
R5SS-P12 | R3UL-P33 | 5 meters |
R5SS-P13 | R1LL-P7 | 10 meters |
R5SS-P14 | R2LL-P33 | 10 meters |
R5SS-P15 | R5LL-P30 | 3 meters |
R5SS-P16 | R2LL-P32 | 10 meters |
R5SS-P17 | R4LL-P7 | 5 meters |
R5SS-P18 | R6UL-P33 | 5 meters |
R5SS-P19 | R5LL-P32 | 3 meters |
R5SS-P20 | R3LL-P5 | 5 meters |
R5SS-P21 | R1UL-P34 | 10 meters |
R5SS-P22 | R2UL-P1 | 10 meters |
R5SS-P23 | R6UL-P35 | 5 meters |
R5SS-P24 | R6UL-P34 | 5 meters |
R5SS-P25 | R3UL-P35 | 5 meters |
R5SS-P26 | R3LL-P1 | 5 meters |
R5SS-P27 | R1LL-P1 | 10 meters |
R5SS-P28 | R2LL-P36 | 10 meters |
R5SS-P29 | R5LL-P36 | 3 meters |
R5SS-P30 | R4LL-P34 | 5 meters |
R5SS-P31 | R4UL-P35 | 5 meters |
R5SS-P32 | R6LL-P34 | 5 meters |
R6SS-P5 | R1UL-P32 | 10 meters |
R6SS-P6 | R2UL-P33 | 10 meters |
R6SS-P7 | R5UL-P7 | 5 meters |
R6SS-P8 | R6LL-P32 | 3 meters |
R6SS-P9 | R5LL-P5 | 5 meters |
R6SS-P10 | R4UL-P30 | 5 meters |
R6SS-P11 | R3UL-P7 | 10 meters |
R6SS-P12 | R3UL-P31 | 10 meters |
R6SS-P13 | R1LL-P32 | 10 meters |
R6SS-P14 | R2LL-P7 | 10 meters |
R6SS-P15 | R5LL-P4 | 5 meters |
R6SS-P16 | R6UL-P30 | 3 meters |
R6SS-P17 | R4LL-P6 | 5 meters |
R6SS-P18 | R6UL-P32 | 3 meters |
R6SS-P19 | R3LL-P6 | 10 meters |
R6SS-P20 | R3LL-P30 | 10 meters |
R6SS-P21 | R1UL-P36 | 10 meters |
R6SS-P22 | R2UL-P36 | 10 meters |
R6SS-P23 | R5UL-P36 | 5 meters |
R6SS-P24 | R6UL-P36 | 3 meters |
R6SS-P25 | R3UL-P36 | 10 meters |
R6SS-P26 | R3LL-P2 | 10 meters |
R6SS-P27 | R1LL-P36 | 10 meters |
R6SS-P28 | R2LL-P1 | 10 meters |
R6SS-P29 | R6LL-P35 | 3 meters |
R6SS-P30 | R4LL-P36 | 5 meters |
R6SS-P31 | R4UL-P36 | 5 meters |
R6SS-P32 | R6LL-P36 | 3 meters |
Seven-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect seven racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a seven-rack system.
Table 22-26 Leaf Switch Connections for the First Rack in a Seven-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R1UL to R1SS |
R1UL-P5 to R1SS-P5 R1UL-P7 to R1SS-P7 |
3 meters |
R1UL to R2SS |
R1UL-P3 to R2SS-P21 R1UL-P31 to R2SS-P5 |
5 meters |
R1UL to R3SS |
R1UL-P1 to R3SS-P27 R1UL-P6 to R3SS-P5 |
5 meters |
R1UL to R4SS |
R1UL-P2 to R4SS-P22 R1UL-P4 to R4SS-P5 |
10 meters |
R1UL to R5SS |
R1UL-P30 to R5SS-P5 R1UL-P34 to R5SS-P29 |
10 meters |
R1UL to R6SS |
R1UL-P32 to R6SS-P5 R1UL-P35 to R6SS-P23 |
10 meters |
R1UL to R7SS |
R1UL-P33 to R7SS-P5 R1UL-P36 to R7SS-P23 |
10 meters |
R1LL to R1SS |
R1LL-P3 to R1SS-P21 R1LL-P5 to R1SS-P13 |
3 meters |
R1LL to R2SS |
R1LL-P31 to R2SS-P13 R1LL-P33 to R2SS-P15 |
5 meters |
R1LL to R3SS |
R1LL-P2 to R3SS-P21 R1LL-P4 to R3SS-P13 |
5 meters |
R1LL to R4SS |
R1LL-P30 to R4SS-P13 R1LL-P34 to R4SS-P21 |
10 meters |
R1LL to R5SS |
R1LL-P7 to R5SS-P13 R1LL-P35 to R5SS-P21 |
10 meters |
R1LL to R6SS |
R1LL-P32 to R6SS-P13 R1LL-P36 to R6SS-P21 |
10 meters |
R1LL to R7SS |
R1LL-P1 to R7SS-P21 R1LL-P6 to R7SS-P13 |
10 meters |
Table 22-27 Leaf Switch Connections for the Second Rack in a Seven-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R2UL to R1SS |
R2UL-P3 to R1SS-P28 R2UL-P5 to R1SS-P6 |
5 meters |
R2UL to R2SS |
R2UL-P31 to R2SS-P6 R2UL-P34 to R2SS-P28 |
3 meters |
R2UL to R3SS |
R2UL-P6 to R3SS-P6 R2UL-P30 to R3SS-P8 |
5 meters |
R2UL to R4SS |
R2UL-P2 to R4SS-P28 R2UL-P4 to R4SS-P6 |
5 meters |
R2UL to R5SS |
R2UL-P1 to R5SS-P28 R2UL-P7 to R5SS-P6 |
10 meters |
R2UL to R6SS |
R2UL-P33 to R6SS-P6 R2UL-P35 to R6SS-P28 |
10 meters |
R2UL to R7SS |
R2UL-P32 to R7SS-P6 R2UL-P36 to R7SS-P28 |
10 meters |
R2LL to R1SS |
R2LL-P3 to R1SS-P22 R2LL-P5 to R1SS-P14 |
5 meters |
R2LL to R2SS |
R2LL-P2 to R2SS-P22 R2LL-P31 to R2SS-P14 |
3 meters |
R2LL to R3SS |
R2LL-P1 to R3SS-P22 R2LL-P6 to R3SS-P14 |
5 meters |
R2LL to R4SS |
R2LL-P4 to R4SS-P14 R2LL-P30 to R4SS-P16 |
5 meters |
R2LL to R5SS |
R2LL-P33 to R5SS-P14 R2LL-P35 to R5SS-P22 |
10 meters |
R2LL to R6SS |
R2LL-P7 to R6SS-P14 R2LL-P36 to R6SS-P22 |
10 meters |
R2LL to R7SS |
R2LL-P32 to R7SS-P14 R2LL-P34 to R7SS-P22 |
10 meters |
Table 22-28 Leaf Switch Connections for the Third Rack in a Seven-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R3UL to R1SS |
R3UL-P3 to R1SS-P25 R3UL-P5 to R1SS-P11 |
5 meters |
R3UL to R2SS |
R3UL-P2 to R2SS-P25 R3UL-P6 to R2SS-P11 |
5 meters |
R3UL to R3SS |
R3UL-P30 to R3SS-P11 R3UL-P34 to R3SS-P25 |
3 meters |
R3UL to R4SS |
R3UL-P1 to R4SS-P25 R3UL-P4 to R4SS-P11 |
5 meters |
R3UL to R5SS |
R3UL-P32 to R5SS-P11 R3UL-P33 to R5SS-P12 |
5 meters |
R3UL to R6SS |
R3UL-P7 to R6SS-P11 R3UL-P36 to R6SS-P32 |
10 meters |
R3UL to R7SS |
R3UL-P31 to R7SS-P11 R3UL-P35 to R7SS-P12 |
10 meters |
R3LL to R1SS |
R3LL-P2 to R1SS-P32 R3LL-P4 to R1SS-P20 |
5 meters |
R3LL to R2SS |
R3LL-P1 to R2SS-P32 R3LL-P31 to R2SS-P20 |
5 meters |
R3LL to R3SS |
R3LL-P32 to R3SS-P20 R3LL-P34 to R3SS-P32 |
3 meters |
R3LL to R4SS |
R3LL-P33 to R4SS-P20 R3LL-P35 to R4SS-P32 |
5 meters |
R3LL to R5SS |
R3LL-P3 to R5SS-P32 R3LL-P5 to R5SS-P20 |
5 meters |
R3LL to R6SS |
R3LL-P6 to R6SS-P19 R3LL-P30 to R6SS-P20 |
10 meters |
R3LL to R7SS |
R3LL-P7 to R7SS-P20 R3LL-P36 to R7SS-P32 |
10 meters |
Table 22-29 Leaf Switch Connections for the Fourth Rack in a Seven-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R4UL to R1SS |
R4UL-P3 to R1SS-P31 R4UL-P7 to R1SS-P10 |
10 meters |
R4UL to R2SS |
R4UL-P4 to R2SS-P9 R4UL-P6 to R2SS-P10 |
5 meters |
R4UL to R3SS |
R4UL-P1 to R3SS-P31 R4UL-P33 to R3SS-P10 |
5 meters |
R4UL to R4SS |
R4UL-P32 to R4SS-P10 R4UL-P34 to R4SS-P31 |
3 meters |
R4UL to R5SS |
R4UL-P2 to R5SS-P31 R4UL-P5 to R5SS-P10 |
5 meters |
R4UL to R6SS |
R4UL-P30 to R6SS-P10 R4UL-P35 to R6SS-P31 |
5 meters |
R4UL to R7SS |
R4UL-P31 to R7SS-P10 R4UL-P36 to R7SS-P31 |
10 meters |
R4LL to R1SS |
R4LL-P3 to R1SS-P27 R4LL-P5 to R1SS-P17 |
10 meters |
R4LL to R2SS |
R4LL-P2 to R2SS-P27 R4LL-P4 to R2SS-P17 |
5 meters |
R4LL to R3SS |
R4LL-P31 to R3SS-P17 R4LL-P33 to R3SS-P18 |
5 meters |
R4LL to R4SS |
R4LL-P30 to R4SS-P17 R4LL-P34 to R4SS-P27 |
3 meters |
R4LL to R5SS |
R4LL-P1 to R5SS-P27 R4LL-P7 to R5SS-P17 |
5 meters |
R4LL to R6SS |
R4LL-P6 to R6SS-P17 R4LL-P35 to R6SS-P27 |
5 meters |
R4LL to R7SS |
R4LL-P32 to R7SS-P17 R4LL-P36 to R7SS-P27 |
10 meters |
Table 22-30 Leaf Switch Connections for the Fifth Rack in a Seven-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R5UL to R1SS |
R5UL-P3 to R1SS-P24 R5UL-P5 to R1SS-P8 |
10 meters |
R5UL to R2SS |
R5UL-P2 to R2SS-P24 R5UL-P4 to R2SS-P8 |
10 meters |
R5UL to R3SS |
R5UL-P1 to R3SS-P24 R5UL-P6 to R3SS-P12 |
5 meters |
R5UL to R4SS |
R5UL-P31 to R4SS-P7 R5UL-P33 to R4SS-P12 |
5 meters |
R5UL to R5SS |
R5UL-P30 to R5SS-P7 R5UL-P34 to R5SS-P25 |
3 meters |
R5UL to R6SS |
R5UL-P7 to R6SS-P7 R5UL-P35 to R6SS-P25 |
5 meters |
R5UL to R7SS |
R5UL-P32 to R7SS-P7 R5UL-P36 to R7SS-P25 |
5 meters |
R5LL to R1SS |
R5LL-P3 to R1SS-P29 R5LL-P7 to R1SS-P18 |
10 meters |
R5LL to R2SS |
R5LL-P2 to R2SS-P29 R5LL-P6 to R2SS-P18 |
10 meters |
R5LL to R3SS |
R5LL-P31 to R3SS-P16 R5LL-P34 to R3SS-P29 |
5 meters |
R5LL to R4SS |
R5LL-P33 to R4SS-P19 R5LL-P35 to R4SS-P29 |
5 meters |
R5LL to R5SS |
R5LL-P30 to R5SS-P15 R5LL-P32 to R5SS-P19 |
3 meters |
R5LL to R6SS |
R5LL-P1 to R6SS-P29 R5LL-P4 to R6SS-P15 |
5 meters |
R5LL to R7SS |
R5LL-P5 to R7SS-P15 R5LL-P36 to R7SS-P29 |
5 meters |
Table 22-31 Leaf Switch Connections for the Sixth Rack in a Seven-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R6UL to R1SS |
R6UL-P3 to R1SS-P23 R6UL-P7 to R1SS-P16 |
10 meters |
R6UL to R2SS |
R6UL-P2 to R2SS-P23 R6UL-P4 to R2SS-P16 |
10 meters |
R6UL to R3SS |
R6UL-P1 to R3SS-P23 R6UL-P6 to R3SS-P19 |
10 meters |
R6UL to R4SS |
R6UL-P31 to R4SS-P15 R6UL-P34 to R4SS-P23 |
5 meters |
R6UL to R5SS |
R6UL-P33 to R5SS-P18 R6UL-P35 to R5SS-P23 |
5 meters |
R6UL to R6SS |
R6UL-P30 to R6SS-P16 R6UL-P32 to R6SS-P18 |
3 meters |
R6UL to R7SS |
R6UL-P5 to R7SS-P16 R6UL-P36 to R7SS-P26 |
5 meters |
R6LL to R1SS |
R6LL-P5 to R1SS-P12 R6LL-P7 to R1SS-P15 |
10 meters |
R6LL to R2SS |
R6LL-P2 to R2SS-P31 R6LL-P4 to R2SS-P12 |
10 meters |
R6LL to R3SS |
R6LL-P3 to R3SS-P28 R6LL-P31 to R3SS-P7 |
10 meters |
R6LL to R4SS |
R6LL-P33 to R4SS-P9 R6LL-P34 to R4SS-P24 |
5 meters |
R6LL to R5SS |
R6LL-P30 to R5SS-P8 R6LL-P35 to R5SS-P24 |
5 meters |
R6LL to R6SS |
R6LL-P32 to R6SS-P8 R6LL-P36 to R6SS-P24 |
3 meters |
R6LL to R7SS |
R6LL-P1 to R7SS-P24 R6LL-P6 to R7SS-P8 |
5 meters |
Table 22-32 Leaf Switch Connections for the Seventh Rack in a Seven-Rack System
Switch Pair | Connections | Cable Length |
---|---|---|
R7UL to R1SS |
R7UL-P3 to R1SS-P30 R7UL-P5 to R1SS-P9 |
10 meters |
R7UL to R2SS |
R7UL-P1 to R2SS-P30 R7UL-P7 to R2SS-P7 |
10 meters |
R7UL to R3SS |
R7UL-P2 to R3SS-P30 R7UL-P4 to R3SS-P9 |
10 meters |
R7UL to R4SS |
R7UL-P6 to R4SS-P8 R7UL-P34 to R4SS-P30 |
10 meters |
R7UL to R5SS |
R7UL-P31 to R5SS-P9 R7UL-P35 to R5SS-P30 |
5 meters |
R7UL to R6SS |
R7UL-P33 to R6SS-P9 R7UL-P36 to R6SS-P30 |
5 meters |
R7UL to R7SS |
R7UL-P30 to R7SS-P9 R7UL-P32 to R7SS-P30 |
3 meters |
R7LL to R1SS |
R7LL-P3 to R1SS-P26 R7LL-P5 to R1SS-P19 |
10 meters |
R7LL to R2SS |
R7LL-P1 to R2SS-P26 R7LL-P7 to R2SS-P19 |
10 meters |
R7LL to R3SS |
R7LL-P2 to R3SS-P26 R7LL-P4 to R3SS-P15 |
10 meters |
R7LL to R4SS |
R7LL-P6 to R4SS-P18 R7LL-P34 to R4SS-P26 |
10 meters |
R7LL to R5SS |
R7LL-P31 to R5SS-P16 R7LL-P35 to R5SS-P26 |
5 meters |
R7LL to R6SS |
R7LL-P33 to R6SS-P12 R7LL-P36 to R6SS-P26 |
5 meters |
R7LL to R7SS |
R7LL-P30 to R7SS-P18 R7LL-P32 to R7SS-P19 |
3 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-33 Seven-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R1UL-P7 | 3 meters |
R1SS-P8 | R5UL-P5 | 10 meters |
R1SS-P9 | R7UL-P5 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R6LL-P5 | 10 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R6LL-P7 | 10 meters |
R1SS-P16 | R6UL-P7 | 10 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R5LL-P7 | 10 meters |
R1SS-P19 | R7LL-P5 | 10 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R1LL-P3 | 3 meters |
R1SS-P22 | R2LL-P3 | 5 meters |
R1SS-P23 | R6UL-P3 | 10 meters |
R1SS-P24 | R5UL-P3 | 10 meters |
R1SS-P25 | R3UL-P3 | 5 meters |
R1SS-P26 | R7LL-P3 | 10 meters |
R1SS-P27 | R4LL-P3 | 10 meters |
R1SS-P28 | R2UL-P3 | 5 meters |
R1SS-P29 | R5LL-P3 | 10 meters |
R1SS-P30 | R7UL-P3 | 10 meters |
R1SS-P31 | R4UL-P3 | 10 meters |
R1SS-P32 | R3LL-P2 | 5 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R7UL-P7 | 10 meters |
R2SS-P8 | R5UL-P4 | 10 meters |
R2SS-P9 | R4UL-P4 | 5 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R6LL-P4 | 10 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R1LL-P33 | 5 meters |
R2SS-P16 | R6UL-P4 | 10 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R5LL-P6 | 10 meters |
R2SS-P19 | R7LL-P7 | 10 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R1UL-P3 | 5 meters |
R2SS-P22 | R2LL-P2 | 3 meters |
R2SS-P23 | R6UL-P2 | 10 meters |
R2SS-P24 | R5UL-P2 | 10 meters |
R2SS-P25 | R3UL-P2 | 5 meters |
R2SS-P26 | R7LL-P1 | 10 meters |
R2SS-P27 | R4LL-P2 | 5 meters |
R2SS-P28 | R2UL-P34 | 3 meters |
R2SS-P29 | R5LL-P2 | 10 meters |
R2SS-P30 | R7UL-P1 | 10 meters |
R2SS-P31 | R6LL-P2 | 10 meters |
R2SS-P32 | R3LL-P1 | 5 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R6LL-P31 | 10 meters |
R3SS-P8 | R2UL-P30 | 5 meters |
R3SS-P9 | R7UL-P4 | 10 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R5UL-P6 | 5 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R7LL-P4 | 10 meters |
R3SS-P16 | R5LL-P31 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R4LL-P33 | 5 meters |
R3SS-P19 | R6UL-P6 | 10 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R1LL-P2 | 5 meters |
R3SS-P22 | R2LL-P1 | 5 meters |
R3SS-P23 | R6UL-P1 | 10 meters |
R3SS-P24 | R5UL-P1 | 5 meters |
R3SS-P25 | R3UL-P34 | 3 meters |
R3SS-P26 | R7LL-P2 | 10 meters |
R3SS-P27 | R1UL-P1 | 5 meters |
R3SS-P28 | R6LL-P3 | 10 meters |
R3SS-P29 | R5LL-P34 | 5 meters |
R3SS-P30 | R7UL-P2 | 10 meters |
R3SS-P31 | R4UL-P1 | 5 meters |
R3SS-P32 | R3LL-P34 | 3 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R5UL-P31 | 5 meters |
R4SS-P8 | R7UL-P6 | 10 meters |
R4SS-P9 | R6LL-P33 | 5 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R5UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R6UL-P31 | 5 meters |
R4SS-P16 | R2LL-P30 | 5 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R7LL-P6 | 10 meters |
R4SS-P19 | R5LL-P33 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R1LL-P34 | 10 meters |
R4SS-P22 | R1UL-P2 | 10 meters |
R4SS-P23 | R6UL-P34 | 5 meters |
R4SS-P24 | R6LL-P34 | 5 meters |
R4SS-P25 | R3UL-P1 | 5 meters |
R4SS-P26 | R7LL-P34 | 10 meters |
R4SS-P27 | R4LL-P34 | 3 meters |
R4SS-P28 | R2UL-P2 | 5 meters |
R4SS-P29 | R5LL-P35 | 5 meters |
R4SS-P30 | R7UL-P34 | 10 meters |
R4SS-P31 | R4UL-P34 | 3 meters |
R4SS-P32 | R3LL-P35 | 5 meters |
R5SS-P5 | R1UL-P30 | 10 meters |
R5SS-P6 | R2UL-P7 | 10 meters |
R5SS-P7 | R5UL-P30 | 3 meters |
R5SS-P8 | R6LL-P30 | 5 meters |
R5SS-P9 | R7UL-P31 | 5 meters |
R5SS-P10 | R4UL-P5 | 5 meters |
R5SS-P11 | R3UL-P32 | 5 meters |
R5SS-P12 | R3UL-P33 | 5 meters |
R5SS-P13 | R1LL-P7 | 10 meters |
R5SS-P14 | R2LL-P33 | 10 meters |
R5SS-P15 | R5LL-P30 | 3 meters |
R5SS-P16 | R7LL-P31 | 5 meters |
R5SS-P17 | R4LL-P7 | 5 meters |
R5SS-P18 | R6UL-P33 | 5 meters |
R5SS-P19 | R5LL-P32 | 3 meters |
R5SS-P20 | R3LL-P5 | 5 meters |
R5SS-P21 | R1LL-P35 | 10 meters |
R5SS-P22 | R2LL-P35 | 10 meters |
R5SS-P23 | R6UL-P35 | 5 meters |
R5SS-P24 | R6LL-P35 | 5 meters |
R5SS-P25 | R5UL-P34 | 3 meters |
R5SS-P26 | R7LL-P35 | 5 meters |
R5SS-P27 | R4LL-P1 | 5 meters |
R5SS-P28 | R2UL-P1 | 10 meters |
R5SS-P29 | R1UL-P34 | 10 meters |
R5SS-P30 | R7UL-P35 | 5 meters |
R5SS-P31 | R4UL-P2 | 5 meters |
R5SS-P32 | R3LL-P3 | 5 meters |
R6SS-P5 | R1UL-P32 | 10 meters |
R6SS-P6 | R2UL-P33 | 10 meters |
R6SS-P7 | R5UL-P7 | 5 meters |
R6SS-P8 | R6LL-P32 | 3 meters |
R6SS-P9 | R7UL-P33 | 5 meters |
R6SS-P10 | R4UL-P30 | 5 meters |
R6SS-P11 | R3UL-P7 | 10 meters |
R6SS-P12 | R7LL-P33 | 5 meters |
R6SS-P13 | R1LL-P32 | 10 meters |
R6SS-P14 | R2LL-P7 | 10 meters |
R6SS-P15 | R5LL-P4 | 5 meters |
R6SS-P16 | R6UL-P30 | 3 meters |
R6SS-P17 | R4LL-P6 | 5 meters |
R6SS-P18 | R6UL-P32 | 3 meters |
R6SS-P19 | R3LL-P6 | 10 meters |
R6SS-P20 | R3LL-P30 | 10 meters |
R6SS-P21 | R1LL-P36 | 10 meters |
R6SS-P22 | R2LL-P36 | 10 meters |
R6SS-P23 | R1UL-P35 | 10 meters |
R6SS-P24 | R6LL-P36 | 3 meters |
R6SS-P25 | R5UL-P35 | 5 meters |
R6SS-P26 | R7LL-P36 | 5 meters |
R6SS-P27 | R4LL-P35 | 5 meters |
R6SS-P28 | R2UL-P35 | 10 meters |
R6SS-P29 | R5LL-P1 | 5 meters |
R6SS-P30 | R7UL-P36 | 5 meters |
R6SS-P31 | R4UL-P35 | 5 meters |
R6SS-P32 | R3UL-P36 | 10 meters |
R7SS-P5 | R1UL-P33 | 10 meters |
R7SS-P6 | R2UL-P32 | 10 meters |
R7SS-P7 | R5UL-P32 | 5 meters |
R7SS-P8 | R6LL-P6 | 5 meters |
R7SS-P9 | R7UL-P30 | 3 meters |
R7SS-P10 | R4UL-P31 | 10 meters |
R7SS-P11 | R3UL-P31 | 10 meters |
R7SS-P12 | R3UL-P35 | 10 meters |
R7SS-P13 | R1LL-P6 | 10 meters |
R7SS-P14 | R2LL-P32 | 10 meters |
R7SS-P15 | R5LL-P5 | 5 meters |
R7SS-P16 | R6UL-P5 | 5 meters |
R7SS-P17 | R4LL-P32 | 10 meters |
R7SS-P18 | R7LL-P30 | 3 meters |
R7SS-P19 | R7LL-P32 | 3 meters |
R7SS-P20 | R3LL-P7 | 10 meters |
R7SS-P21 | R1LL-P1 | 10 meters |
R7SS-P22 | R2LL-P34 | 10 meters |
R7SS-P23 | R1UL-P36 | 10 meters |
R7SS-P24 | R6LL-P1 | 5 meters |
R7SS-P25 | R5UL-P36 | 5 meters |
R7SS-P26 | R6UL-P36 | 5 meters |
R7SS-P27 | R4LL-P36 | 10 meters |
R7SS-P28 | R2UL-P36 | 10 meters |
R7SS-P29 | R5LL-P36 | 5 meters |
R7SS-P30 | R7UL-P32 | 3 meters |
R7SS-P31 | R4UL-P36 | 10 meters |
R7SS-P32 | R3LL-P36 | 10 meters |
Eight-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect eight racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.
The following tables contain details for all of the RoCE Network Fabric cabling connections in an eight-rack system.
Table 22-34 Leaf Switch Connections for the First Rack in a Eight-Rack System
Connection | Cable Length |
---|---|
R1UL-P1 to R3SS-P23 | 5 meters |
R1UL-P2 to R4SS-P23 | 10 meters |
R1UL-P3 to R1SS-P23 | 3 meters |
R1UL-P4 to R4SS-P5 | 10 meters |
R1UL-P5 to R1SS-P5 | 3 meters |
R1UL-P6 to R3SS-P5 | 5 meters |
R1UL-P7 to R8SS-P5 | 10 meters |
R1UL-P30 to R5SS-P5 | 10 meters |
R1UL-P31 to R2SS-P5 | 5 meters |
R1UL-P32 to R6SS-P5 | 10 meters |
R1UL-P33 to R7SS-P5 | 10 meters |
R1UL-P34 to R2SS-P23 | 5 meters |
R1UL-P35 to R5SS-P23 | 10 meters |
R1UL-P36 to R6SS-P23 | 10 meters |
R1LL-P1 to R2SS-P24 | 5 meters |
R1LL-P2 to R3SS-P24 | 5 meters |
R1LL-P3 to R5SS-P24 | 10 meters |
R1LL-P4 to R3SS-P13 | 5 meters |
R1LL-P5 to R1SS-P13 | 3 meters |
R1LL-P6 to R7SS-P13 | 10 meters |
R1LL-P7 to R5SS-P13 | 10 meters |
R1LL-P30 to R4SS-P13 | 10 meters |
R1LL-P31 to R2SS-P13 | 5 meters |
R1LL-P32 to R6SS-P13 | 10 meters |
R1LL-P33 to R8SS-P13 | 10 meters |
R1LL-P34 to R4SS-P24 | 10 meters |
R1LL-P35 to R6SS-P24 | 10 meters |
R1LL-P36 to R7SS-P24 | 10 meters |
Table 22-35 Leaf Switch Connections for the Second Rack in a Eight-Rack System
Connection | Cable Length |
---|---|
R2UL-P1 to R5SS-P25 | 10 meters |
R2UL-P2 to R3SS-P25 | 5 meters |
R2UL-P3 to R4SS-P25 | 5 meters |
R2UL-P4 to R4SS-P6 | 5 meters |
R2UL-P5 to R1SS-P6 | 5 meters |
R2UL-P6 to R3SS-P6 | 5 meters |
R2UL-P7 to R5SS-P6 | 10 meters |
R2UL-P30 to R8SS-P6 | 10 meters |
R2UL-P31 to R2SS-P6 | 3 meters |
R2UL-P32 to R7SS-P6 | 10 meters |
R2UL-P33 to R6SS-P6 | 10 meters |
R2UL-P34 to R7SS-P25 | 10 meters |
R2UL-P35 to R6SS-P25 | 10 meters |
R2UL-P36 to R8SS-P25 | 10 meters |
R2LL-P1 to R6SS-P32 | 10 meters |
R2LL-P2 to R4SS-P32 | 5 meters |
R2LL-P3 to R1SS-P22 | 5 meters |
R2LL-P4 to R4SS-P14 | 5 meters |
R2LL-P5 to R1SS-P14 | 5 meters |
R2LL-P6 to R3SS-P14 | 5 meters |
R2LL-P7 to R6SS-P14 | 10 meters |
R2LL-P30 to R8SS-P14 | 10 meters |
R2LL-P31 to R2SS-P14 | 3 meters |
R2LL-P32 to R7SS-P14 | 10 meters |
R2LL-P33 to R5SS-P14 | 10 meters |
R2LL-P34 to R7SS-P32 | 10 meters |
R2LL-P35 to R5SS-P32 | 10 meters |
R2LL-P36 to R8SS-P32 | 10 meters |
Table 22-36 Leaf Switch Connections for the Third Rack in a Eight-Rack System
Connection | Cable Length |
---|---|
R3UL-P1 to R6SS-P31 | 10 meters |
R3UL-P2 to R2SS-P25 | 5 meters |
R3UL-P3 to R1SS-P25 | 5 meters |
R3UL-P4 to R4SS-P11 | 5 meters |
R3UL-P5 to R1SS-P11 | 5 meters |
R3UL-P6 to R2SS-P11 | 5 meters |
R3UL-P7 to R6SS-P11 | 10 meters |
R3UL-P30 to R3SS-P11 | 3 meters |
R3UL-P31 to R7SS-P11 | 10 meters |
R3UL-P32 to R5SS-P11 | 5 meters |
R3UL-P33 to R8SS-P11 | 10 meters |
R3UL-P34 to R5SS-P31 | 5 meters |
R3UL-P35 to R7SS-P31 | 10 meters |
R3UL-P36 to R8SS-P31 | 10 meters |
R3LL-P1 to R7SS-P27 | 10 meters |
R3LL-P2 to R1SS-P32 | 5 meters |
R3LL-P3 to R2SS-P32 | 5 meters |
R3LL-P4 to R1SS-P20 | 5 meters |
R3LL-P5 to R5SS-P20 | 5 meters |
R3LL-P6 to R8SS-P20 | 10 meters |
R3LL-P7 to R7SS-P20 | 10 meters |
R3LL-P30 to R6SS-P20 | 10 meters |
R3LL-P31 to R2SS-P20 | 5 meters |
R3LL-P32 to R3SS-P20 | 3 meters |
R3LL-P33 to R4SS-P20 | 5 meters |
R3LL-P34 to R3SS-P32 | 3 meters |
R3LL-P35 to R6SS-P27 | 10 meters |
R3LL-P36 to R8SS-P27 | 10 meters |
Table 22-37 Leaf Switch Connections for the Fourth Rack in a Eight-Rack System
Connection | Cable Length |
---|---|
R4UL-P1 to R8SS-P23 | 10 meters |
R4UL-P2 to R2SS-P31 | 5 meters |
R4UL-P3 to R1SS-P31 | 10 meters |
R4UL-P4 to R8SS-P10 | 10 meters |
R4UL-P5 to R5SS-P10 | 5 meters |
R4UL-P6 to R2SS-P10 | 5 meters |
R4UL-P7 to R1SS-P10 | 10 meters |
R4UL-P30 to R6SS-P10 | 5 meters |
R4UL-P31 to R7SS-P10 | 10 meters |
R4UL-P32 to R4SS-P10 | 3 meters |
R4UL-P33 to R3SS-P10 | 5 meters |
R4UL-P34 to R4SS-P31 | 3 meters |
R4UL-P35 to R3SS-P31 | 5 meters |
R4UL-P36 to R7SS-P23 | 10 meters |
R4LL-P1 to R5SS-P27 | 5 meters |
R4LL-P2 to R2SS-P27 | 5 meters |
R4LL-P3 to R1SS-P27 | 10 meters |
R4LL-P4 to R2SS-P17 | 5 meters |
R4LL-P5 to R1SS-P17 | 10 meters |
R4LL-P6 to R6SS-P17 | 5 meters |
R4LL-P7 to R5SS-P17 | 5 meters |
R4LL-P30 to R4SS-P17 | 3 meters |
R4LL-P31 to R3SS-P17 | 5 meters |
R4LL-P32 to R7SS-P17 | 10 meters |
R4LL-P33 to R8SS-P17 | 10 meters |
R4LL-P34 to R3SS-P27 | 5 meters |
R4LL-P35 to R4SS-P27 | 3 meters |
R4LL-P36 to R8SS-P24 | 10 meters |
Table 22-38 Leaf Switch Connections for the Fifth Rack in a Eight-Rack System
Connection | Cable Length |
---|---|
R5UL-P1 to R3SS-P28 | 5 meters |
R5UL-P2 to R2SS-P28 | 10 meters |
R5UL-P3 to R1SS-P28 | 10 meters |
R5UL-P4 to R2SS-P8 | 10 meters |
R5UL-P5 to R1SS-P8 | 10 meters |
R5UL-P6 to R3SS-P8 | 5 meters |
R5UL-P7 to R6SS-P7 | 5 meters |
R5UL-P30 to R5SS-P7 | 3 meters |
R5UL-P31 to R8SS-P7 | 10 meters |
R5UL-P32 to R7SS-P7 | 5 meters |
R5UL-P33 to R4SS-P12 | 5 meters |
R5UL-P34 to R4SS-P28 | 5 meters |
R5UL-P35 to R5SS-P28 | 3 meters |
R5UL-P36 to R6SS-P28 | 5 meters |
R5LL-P1 to R7SS-P22 | 5 meters |
R5LL-P2 to R6SS-P22 | 5 meters |
R5LL-P3 to R2SS-P22 | 10 meters |
R5LL-P4 to R6SS-P15 | 5 meters |
R5LL-P5 to R7SS-P15 | 5 meters |
R5LL-P6 to R2SS-P18 | 10 meters |
R5LL-P7 to R1SS-P18 | 10 meters |
R5LL-P30 to R5SS-P15 | 3 meters |
R5LL-P31 to R3SS-P16 | 5 meters |
R5LL-P32 to R8SS-P15 | 10 meters |
R5LL-P33 to R4SS-P19 | 5 meters |
R5LL-P34 to R3SS-P22 | 5 meters |
R5LL-P35 to R4SS-P22 | 5 meters |
R5LL-P36 to R5SS-P22 | 3 meters |
Table 22-39 Leaf Switch Connections for the Sixth Rack in a Eight-Rack System
Connection | Cable Length |
---|---|
R6UL-P1 to R4SS-P30 | 5 meters |
R6UL-P2 to R3SS-P30 | 10 meters |
R6UL-P3 to R7SS-P30 | 5 meters |
R6UL-P4 to R2SS-P16 | 10 meters |
R6UL-P5 to R7SS-P16 | 5 meters |
R6UL-P6 to R3SS-P19 | 10 meters |
R6UL-P7 to R1SS-P16 | 10 meters |
R6UL-P30 to R6SS-P16 | 3 meters |
R6UL-P31 to R4SS-P15 | 5 meters |
R6UL-P32 to R8SS-P16 | 5 meters |
R6UL-P33 to R5SS-P18 | 5 meters |
R6UL-P34 to R5SS-P30 | 5 meters |
R6UL-P35 to R6SS-P30 | 3 meters |
R6UL-P36 to R8SS-P30 | 5 meters |
R6LL-P1 to R8SS-P26 | 5 meters |
R6LL-P2 to R7SS-P26 | 5 meters |
R6LL-P3 to R1SS-P24 | 10 meters |
R6LL-P4 to R2SS-P12 | 10 meters |
R6LL-P5 to R1SS-P12 | 10 meters |
R6LL-P6 to R7SS-P8 | 5 meters |
R6LL-P7 to R8SS-P8 | 5 meters |
R6LL-P30 to R5SS-P8 | 5 meters |
R6LL-P31 to R3SS-P7 | 10 meters |
R6LL-P32 to R6SS-P8 | 3 meters |
R6LL-P33 to R4SS-P9 | 5 meters |
R6LL-P34 to R4SS-P26 | 5 meters |
R6LL-P35 to R5SS-P26 | 5 meters |
R6LL-P36 to R6SS-P26 | 3 meters |
Table 22-40 Leaf Switch Connections for the Seventh Rack in a Eight-Rack System
Connection | Cable Length |
---|---|
R7UL-P1 to R2SS-P30 | 10 meters |
R7UL-P2 to R5SS-P21 | 5 meters |
R7UL-P3 to R1SS-P30 | 10 meters |
R7UL-P4 to R3SS-P9 | 10 meters |
R7UL-P5 to R1SS-P9 | 10 meters |
R7UL-P6 to R4SS-P8 | 10 meters |
R7UL-P7 to R2SS-P7 | 10 meters |
R7UL-P30 to R7SS-P9 | 3 meters |
R7UL-P31 to R5SS-P9 | 5 meters |
R7UL-P32 to R8SS-P9 | 5 meters |
R7UL-P33 to R6SS-P9 | 5 meters |
R7UL-P34 to R8SS-P21 | 5 meters |
R7UL-P35 to R6SS-P21 | 5 meters |
R7UL-P36 to R7SS-P21 | 3 meters |
R7LL-P1 to R2SS-P26 | 10 meters |
R7LL-P2 to R3SS-P26 | 10 meters |
R7LL-P3 to R1SS-P26 | 10 meters |
R7LL-P4 to R3SS-P15 | 10 meters |
R7LL-P5 to R1SS-P19 | 10 meters |
R7LL-P6 to R4SS-P18 | 10 meters |
R7LL-P7 to R2SS-P19 | 10 meters |
R7LL-P30 to R7SS-P18 | 3 meters |
R7LL-P31 to R5SS-P16 | 5 meters |
R7LL-P32 to R8SS-P12 | 5 meters |
R7LL-P33 to R6SS-P18 | 5 meters |
R7LL-P34 to R6SS-P29 | 5 meters |
R7LL-P35 to R7SS-P29 | 3 meters |
R7LL-P36 to R8SS-P29 | 5 meters |
Table 22-41 Leaf Switch Connections for the Eighth Rack in a Eight-Rack System
Connection | Cable Length |
---|---|
R8UL-P1 to R2SS-P21 | 10 meters |
R8UL-P2 to R3SS-P21 | 10 meters |
R8UL-P3 to R1SS-P21 | 10 meters |
R8UL-P4 to R3SS-P18 | 10 meters |
R8UL-P5 to R1SS-P15 | 10 meters |
R8UL-P6 to R4SS-P16 | 10 meters |
R8UL-P7 to R2SS-P15 | 10 meters |
R8UL-P30 to R7SS-P19 | 5 meters |
R8UL-P31 to R5SS-P19 | 10 meters |
R8UL-P32 to R8SS-P19 | 3 meters |
R8UL-P33 to R6SS-P19 | 5 meters |
R8UL-P34 to R7SS-P28 | 5 meters |
R8UL-P35 to R8SS-P28 | 3 meters |
R8UL-P36 to R4SS-P21 | 10 meters |
R8LL-P1 to R2SS-P29 | 10 meters |
R8LL-P2 to R3SS-P29 | 10 meters |
R8LL-P3 to R1SS-P29 | 10 meters |
R8LL-P4 to R3SS-P12 | 10 meters |
R8LL-P5 to R1SS-P7 | 10 meters |
R8LL-P6 to R4SS-P7 | 10 meters |
R8LL-P7 to R2SS-P9 | 10 meters |
R8LL-P30 to R7SS-P12 | 5 meters |
R8LL-P31 to R5SS-P12 | 10 meters |
R8LL-P32 to R8SS-P18 | 3 meters |
R8LL-P33 to R6SS-P12 | 5 meters |
R8LL-P34 to R8SS-P22 | 3 meters |
R8LL-P35 to R5SS-P29 | 10 meters |
R8LL-P36 to R4SS-P29 | 10 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-42 Eight-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R8LL-P5 | 10 meters |
R1SS-P8 | R5UL-P5 | 10 meters |
R1SS-P9 | R7UL-P5 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R6LL-P5 | 10 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R8UL-P5 | 10 meters |
R1SS-P16 | R6UL-P7 | 10 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R5LL-P7 | 10 meters |
R1SS-P19 | R7LL-P5 | 10 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R8UL-P3 | 10 meters |
R1SS-P22 | R2LL-P3 | 5 meters |
R1SS-P23 | R1UL-P3 | 3 meters |
R1SS-P24 | R6LL-P3 | 10 meters |
R1SS-P25 | R3UL-P3 | 5 meters |
R1SS-P26 | R7LL-P3 | 10 meters |
R1SS-P27 | R4LL-P3 | 10 meters |
R1SS-P28 | R5UL-P3 | 10 meters |
R1SS-P29 | R8LL-P3 | 10 meters |
R1SS-P30 | R7UL-P3 | 10 meters |
R1SS-P31 | R4UL-P3 | 10 meters |
R1SS-P32 | R3LL-P2 | 5 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R7UL-P7 | 10 meters |
R2SS-P8 | R5UL-P4 | 10 meters |
R2SS-P9 | R8LL-P7 | 10 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R6LL-P4 | 10 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R8UL-P7 | 10 meters |
R2SS-P16 | R6UL-P4 | 10 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R5LL-P6 | 10 meters |
R2SS-P19 | R7LL-P7 | 10 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R8UL-P1 | 10 meters |
R2SS-P22 | R5LL-P3 | 10 meters |
R2SS-P23 | R1UL-P34 | 5 meters |
R2SS-P24 | R1LL-P1 | 5 meters |
R2SS-P25 | R3UL-P2 | 5 meters |
R2SS-P26 | R7LL-P1 | 10 meters |
R2SS-P27 | R4LL-P2 | 5 meters |
R2SS-P28 | R5UL-P2 | 10 meters |
R2SS-P29 | R8LL-P1 | 10 meters |
R2SS-P30 | R7UL-P1 | 10 meters |
R2SS-P31 | R4UL-P2 | 5 meters |
R2SS-P32 | R3LL-P3 | 5 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R6LL-P31 | 10 meters |
R3SS-P8 | R5UL-P6 | 5 meters |
R3SS-P9 | R7UL-P4 | 10 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R8LL-P4 | 10 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R7LL-P4 | 10 meters |
R3SS-P16 | R5LL-P31 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R8UL-P4 | 10 meters |
R3SS-P19 | R6UL-P6 | 10 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R8UL-P2 | 10 meters |
R3SS-P22 | R5LL-P34 | 5 meters |
R3SS-P23 | R1UL-P1 | 5 meters |
R3SS-P24 | R1LL-P2 | 5 meters |
R3SS-P25 | R2UL-P2 | 5 meters |
R3SS-P26 | R7LL-P2 | 10 meters |
R3SS-P27 | R4LL-P34 | 5 meters |
R3SS-P28 | R5UL-P1 | 5 meters |
R3SS-P29 | R8LL-P2 | 10 meters |
R3SS-P30 | R6UL-P2 | 10 meters |
R3SS-P31 | R4UL-P35 | 5 meters |
R3SS-P32 | R3LL-P34 | 3 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R8LL-P6 | 10 meters |
R4SS-P8 | R7UL-P6 | 10 meters |
R4SS-P9 | R6LL-P33 | 5 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R5UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R6UL-P31 | 5 meters |
R4SS-P16 | R8UL-P6 | 10 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R7LL-P6 | 10 meters |
R4SS-P19 | R5LL-P33 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R8UL-P36 | 10 meters |
R4SS-P22 | R5LL-P35 | 5 meters |
R4SS-P23 | R1UL-P2 | 10 meters |
R4SS-P24 | R1LL-P34 | 10 meters |
R4SS-P25 | R2UL-P3 | 5 meters |
R4SS-P26 | R6LL-P34 | 5 meters |
R4SS-P27 | R4LL-P35 | 3 meters |
R4SS-P28 | R5UL-P34 | 5 meters |
R4SS-P29 | R8LL-P36 | 10 meters |
R4SS-P30 | R6UL-P1 | 5 meters |
R4SS-P31 | R4UL-P34 | 3 meters |
R4SS-P32 | R2LL-P2 | 5 meters |
R5SS-P5 | R1UL-P30 | 10 meters |
R5SS-P6 | R2UL-P7 | 10 meters |
R5SS-P7 | R5UL-P30 | 3 meters |
R5SS-P8 | R6LL-P30 | 5 meters |
R5SS-P9 | R7UL-P31 | 5 meters |
R5SS-P10 | R4UL-P5 | 5 meters |
R5SS-P11 | R3UL-P32 | 5 meters |
R5SS-P12 | R8LL-P31 | 10 meters |
R5SS-P13 | R1LL-P7 | 10 meters |
R5SS-P14 | R2LL-P33 | 10 meters |
R5SS-P15 | R5LL-P30 | 3 meters |
R5SS-P16 | R7LL-P31 | 5 meters |
R5SS-P17 | R4LL-P7 | 5 meters |
R5SS-P18 | R6UL-P33 | 5 meters |
R5SS-P19 | R8UL-P31 | 10 meters |
R5SS-P20 | R3LL-P5 | 5 meters |
R5SS-P21 | R7UL-P2 | 5 meters |
R5SS-P22 | R5LL-P36 | 3 meters |
R5SS-P23 | R1UL-P35 | 10 meters |
R5SS-P24 | R1LL-P3 | 10 meters |
R5SS-P25 | R2UL-P1 | 10 meters |
R5SS-P26 | R6LL-P35 | 5 meters |
R5SS-P27 | R4LL-P1 | 5 meters |
R5SS-P28 | R5UL-P35 | 3 meters |
R5SS-P29 | R8LL-P35 | 10 meters |
R5SS-P30 | R6UL-P34 | 5 meters |
R5SS-P31 | R3UL-P34 | 5 meters |
R5SS-P32 | R2LL-P35 | 10 meters |
R6SS-P5 | R1UL-P32 | 10 meters |
R6SS-P6 | R2UL-P33 | 10 meters |
R6SS-P7 | R5UL-P7 | 5 meters |
R6SS-P8 | R6LL-P32 | 3 meters |
R6SS-P9 | R7UL-P33 | 5 meters |
R6SS-P10 | R4UL-P30 | 5 meters |
R6SS-P11 | R3UL-P7 | 10 meters |
R6SS-P12 | R8LL-P33 | 5 meters |
R6SS-P13 | R1LL-P32 | 10 meters |
R6SS-P14 | R2LL-P7 | 10 meters |
R6SS-P15 | R5LL-P4 | 5 meters |
R6SS-P16 | R6UL-P30 | 3 meters |
R6SS-P17 | R4LL-P6 | 5 meters |
R6SS-P18 | R7LL-P33 | 5 meters |
R6SS-P19 | R8UL-P33 | 5 meters |
R6SS-P20 | R3LL-P30 | 10 meters |
R6SS-P21 | R7UL-P35 | 5 meters |
R6SS-P22 | R5LL-P2 | 5 meters |
R6SS-P23 | R1UL-P36 | 10 meters |
R6SS-P24 | R1LL-P35 | 10 meters |
R6SS-P25 | R2UL-P35 | 10 meters |
R6SS-P26 | R6LL-P36 | 3 meters |
R6SS-P27 | R3LL-P35 | 10 meters |
R6SS-P28 | R5UL-P36 | 5 meters |
R6SS-P29 | R7LL-P34 | 5 meters |
R6SS-P30 | R6UL-P35 | 3 meters |
R6SS-P31 | R3UL-P1 | 10 meters |
R6SS-P32 | R2LL-P1 | 10 meters |
R7SS-P5 | R1UL-P33 | 10 meters |
R7SS-P6 | R2UL-P32 | 10 meters |
R7SS-P7 | R5UL-P32 | 5 meters |
R7SS-P8 | R6LL-P6 | 5 meters |
R7SS-P9 | R7UL-P30 | 3 meters |
R7SS-P10 | R4UL-P31 | 10 meters |
R7SS-P11 | R3UL-P31 | 10 meters |
R7SS-P12 | R8LL-P30 | 5 meters |
R7SS-P13 | R1LL-P6 | 10 meters |
R7SS-P14 | R2LL-P32 | 10 meters |
R7SS-P15 | R5LL-P5 | 5 meters |
R7SS-P16 | R6UL-P5 | 5 meters |
R7SS-P17 | R4LL-P32 | 10 meters |
R7SS-P18 | R7LL-P30 | 3 meters |
R7SS-P19 | R8UL-P30 | 5 meters |
R7SS-P20 | R3LL-P7 | 10 meters |
R7SS-P21 | R7UL-P36 | 3 meters |
R7SS-P22 | R5LL-P1 | 5 meters |
R7SS-P23 | R4UL-P36 | 10 meters |
R7SS-P24 | R1LL-P36 | 10 meters |
R7SS-P25 | R2UL-P34 | 10 meters |
R7SS-P26 | R6LL-P2 | 5 meters |
R7SS-P27 | R3LL-P1 | 10 meters |
R7SS-P28 | R8UL-P34 | 5 meters |
R7SS-P29 | R7LL-P35 | 3 meters |
R7SS-P30 | R6UL-P3 | 5 meters |
R7SS-P31 | R3UL-P35 | 10 meters |
R7SS-P32 | R2LL-P34 | 10 meters |
R8SS-P5 | R1UL-P7 | 10 meters |
R8SS-P6 | R2UL-P30 | 10 meters |
R8SS-P7 | R5UL-P31 | 10 meters |
R8SS-P8 | R6LL-P7 | 5 meters |
R8SS-P9 | R7UL-P32 | 5 meters |
R8SS-P10 | R4UL-P4 | 10 meters |
R8SS-P11 | R3UL-P33 | 10 meters |
R8SS-P12 | R7LL-P32 | 5 meters |
R8SS-P13 | R1LL-P33 | 10 meters |
R8SS-P14 | R2LL-P30 | 10 meters |
R8SS-P15 | R5LL-P32 | 10 meters |
R8SS-P16 | R6UL-P32 | 5 meters |
R8SS-P17 | R4LL-P33 | 10 meters |
R8SS-P18 | R8LL-P32 | 3 meters |
R8SS-P19 | R8UL-P32 | 3 meters |
R8SS-P20 | R3LL-P6 | 10 meters |
R8SS-P21 | R7UL-P34 | 5 meters |
R8SS-P22 | R8LL-P34 | 3 meters |
R8SS-P23 | R4UL-P1 | 10 meters |
R8SS-P24 | R4LL-P36 | 10 meters |
R8SS-P25 | R2UL-P36 | 10 meters |
R8SS-P26 | R6LL-P1 | 5 meters |
R8SS-P27 | R3LL-P36 | 10 meters |
R8SS-P28 | R8UL-P35 | 3 meters |
R8SS-P29 | R7LL-P36 | 5 meters |
R8SS-P30 | R6UL-P36 | 5 meters |
R8SS-P31 | R3UL-P36 | 10 meters |
R8SS-P32 | R2LL-P36 | 10 meters |
Nine-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect nine racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, for these systems only, ignore the connections to port number 30 on every leaf switch in the following tables. This adjustment leaves only 13 inter-switch links on each leaf switch and only applies to X9M-8 systems with three database servers and 11 storage servers.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a 9 rack system.
Table 22-43 Leaf Switch Connections for the First Rack in a 9 Rack System
Connection | Cable Length |
---|---|
R1UL-P1 to R3SS-P23 | 5 meters |
R1UL-P2 to R4SS-P23 | 10 meters |
R1UL-P3 to R1SS-P23 | 3 meters |
R1UL-P4 to R4SS-P5 | 10 meters |
R1UL-P5 to R1SS-P5 | 3 meters |
R1UL-P6 to R3SS-P5 | 5 meters |
R1UL-P7 to R8SS-P5 | 10 meters |
R1UL-P30 to R5SS-P5 | 10 meters |
R1UL-P31 to R2SS-P5 | 5 meters |
R1UL-P32 to R6SS-P5 | 10 meters |
R1UL-P33 to R7SS-P5 | 10 meters |
R1UL-P34 to R2SS-P23 | 5 meters |
R1UL-P35 to R5SS-P23 | 10 meters |
R1UL-P36 to R9SS-P5 | 10 meters |
R1LL-P1 to R2SS-P25 | 5 meters |
R1LL-P2 to R3SS-P25 | 5 meters |
R1LL-P3 to R5SS-P25 | 10 meters |
R1LL-P4 to R3SS-P13 | 5 meters |
R1LL-P5 to R1SS-P13 | 3 meters |
R1LL-P6 to R7SS-P13 | 10 meters |
R1LL-P7 to R5SS-P13 | 10 meters |
R1LL-P30 to R4SS-P13 | 10 meters |
R1LL-P31 to R2SS-P13 | 5 meters |
R1LL-P32 to R6SS-P13 | 10 meters |
R1LL-P33 to R8SS-P13 | 10 meters |
R1LL-P34 to R4SS-P25 | 10 meters |
R1LL-P35 to R6SS-P25 | 10 meters |
R1LL-P36 to R9SS-P13 | 10 meters |
Table 22-44 Leaf Switch Connections for the Second Rack in a 9 Rack System
Connection | Cable Length |
---|---|
R2UL-P1 to R5SS-P31 | 10 meters |
R2UL-P2 to R3SS-P31 | 5 meters |
R2UL-P3 to R4SS-P31 | 5 meters |
R2UL-P4 to R4SS-P6 | 5 meters |
R2UL-P5 to R1SS-P6 | 5 meters |
R2UL-P6 to R3SS-P6 | 5 meters |
R2UL-P7 to R5SS-P6 | 10 meters |
R2UL-P30 to R8SS-P6 | 10 meters |
R2UL-P31 to R2SS-P6 | 3 meters |
R2UL-P32 to R7SS-P6 | 10 meters |
R2UL-P33 to R6SS-P6 | 10 meters |
R2UL-P34 to R7SS-P31 | 10 meters |
R2UL-P35 to R6SS-P31 | 10 meters |
R2UL-P36 to R9SS-P6 | 10 meters |
R2LL-P1 to R6SS-P27 | 10 meters |
R2LL-P2 to R4SS-P27 | 5 meters |
R2LL-P3 to R9SS-P14 | 10 meters |
R2LL-P4 to R4SS-P14 | 5 meters |
R2LL-P5 to R1SS-P14 | 5 meters |
R2LL-P6 to R3SS-P14 | 5 meters |
R2LL-P7 to R6SS-P14 | 10 meters |
R2LL-P30 to R8SS-P14 | 10 meters |
R2LL-P31 to R2SS-P14 | 3 meters |
R2LL-P32 to R7SS-P14 | 10 meters |
R2LL-P33 to R5SS-P14 | 10 meters |
R2LL-P34 to R7SS-P27 | 10 meters |
R2LL-P35 to R5SS-P27 | 10 meters |
R2LL-P36 to R8SS-P27 | 10 meters |
Table 22-45 Leaf Switch Connections for the Third Rack in a 9 Rack System
Connection | Cable Length |
---|---|
R3UL-P1 to R6SS-P28 | 10 meters |
R3UL-P2 to R9SS-P11 | 10 meters |
R3UL-P3 to R9SS-P28 | 10 meters |
R3UL-P4 to R4SS-P11 | 5 meters |
R3UL-P5 to R1SS-P11 | 5 meters |
R3UL-P6 to R2SS-P11 | 5 meters |
R3UL-P7 to R6SS-P11 | 10 meters |
R3UL-P30 to R3SS-P11 | 3 meters |
R3UL-P31 to R7SS-P11 | 10 meters |
R3UL-P32 to R5SS-P11 | 5 meters |
R3UL-P33 to R8SS-P11 | 10 meters |
R3UL-P34 to R5SS-P28 | 5 meters |
R3UL-P35 to R7SS-P28 | 10 meters |
R3UL-P36 to R8SS-P28 | 10 meters |
R3LL-P1 to R7SS-P23 | 10 meters |
R3LL-P2 to R1SS-P32 | 5 meters |
R3LL-P3 to R9SS-P20 | 10 meters |
R3LL-P4 to R1SS-P20 | 5 meters |
R3LL-P5 to R5SS-P20 | 5 meters |
R3LL-P6 to R8SS-P20 | 10 meters |
R3LL-P7 to R7SS-P20 | 10 meters |
R3LL-P30 to R6SS-P20 | 10 meters |
R3LL-P31 to R2SS-P20 | 5 meters |
R3LL-P32 to R3SS-P20 | 3 meters |
R3LL-P33 to R4SS-P20 | 5 meters |
R3LL-P34 to R9SS-P23 | 10 meters |
R3LL-P35 to R6SS-P23 | 10 meters |
R3LL-P36 to R8SS-P23 | 10 meters |
Table 22-46 Leaf Switch Connections for the Fourth Rack in a 9 Rack System
Connection | Cable Length |
---|---|
R4UL-P1 to R8SS-P25 | 10 meters |
R4UL-P2 to R2SS-P31 | 5 meters |
R4UL-P3 to R1SS-P31 | 10 meters |
R4UL-P4 to R8SS-P10 | 10 meters |
R4UL-P5 to R5SS-P10 | 5 meters |
R4UL-P6 to R2SS-P10 | 5 meters |
R4UL-P7 to R1SS-P10 | 10 meters |
R4UL-P30 to R6SS-P10 | 5 meters |
R4UL-P31 to R7SS-P10 | 10 meters |
R4UL-P32 to R4SS-P10 | 3 meters |
R4UL-P33 to R3SS-P10 | 5 meters |
R4UL-P34 to R9SS-P10 | 10 meters |
R4UL-P35 to R9SS-P25 | 10 meters |
R4UL-P36 to R7SS-P25 | 10 meters |
R4LL-P1 to R9SS-P17 | 10 meters |
R4LL-P2 to R2SS-P27 | 5 meters |
R4LL-P3 to R1SS-P27 | 10 meters |
R4LL-P4 to R2SS-P17 | 5 meters |
R4LL-P5 to R1SS-P17 | 10 meters |
R4LL-P6 to R6SS-P17 | 5 meters |
R4LL-P7 to R5SS-P17 | 5 meters |
R4LL-P30 to R4SS-P17 | 3 meters |
R4LL-P31 to R3SS-P17 | 5 meters |
R4LL-P32 to R7SS-P17 | 10 meters |
R4LL-P33 to R8SS-P17 | 10 meters |
R4LL-P34 to R3SS-P27 | 5 meters |
R4LL-P35 to R9SS-P31 | 10 meters |
R4LL-P36 to R8SS-P31 | 10 meters |
Table 22-47 Leaf Switch Connections for the Fifth Rack in a 9 Rack System
Connection | Cable Length |
---|---|
R5UL-P1 to R3SS-P28 | 5 meters |
R5UL-P2 to R2SS-P28 | 10 meters |
R5UL-P3 to R1SS-P28 | 10 meters |
R5UL-P4 to R2SS-P8 | 10 meters |
R5UL-P5 to R1SS-P8 | 10 meters |
R5UL-P6 to R3SS-P8 | 5 meters |
R5UL-P7 to R6SS-P7 | 5 meters |
R5UL-P30 to R5SS-P7 | 3 meters |
R5UL-P31 to R8SS-P7 | 10 meters |
R5UL-P32 to R7SS-P7 | 5 meters |
R5UL-P33 to R4SS-P12 | 5 meters |
R5UL-P34 to R4SS-P28 | 5 meters |
R5UL-P35 to R9SS-P7 | 10 meters |
R5UL-P36 to R9SS-P27 | 10 meters |
R5LL-P1 to R9SS-P15 | 10 meters |
R5LL-P2 to R1SS-P22 | 10 meters |
R5LL-P3 to R2SS-P22 | 10 meters |
R5LL-P4 to R6SS-P15 | 5 meters |
R5LL-P5 to R7SS-P15 | 5 meters |
R5LL-P6 to R2SS-P18 | 10 meters |
R5LL-P7 to R1SS-P18 | 10 meters |
R5LL-P30 to R5SS-P15 | 3 meters |
R5LL-P31 to R3SS-P16 | 5 meters |
R5LL-P32 to R8SS-P15 | 10 meters |
R5LL-P33 to R4SS-P19 | 5 meters |
R5LL-P34 to R3SS-P22 | 5 meters |
R5LL-P35 to R4SS-P22 | 5 meters |
R5LL-P36 to R5SS-P22 | 3 meters |
Table 22-48 Leaf Switch Connections for the Sixth Rack in a 9 Rack System
Connection | Cable Length |
---|---|
R6UL-P1 to R4SS-P32 | 5 meters |
R6UL-P2 to R3SS-P32 | 10 meters |
R6UL-P3 to R9SS-P16 | 10 meters |
R6UL-P4 to R2SS-P16 | 10 meters |
R6UL-P5 to R7SS-P16 | 5 meters |
R6UL-P6 to R3SS-P19 | 10 meters |
R6UL-P7 to R1SS-P16 | 10 meters |
R6UL-P30 to R6SS-P16 | 3 meters |
R6UL-P31 to R4SS-P15 | 5 meters |
R6UL-P32 to R8SS-P16 | 5 meters |
R6UL-P33 to R5SS-P18 | 5 meters |
R6UL-P34 to R5SS-P32 | 5 meters |
R6UL-P35 to R6SS-P32 | 3 meters |
R6UL-P36 to R2SS-P32 | 10 meters |
R6LL-P1 to R9SS-P8 | 10 meters |
R6LL-P2 to R7SS-P21 | 5 meters |
R6LL-P3 to R3SS-P21 | 10 meters |
R6LL-P4 to R2SS-P12 | 10 meters |
R6LL-P5 to R1SS-P12 | 10 meters |
R6LL-P6 to R7SS-P8 | 5 meters |
R6LL-P7 to R8SS-P8 | 5 meters |
R6LL-P30 to R5SS-P8 | 5 meters |
R6LL-P31 to R3SS-P7 | 10 meters |
R6LL-P32 to R6SS-P8 | 3 meters |
R6LL-P33 to R4SS-P9 | 5 meters |
R6LL-P34 to R4SS-P21 | 5 meters |
R6LL-P35 to R5SS-P21 | 5 meters |
R6LL-P36 to R6SS-P21 | 3 meters |
Table 22-49 Leaf Switch Connections for the Seventh Rack in a 9 Rack System
Connection | Cable Length |
---|---|
R7UL-P1 to R5SS-P26 | 5 meters |
R7UL-P2 to R9SS-P9 | 5 meters |
R7UL-P3 to R4SS-P26 | 10 meters |
R7UL-P4 to R3SS-P9 | 10 meters |
R7UL-P5 to R1SS-P9 | 10 meters |
R7UL-P6 to R4SS-P8 | 10 meters |
R7UL-P7 to R2SS-P7 | 10 meters |
R7UL-P30 to R7SS-P9 | 3 meters |
R7UL-P31 to R5SS-P9 | 5 meters |
R7UL-P32 to R8SS-P9 | 5 meters |
R7UL-P33 to R6SS-P9 | 5 meters |
R7UL-P34 to R8SS-P26 | 5 meters |
R7UL-P35 to R6SS-P26 | 5 meters |
R7UL-P36 to R7SS-P26 | 3 meters |
R7LL-P1 to R9SS-P12 | 5 meters |
R7LL-P2 to R9SS-P30 | 5 meters |
R7LL-P3 to R5SS-P30 | 5 meters |
R7LL-P4 to R3SS-P15 | 10 meters |
R7LL-P5 to R1SS-P19 | 10 meters |
R7LL-P6 to R4SS-P18 | 10 meters |
R7LL-P7 to R2SS-P19 | 10 meters |
R7LL-P30 to R7SS-P18 | 3 meters |
R7LL-P31 to R5SS-P16 | 5 meters |
R7LL-P32 to R8SS-P12 | 5 meters |
R7LL-P33 to R6SS-P18 | 5 meters |
R7LL-P34 to R6SS-P30 | 5 meters |
R7LL-P35 to R7SS-P30 | 3 meters |
R7LL-P36 to R8SS-P30 | 5 meters |
Table 22-50 Leaf Switch Connections for the Eighth Rack in a 9 Rack System
Connection | Cable Length |
---|---|
R8UL-P1 to R9SS-P19 | 5 meters |
R8UL-P2 to R9SS-P22 | 5 meters |
R8UL-P3 to R1SS-P25 | 10 meters |
R8UL-P4 to R3SS-P18 | 10 meters |
R8UL-P5 to R1SS-P15 | 10 meters |
R8UL-P6 to R4SS-P16 | 10 meters |
R8UL-P7 to R2SS-P15 | 10 meters |
R8UL-P30 to R7SS-P19 | 5 meters |
R8UL-P31 to R5SS-P19 | 10 meters |
R8UL-P32 to R8SS-P19 | 3 meters |
R8UL-P33 to R6SS-P19 | 5 meters |
R8UL-P34 to R7SS-P22 | 5 meters |
R8UL-P35 to R8SS-P22 | 3 meters |
R8UL-P36 to R6SS-P22 | 5 meters |
R8LL-P1 to R2SS-P21 | 10 meters |
R8LL-P2 to R9SS-P18 | 5 meters |
R8LL-P3 to R1SS-P21 | 10 meters |
R8LL-P4 to R3SS-P12 | 10 meters |
R8LL-P5 to R1SS-P7 | 10 meters |
R8LL-P6 to R4SS-P7 | 10 meters |
R8LL-P7 to R2SS-P9 | 10 meters |
R8LL-P30 to R7SS-P12 | 5 meters |
R8LL-P31 to R5SS-P12 | 10 meters |
R8LL-P32 to R8SS-P18 | 3 meters |
R8LL-P33 to R6SS-P12 | 5 meters |
R8LL-P34 to R8SS-P32 | 3 meters |
R8LL-P35 to R9SS-P32 | 5 meters |
R8LL-P36 to R7SS-P32 | 5 meters |
Table 22-51 Leaf Switch Connections for the Ninth Rack in a 9 Rack System
Connection | Cable Length |
---|---|
R9UL-P1 to R1SS-P24 | 10 meters |
R9UL-P2 to R1SS-P26 | 10 meters |
R9UL-P3 to R2SS-P24 | 10 meters |
R9UL-P4 to R2SS-P26 | 10 meters |
R9UL-P5 to R3SS-P24 | 10 meters |
R9UL-P6 to R3SS-P26 | 10 meters |
R9UL-P7 to R4SS-P24 | 10 meters |
R9UL-P30 to R5SS-P24 | 10 meters |
R9UL-P31 to R6SS-P24 | 10 meters |
R9UL-P32 to R7SS-P24 | 5 meters |
R9UL-P33 to R8SS-P21 | 5 meters |
R9UL-P34 to R8SS-P24 | 5 meters |
R9UL-P35 to R9SS-P21 | 3 meters |
R9UL-P36 to R9SS-P24 | 3 meters |
R9LL-P1 to R1SS-P29 | 10 meters |
R9LL-P2 to R1SS-P30 | 10 meters |
R9LL-P3 to R2SS-P29 | 10 meters |
R9LL-P4 to R2SS-P30 | 10 meters |
R9LL-P5 to R3SS-P29 | 10 meters |
R9LL-P6 to R3SS-P30 | 10 meters |
R9LL-P7 to R4SS-P29 | 10 meters |
R9LL-P30 to R4SS-P30 | 10 meters |
R9LL-P31 to R5SS-P29 | 10 meters |
R9LL-P32 to R6SS-P29 | 10 meters |
R9LL-P33 to R7SS-P29 | 5 meters |
R9LL-P34 to R8SS-P29 | 5 meters |
R9LL-P35 to R9SS-P26 | 3 meters |
R9LL-P36 to R9SS-P29 | 3 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-52 Nine-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R8LL-P5 | 10 meters |
R1SS-P8 | R5UL-P5 | 10 meters |
R1SS-P9 | R7UL-P5 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R6LL-P5 | 10 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R8UL-P5 | 10 meters |
R1SS-P16 | R6UL-P7 | 10 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R5LL-P7 | 10 meters |
R1SS-P19 | R7LL-P5 | 10 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R8LL-P3 | 10 meters |
R1SS-P22 | R5LL-P2 | 10 meters |
R1SS-P23 | R1UL-P3 | 3 meters |
R1SS-P24 | R9UL-P1 | 10 meters |
R1SS-P25 | R8UL-P3 | 10 meters |
R1SS-P26 | R9UL-P2 | 10 meters |
R1SS-P27 | R4LL-P3 | 10 meters |
R1SS-P28 | R5UL-P3 | 10 meters |
R1SS-P29 | R9LL-P1 | 10 meters |
R1SS-P30 | R9LL-P2 | 10 meters |
R1SS-P31 | R4UL-P3 | 10 meters |
R1SS-P32 | R3LL-P2 | 5 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R7UL-P7 | 10 meters |
R2SS-P8 | R5UL-P4 | 10 meters |
R2SS-P9 | R8LL-P7 | 10 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R6LL-P4 | 10 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R8UL-P7 | 10 meters |
R2SS-P16 | R6UL-P4 | 10 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R5LL-P6 | 10 meters |
R2SS-P19 | R7LL-P7 | 10 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R8LL-P1 | 10 meters |
R2SS-P22 | R5LL-P3 | 10 meters |
R2SS-P23 | R1UL-P34 | 5 meters |
R2SS-P24 | R9UL-P3 | 10 meters |
R2SS-P25 | R1LL-P1 | 5 meters |
R2SS-P26 | R9UL-P4 | 10 meters |
R2SS-P27 | R4LL-P2 | 5 meters |
R2SS-P28 | R5UL-P2 | 10 meters |
R2SS-P29 | R9LL-P3 | 10 meters |
R2SS-P30 | R9LL-P4 | 10 meters |
R2SS-P31 | R4UL-P2 | 5 meters |
R2SS-P32 | R6UL-P36 | 10 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R6LL-P31 | 10 meters |
R3SS-P8 | R5UL-P6 | 5 meters |
R3SS-P9 | R7UL-P4 | 10 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R8LL-P4 | 10 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R7LL-P4 | 10 meters |
R3SS-P16 | R5LL-P31 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R8UL-P4 | 10 meters |
R3SS-P19 | R6UL-P6 | 10 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R6LL-P3 | 10 meters |
R3SS-P22 | R5LL-P34 | 5 meters |
R3SS-P23 | R1UL-P1 | 5 meters |
R3SS-P24 | R9UL-P5 | 10 meters |
R3SS-P25 | R1LL-P2 | 5 meters |
R3SS-P26 | R9UL-P6 | 10 meters |
R3SS-P27 | R4LL-P34 | 5 meters |
R3SS-P28 | R5UL-P1 | 5 meters |
R3SS-P29 | R9LL-P5 | 10 meters |
R3SS-P30 | R9LL-P6 | 10 meters |
R3SS-P31 | R2UL-P2 | 5 meters |
R3SS-P32 | R6UL-P2 | 10 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R8LL-P6 | 10 meters |
R4SS-P8 | R7UL-P6 | 10 meters |
R4SS-P9 | R6LL-P33 | 5 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R5UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R6UL-P31 | 5 meters |
R4SS-P16 | R8UL-P6 | 10 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R7LL-P6 | 10 meters |
R4SS-P19 | R5LL-P33 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R6LL-P34 | 5 meters |
R4SS-P22 | R5LL-P35 | 5 meters |
R4SS-P23 | R1UL-P2 | 10 meters |
R4SS-P24 | R9UL-P7 | 10 meters |
R4SS-P25 | R1LL-P34 | 10 meters |
R4SS-P26 | R7UL-P3 | 10 meters |
R4SS-P27 | R2LL-P2 | 5 meters |
R4SS-P28 | R5UL-P34 | 5 meters |
R4SS-P29 | R9LL-P7 | 10 meters |
R4SS-P30 | R9LL-P30 | 10 meters |
R4SS-P31 | R2UL-P3 | 5 meters |
R4SS-P32 | R6UL-P1 | 5 meters |
R5SS-P5 | R1UL-P30 | 10 meters |
R5SS-P6 | R2UL-P7 | 10 meters |
R5SS-P7 | R5UL-P30 | 3 meters |
R5SS-P8 | R6LL-P30 | 5 meters |
R5SS-P9 | R7UL-P31 | 5 meters |
R5SS-P10 | R4UL-P5 | 5 meters |
R5SS-P11 | R3UL-P32 | 5 meters |
R5SS-P12 | R8LL-P31 | 10 meters |
R5SS-P13 | R1LL-P7 | 10 meters |
R5SS-P14 | R2LL-P33 | 10 meters |
R5SS-P15 | R5LL-P30 | 3 meters |
R5SS-P16 | R7LL-P31 | 5 meters |
R5SS-P17 | R4LL-P7 | 5 meters |
R5SS-P18 | R6UL-P33 | 5 meters |
R5SS-P19 | R8UL-P31 | 10 meters |
R5SS-P20 | R3LL-P5 | 5 meters |
R5SS-P21 | R6LL-P35 | 5 meters |
R5SS-P22 | R5LL-P36 | 3 meters |
R5SS-P23 | R1UL-P35 | 10 meters |
R5SS-P24 | R9UL-P30 | 10 meters |
R5SS-P25 | R1LL-P3 | 10 meters |
R5SS-P26 | R7UL-P1 | 5 meters |
R5SS-P27 | R2LL-P35 | 10 meters |
R5SS-P28 | R3UL-P34 | 5 meters |
R5SS-P29 | R9LL-P31 | 10 meters |
R5SS-P30 | R7LL-P3 | 5 meters |
R5SS-P31 | R2UL-P1 | 10 meters |
R5SS-P32 | R6UL-P34 | 5 meters |
R6SS-P5 | R1UL-P32 | 10 meters |
R6SS-P6 | R2UL-P33 | 10 meters |
R6SS-P7 | R5UL-P7 | 5 meters |
R6SS-P8 | R6LL-P32 | 3 meters |
R6SS-P9 | R7UL-P33 | 5 meters |
R6SS-P10 | R4UL-P30 | 5 meters |
R6SS-P11 | R3UL-P7 | 10 meters |
R6SS-P12 | R8LL-P33 | 5 meters |
R6SS-P13 | R1LL-P32 | 10 meters |
R6SS-P14 | R2LL-P7 | 10 meters |
R6SS-P15 | R5LL-P4 | 5 meters |
R6SS-P16 | R6UL-P30 | 3 meters |
R6SS-P17 | R4LL-P6 | 5 meters |
R6SS-P18 | R7LL-P33 | 5 meters |
R6SS-P19 | R8UL-P33 | 5 meters |
R6SS-P20 | R3LL-P30 | 10 meters |
R6SS-P21 | R6LL-P36 | 3 meters |
R6SS-P22 | R8UL-P36 | 5 meters |
R6SS-P23 | R3LL-P35 | 10 meters |
R6SS-P24 | R9UL-P31 | 10 meters |
R6SS-P25 | R1LL-P35 | 10 meters |
R6SS-P26 | R7UL-P35 | 5 meters |
R6SS-P27 | R2LL-P1 | 10 meters |
R6SS-P28 | R3UL-P1 | 10 meters |
R6SS-P29 | R9LL-P32 | 10 meters |
R6SS-P30 | R7LL-P34 | 5 meters |
R6SS-P31 | R2UL-P35 | 10 meters |
R6SS-P32 | R6UL-P35 | 3 meters |
R7SS-P5 | R1UL-P33 | 10 meters |
R7SS-P6 | R2UL-P32 | 10 meters |
R7SS-P7 | R5UL-P32 | 5 meters |
R7SS-P8 | R6LL-P6 | 5 meters |
R7SS-P9 | R7UL-P30 | 3 meters |
R7SS-P10 | R4UL-P31 | 10 meters |
R7SS-P11 | R3UL-P31 | 10 meters |
R7SS-P12 | R8LL-P30 | 5 meters |
R7SS-P13 | R1LL-P6 | 10 meters |
R7SS-P14 | R2LL-P32 | 10 meters |
R7SS-P15 | R5LL-P5 | 5 meters |
R7SS-P16 | R6UL-P5 | 5 meters |
R7SS-P17 | R4LL-P32 | 10 meters |
R7SS-P18 | R7LL-P30 | 3 meters |
R7SS-P19 | R8UL-P30 | 5 meters |
R7SS-P20 | R3LL-P7 | 10 meters |
R7SS-P21 | R6LL-P2 | 5 meters |
R7SS-P22 | R8UL-P34 | 5 meters |
R7SS-P23 | R3LL-P1 | 10 meters |
R7SS-P24 | R9UL-P32 | 5 meters |
R7SS-P25 | R4UL-P36 | 10 meters |
R7SS-P26 | R7UL-P36 | 3 meters |
R7SS-P27 | R2LL-P34 | 10 meters |
R7SS-P28 | R3UL-P35 | 10 meters |
R7SS-P29 | R9LL-P33 | 5 meters |
R7SS-P30 | R7LL-P35 | 3 meters |
R7SS-P31 | R2UL-P34 | 10 meters |
R7SS-P32 | R8LL-P36 | 5 meters |
R8SS-P5 | R1UL-P7 | 10 meters |
R8SS-P6 | R2UL-P30 | 10 meters |
R8SS-P7 | R5UL-P31 | 10 meters |
R8SS-P8 | R6LL-P7 | 5 meters |
R8SS-P9 | R7UL-P32 | 5 meters |
R8SS-P10 | R4UL-P4 | 10 meters |
R8SS-P11 | R3UL-P33 | 10 meters |
R8SS-P12 | R7LL-P32 | 5 meters |
R8SS-P13 | R1LL-P33 | 10 meters |
R8SS-P14 | R2LL-P30 | 10 meters |
R8SS-P15 | R5LL-P32 | 10 meters |
R8SS-P16 | R6UL-P32 | 5 meters |
R8SS-P17 | R4LL-P33 | 10 meters |
R8SS-P18 | R8LL-P32 | 3 meters |
R8SS-P19 | R8UL-P32 | 3 meters |
R8SS-P20 | R3LL-P6 | 10 meters |
R8SS-P21 | R9UL-P33 | 5 meters |
R8SS-P22 | R8UL-P35 | 3 meters |
R8SS-P23 | R3LL-P36 | 10 meters |
R8SS-P24 | R9UL-P34 | 5 meters |
R8SS-P25 | R4UL-P1 | 10 meters |
R8SS-P26 | R7UL-P34 | 5 meters |
R8SS-P27 | R2LL-P36 | 10 meters |
R8SS-P28 | R3UL-P36 | 10 meters |
R8SS-P29 | R9LL-P34 | 5 meters |
R8SS-P30 | R7LL-P36 | 5 meters |
R8SS-P31 | R4LL-P36 | 10 meters |
R8SS-P32 | R8LL-P34 | 3 meters |
R9SS-P5 | R1UL-P36 | 10 meters |
R9SS-P6 | R2UL-P36 | 10 meters |
R9SS-P7 | R5UL-P35 | 10 meters |
R9SS-P8 | R6LL-P1 | 10 meters |
R9SS-P9 | R7UL-P2 | 5 meters |
R9SS-P10 | R4UL-P34 | 10 meters |
R9SS-P11 | R3UL-P2 | 10 meters |
R9SS-P12 | R7LL-P1 | 5 meters |
R9SS-P13 | R1LL-P36 | 10 meters |
R9SS-P14 | R2LL-P3 | 10 meters |
R9SS-P15 | R5LL-P1 | 10 meters |
R9SS-P16 | R6UL-P3 | 10 meters |
R9SS-P17 | R4LL-P1 | 10 meters |
R9SS-P18 | R8LL-P2 | 5 meters |
R9SS-P19 | R8UL-P1 | 5 meters |
R9SS-P20 | R3LL-P3 | 10 meters |
R9SS-P21 | R9UL-P35 | 3 meters |
R9SS-P22 | R8UL-P2 | 5 meters |
R9SS-P23 | R3LL-P34 | 10 meters |
R9SS-P24 | R9UL-P36 | 3 meters |
R9SS-P25 | R4UL-P35 | 10 meters |
R9SS-P26 | R9LL-P35 | 3 meters |
R9SS-P27 | R5UL-P36 | 10 meters |
R9SS-P28 | R3UL-P3 | 10 meters |
R9SS-P29 | R9LL-P36 | 3 meters |
R9SS-P30 | R7LL-P2 | 5 meters |
R9SS-P31 | R4LL-P35 | 10 meters |
R9SS-P32 | R8LL-P35 | 5 meters |
Ten-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect ten racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, interconnecting 10 or more of these racks requires modification to the following cabling tables. Contact Oracle for further details.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a 10 rack system.
Table 22-53 Leaf Switch Connections for the First Rack in a 10 Rack System
Connection | Cable Length |
---|---|
R1UL-P1 to R3SS-P23 | 5 meters |
R1UL-P2 to R4SS-P23 | 10 meters |
R1UL-P3 to R1SS-P23 | 3 meters |
R1UL-P4 to R4SS-P5 | 10 meters |
R1UL-P5 to R1SS-P5 | 3 meters |
R1UL-P6 to R3SS-P5 | 5 meters |
R1UL-P7 to R8SS-P5 | 10 meters |
R1UL-P30 to R5SS-P5 | 10 meters |
R1UL-P31 to R2SS-P5 | 5 meters |
R1UL-P32 to R6SS-P5 | 10 meters |
R1UL-P33 to R7SS-P5 | 10 meters |
R1UL-P34 to R2SS-P23 | 5 meters |
R1UL-P35 to R10SS-P5 | 15 meters |
R1UL-P36 to R9SS-P5 | 10 meters |
R1LL-P1 to R2SS-P27 | 5 meters |
R1LL-P2 to R3SS-P27 | 5 meters |
R1LL-P3 to R5SS-P27 | 10 meters |
R1LL-P4 to R3SS-P13 | 5 meters |
R1LL-P5 to R1SS-P13 | 3 meters |
R1LL-P6 to R7SS-P13 | 10 meters |
R1LL-P7 to R5SS-P13 | 10 meters |
R1LL-P30 to R4SS-P13 | 10 meters |
R1LL-P31 to R2SS-P13 | 5 meters |
R1LL-P32 to R6SS-P13 | 10 meters |
R1LL-P33 to R8SS-P13 | 10 meters |
R1LL-P34 to R4SS-P27 | 10 meters |
R1LL-P35 to R10SS-P13 | 15 meters |
R1LL-P36 to R9SS-P13 | 10 meters |
Table 22-54 Leaf Switch Connections for the Second Rack in a 10 Rack System
Connection | Cable Length |
---|---|
R2UL-P1 to R5SS-P28 | 10 meters |
R2UL-P2 to R3SS-P28 | 5 meters |
R2UL-P3 to R4SS-P28 | 5 meters |
R2UL-P4 to R4SS-P6 | 5 meters |
R2UL-P5 to R1SS-P6 | 5 meters |
R2UL-P6 to R3SS-P6 | 5 meters |
R2UL-P7 to R5SS-P6 | 10 meters |
R2UL-P30 to R8SS-P6 | 10 meters |
R2UL-P31 to R2SS-P6 | 3 meters |
R2UL-P32 to R7SS-P6 | 10 meters |
R2UL-P33 to R6SS-P6 | 10 meters |
R2UL-P34 to R10SS-P6 | 10 meters |
R2UL-P35 to R6SS-P28 | 10 meters |
R2UL-P36 to R9SS-P6 | 10 meters |
R2LL-P1 to R6SS-P22 | 10 meters |
R2LL-P2 to R4SS-P22 | 5 meters |
R2LL-P3 to R9SS-P14 | 10 meters |
R2LL-P4 to R4SS-P14 | 5 meters |
R2LL-P5 to R1SS-P14 | 5 meters |
R2LL-P6 to R3SS-P14 | 5 meters |
R2LL-P7 to R6SS-P14 | 10 meters |
R2LL-P30 to R8SS-P14 | 10 meters |
R2LL-P31 to R2SS-P14 | 3 meters |
R2LL-P32 to R7SS-P14 | 10 meters |
R2LL-P33 to R5SS-P14 | 10 meters |
R2LL-P34 to R7SS-P22 | 10 meters |
R2LL-P35 to R5SS-P22 | 10 meters |
R2LL-P36 to R10SS-P14 | 10 meters |
Table 22-55 Leaf Switch Connections for the Third Rack in a 10 Rack System
Connection | Cable Length |
---|---|
R3UL-P1 to R6SS-P23 | 10 meters |
R3UL-P2 to R9SS-P11 | 10 meters |
R3UL-P3 to R10SS-P11 | 10 meters |
R3UL-P4 to R4SS-P11 | 5 meters |
R3UL-P5 to R1SS-P11 | 5 meters |
R3UL-P6 to R2SS-P11 | 5 meters |
R3UL-P7 to R6SS-P11 | 10 meters |
R3UL-P30 to R3SS-P11 | 3 meters |
R3UL-P31 to R7SS-P11 | 10 meters |
R3UL-P32 to R5SS-P11 | 5 meters |
R3UL-P33 to R8SS-P11 | 10 meters |
R3UL-P34 to R5SS-P23 | 5 meters |
R3UL-P35 to R7SS-P23 | 10 meters |
R3UL-P36 to R8SS-P23 | 10 meters |
R3LL-P1 to R7SS-P27 | 10 meters |
R3LL-P2 to R10SS-P20 | 10 meters |
R3LL-P3 to R9SS-P20 | 10 meters |
R3LL-P4 to R1SS-P20 | 5 meters |
R3LL-P5 to R5SS-P20 | 5 meters |
R3LL-P6 to R8SS-P20 | 10 meters |
R3LL-P7 to R7SS-P20 | 10 meters |
R3LL-P30 to R6SS-P20 | 10 meters |
R3LL-P31 to R2SS-P20 | 5 meters |
R3LL-P32 to R3SS-P20 | 3 meters |
R3LL-P33 to R4SS-P20 | 5 meters |
R3LL-P34 to R9SS-P27 | 10 meters |
R3LL-P35 to R6SS-P27 | 10 meters |
R3LL-P36 to R8SS-P27 | 10 meters |
Table 22-56 Leaf Switch Connections for the Fourth Rack in a 10 Rack System
Connection | Cable Length |
---|---|
R4UL-P1 to R8SS-P28 | 10 meters |
R4UL-P2 to R10SS-P28 | 10 meters |
R4UL-P3 to R10SS-P10 | 10 meters |
R4UL-P4 to R8SS-P10 | 10 meters |
R4UL-P5 to R5SS-P10 | 5 meters |
R4UL-P6 to R2SS-P10 | 5 meters |
R4UL-P7 to R1SS-P10 | 10 meters |
R4UL-P30 to R6SS-P10 | 5 meters |
R4UL-P31 to R7SS-P10 | 10 meters |
R4UL-P32 to R4SS-P10 | 3 meters |
R4UL-P33 to R3SS-P10 | 5 meters |
R4UL-P34 to R9SS-P10 | 10 meters |
R4UL-P35 to R9SS-P28 | 10 meters |
R4UL-P36 to R7SS-P28 | 10 meters |
R4LL-P1 to R9SS-P17 | 10 meters |
R4LL-P2 to R10SS-P17 | 10 meters |
R4LL-P3 to R1SS-P27 | 10 meters |
R4LL-P4 to R2SS-P17 | 5 meters |
R4LL-P5 to R1SS-P17 | 10 meters |
R4LL-P6 to R6SS-P17 | 5 meters |
R4LL-P7 to R5SS-P17 | 5 meters |
R4LL-P30 to R4SS-P17 | 3 meters |
R4LL-P31 to R3SS-P17 | 5 meters |
R4LL-P32 to R7SS-P17 | 10 meters |
R4LL-P33 to R8SS-P17 | 10 meters |
R4LL-P34 to R10SS-P22 | 10 meters |
R4LL-P35 to R9SS-P22 | 10 meters |
R4LL-P36 to R8SS-P22 | 10 meters |
Table 22-57 Leaf Switch Connections for the Fifth Rack in a 10 Rack System
Connection | Cable Length |
---|---|
R5UL-P1 to R10SS-P7 | 10 meters |
R5UL-P2 to R2SS-P28 | 10 meters |
R5UL-P3 to R1SS-P28 | 10 meters |
R5UL-P4 to R2SS-P8 | 10 meters |
R5UL-P5 to R1SS-P8 | 10 meters |
R5UL-P6 to R3SS-P8 | 5 meters |
R5UL-P7 to R6SS-P7 | 5 meters |
R5UL-P30 to R5SS-P7 | 3 meters |
R5UL-P31 to R8SS-P7 | 10 meters |
R5UL-P32 to R7SS-P7 | 5 meters |
R5UL-P33 to R4SS-P12 | 5 meters |
R5UL-P34 to R10SS-P23 | 10 meters |
R5UL-P35 to R9SS-P7 | 10 meters |
R5UL-P36 to R9SS-P23 | 10 meters |
R5LL-P1 to R9SS-P15 | 10 meters |
R5LL-P2 to R1SS-P22 | 10 meters |
R5LL-P3 to R2SS-P22 | 10 meters |
R5LL-P4 to R6SS-P15 | 5 meters |
R5LL-P5 to R7SS-P15 | 5 meters |
R5LL-P6 to R2SS-P18 | 10 meters |
R5LL-P7 to R1SS-P18 | 10 meters |
R5LL-P30 to R5SS-P15 | 3 meters |
R5LL-P31 to R3SS-P16 | 5 meters |
R5LL-P32 to R8SS-P15 | 10 meters |
R5LL-P33 to R4SS-P19 | 5 meters |
R5LL-P34 to R3SS-P22 | 5 meters |
R5LL-P35 to R10SS-P15 | 10 meters |
R5LL-P36 to R10SS-P27 | 10 meters |
Table 22-58 Leaf Switch Connections for the Sixth Rack in a 10 Rack System
Connection | Cable Length |
---|---|
R6UL-P1 to R4SS-P26 | 5 meters |
R6UL-P2 to R3SS-P26 | 10 meters |
R6UL-P3 to R9SS-P16 | 10 meters |
R6UL-P4 to R2SS-P16 | 10 meters |
R6UL-P5 to R7SS-P16 | 5 meters |
R6UL-P6 to R3SS-P19 | 10 meters |
R6UL-P7 to R1SS-P16 | 10 meters |
R6UL-P30 to R6SS-P16 | 3 meters |
R6UL-P31 to R4SS-P15 | 5 meters |
R6UL-P32 to R8SS-P16 | 5 meters |
R6UL-P33 to R5SS-P18 | 5 meters |
R6UL-P34 to R1SS-P26 | 10 meters |
R6UL-P35 to R10SS-P16 | 10 meters |
R6UL-P36 to R2SS-P26 | 10 meters |
R6LL-P1 to R9SS-P8 | 10 meters |
R6LL-P2 to R10SS-P8 | 10 meters |
R6LL-P3 to R3SS-P29 | 10 meters |
R6LL-P4 to R2SS-P12 | 10 meters |
R6LL-P5 to R1SS-P12 | 10 meters |
R6LL-P6 to R7SS-P8 | 5 meters |
R6LL-P7 to R8SS-P8 | 5 meters |
R6LL-P30 to R5SS-P8 | 5 meters |
R6LL-P31 to R3SS-P7 | 10 meters |
R6LL-P32 to R6SS-P8 | 3 meters |
R6LL-P33 to R4SS-P9 | 5 meters |
R6LL-P34 to R4SS-P29 | 5 meters |
R6LL-P35 to R5SS-P29 | 5 meters |
R6LL-P36 to R2SS-P29 | 10 meters |
Table 22-59 Leaf Switch Connections for the Seventh Rack in a 10 Rack System
Connection | Cable Length |
---|---|
R7UL-P1 to R5SS-P25 | 5 meters |
R7UL-P2 to R9SS-P9 | 5 meters |
R7UL-P3 to R4SS-P25 | 10 meters |
R7UL-P4 to R3SS-P9 | 10 meters |
R7UL-P5 to R1SS-P9 | 10 meters |
R7UL-P6 to R4SS-P8 | 10 meters |
R7UL-P7 to R2SS-P7 | 10 meters |
R7UL-P30 to R7SS-P9 | 3 meters |
R7UL-P31 to R5SS-P9 | 5 meters |
R7UL-P32 to R8SS-P9 | 5 meters |
R7UL-P33 to R6SS-P9 | 5 meters |
R7UL-P34 to R3SS-P25 | 10 meters |
R7UL-P35 to R6SS-P25 | 5 meters |
R7UL-P36 to R10SS-P9 | 10 meters |
R7LL-P1 to R9SS-P12 | 5 meters |
R7LL-P2 to R10SS-P12 | 10 meters |
R7LL-P3 to R5SS-P31 | 5 meters |
R7LL-P4 to R3SS-P15 | 10 meters |
R7LL-P5 to R1SS-P19 | 10 meters |
R7LL-P6 to R4SS-P18 | 10 meters |
R7LL-P7 to R2SS-P19 | 10 meters |
R7LL-P30 to R7SS-P18 | 3 meters |
R7LL-P31 to R5SS-P16 | 5 meters |
R7LL-P32 to R8SS-P12 | 5 meters |
R7LL-P33 to R6SS-P18 | 5 meters |
R7LL-P34 to R6SS-P31 | 5 meters |
R7LL-P35 to R7SS-P31 | 3 meters |
R7LL-P36 to R4SS-P31 | 10 meters |
Table 22-60 Leaf Switch Connections for the Eighth Rack in a 10 Rack System
Connection | Cable Length |
---|---|
R8UL-P1 to R9SS-P19 | 5 meters |
R8UL-P2 to R10SS-P19 | 5 meters |
R8UL-P3 to R5SS-P26 | 10 meters |
R8UL-P4 to R3SS-P18 | 10 meters |
R8UL-P5 to R1SS-P15 | 10 meters |
R8UL-P6 to R4SS-P16 | 10 meters |
R8UL-P7 to R2SS-P15 | 10 meters |
R8UL-P30 to R7SS-P19 | 5 meters |
R8UL-P31 to R5SS-P19 | 10 meters |
R8UL-P32 to R8SS-P19 | 3 meters |
R8UL-P33 to R6SS-P19 | 5 meters |
R8UL-P34 to R7SS-P26 | 5 meters |
R8UL-P35 to R8SS-P26 | 3 meters |
R8UL-P36 to R6SS-P26 | 5 meters |
R8LL-P1 to R7SS-P29 | 5 meters |
R8LL-P2 to R9SS-P18 | 5 meters |
R8LL-P3 to R6SS-P29 | 5 meters |
R8LL-P4 to R3SS-P12 | 10 meters |
R8LL-P5 to R1SS-P7 | 10 meters |
R8LL-P6 to R4SS-P7 | 10 meters |
R8LL-P7 to R2SS-P9 | 10 meters |
R8LL-P30 to R7SS-P12 | 5 meters |
R8LL-P31 to R5SS-P12 | 10 meters |
R8LL-P32 to R8SS-P18 | 3 meters |
R8LL-P33 to R6SS-P12 | 5 meters |
R8LL-P34 to R8SS-P29 | 3 meters |
R8LL-P35 to R9SS-P29 | 5 meters |
R8LL-P36 to R10SS-P18 | 5 meters |
Table 22-61 Leaf Switch Connections for the Ninth Rack in a 10 Rack System
Connection | Cable Length |
---|---|
R9UL-P1 to R1SS-P24 | 10 meters |
R9UL-P2 to R7SS-P25 | 5 meters |
R9UL-P3 to R2SS-P24 | 10 meters |
R9UL-P4 to R10SS-P24 | 5 meters |
R9UL-P5 to R3SS-P24 | 10 meters |
R9UL-P6 to R10SS-P25 | 5 meters |
R9UL-P7 to R4SS-P24 | 10 meters |
R9UL-P30 to R5SS-P24 | 10 meters |
R9UL-P31 to R6SS-P24 | 10 meters |
R9UL-P32 to R7SS-P24 | 5 meters |
R9UL-P33 to R8SS-P24 | 5 meters |
R9UL-P34 to R8SS-P25 | 5 meters |
R9UL-P35 to R9SS-P24 | 3 meters |
R9UL-P36 to R9SS-P25 | 3 meters |
R9LL-P1 to R1SS-P29 | 10 meters |
R9LL-P2 to R1SS-P30 | 10 meters |
R9LL-P3 to R2SS-P30 | 10 meters |
R9LL-P4 to R8SS-P31 | 5 meters |
R9LL-P5 to R3SS-P30 | 10 meters |
R9LL-P6 to R10SS-P30 | 5 meters |
R9LL-P7 to R4SS-P30 | 10 meters |
R9LL-P30 to R10SS-P31 | 5 meters |
R9LL-P31 to R5SS-P30 | 10 meters |
R9LL-P32 to R6SS-P30 | 10 meters |
R9LL-P33 to R7SS-P30 | 5 meters |
R9LL-P34 to R8SS-P30 | 5 meters |
R9LL-P35 to R9SS-P30 | 3 meters |
R9LL-P36 to R9SS-P31 | 3 meters |
Table 22-62 Leaf Switch Connections for the Tenth Rack in a 10 Rack System
Connection | Cable Length |
---|---|
R10UL-P1 to R1SS-P21 | 15 meters |
R10UL-P2 to R1SS-P25 | 15 meters |
R10UL-P3 to R2SS-P21 | 10 meters |
R10UL-P4 to R10SS-P21 | 3 meters |
R10UL-P5 to R3SS-P21 | 10 meters |
R10UL-P6 to R10SS-P26 | 3 meters |
R10UL-P7 to R4SS-P21 | 10 meters |
R10UL-P30 to R5SS-P21 | 10 meters |
R10UL-P31 to R6SS-P21 | 10 meters |
R10UL-P32 to R7SS-P21 | 10 meters |
R10UL-P33 to R8SS-P21 | 5 meters |
R10UL-P34 to R2SS-P25 | 10 meters |
R10UL-P35 to R9SS-P21 | 5 meters |
R10UL-P36 to R9SS-P26 | 5 meters |
R10LL-P1 to R1SS-P31 | 15 meters |
R10LL-P2 to R1SS-P32 | 15 meters |
R10LL-P3 to R2SS-P31 | 10 meters |
R10LL-P4 to R2SS-P32 | 10 meters |
R10LL-P5 to R3SS-P31 | 10 meters |
R10LL-P6 to R10SS-P29 | 3 meters |
R10LL-P7 to R4SS-P32 | 10 meters |
R10LL-P30 to R10SS-P32 | 3 meters |
R10LL-P31 to R5SS-P32 | 10 meters |
R10LL-P32 to R6SS-P32 | 10 meters |
R10LL-P33 to R7SS-P32 | 10 meters |
R10LL-P34 to R8SS-P32 | 5 meters |
R10LL-P35 to R9SS-P32 | 5 meters |
R10LL-P36 to R3SS-P32 | 10 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-63 Ten-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R8LL-P5 | 10 meters |
R1SS-P8 | R5UL-P5 | 10 meters |
R1SS-P9 | R7UL-P5 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R6LL-P5 | 10 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R8UL-P5 | 10 meters |
R1SS-P16 | R6UL-P7 | 10 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R5LL-P7 | 10 meters |
R1SS-P19 | R7LL-P5 | 10 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R10UL-P1 | 15 meters |
R1SS-P22 | R5LL-P2 | 10 meters |
R1SS-P23 | R1UL-P3 | 3 meters |
R1SS-P24 | R9UL-P1 | 10 meters |
R1SS-P25 | R10UL-P2 | 15 meters |
R1SS-P26 | R6UL-P34 | 10 meters |
R1SS-P27 | R4LL-P3 | 10 meters |
R1SS-P28 | R5UL-P3 | 10 meters |
R1SS-P29 | R9LL-P1 | 10 meters |
R1SS-P30 | R9LL-P2 | 10 meters |
R1SS-P31 | R10LL-P1 | 15 meters |
R1SS-P32 | R10LL-P2 | 15 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R7UL-P7 | 10 meters |
R2SS-P8 | R5UL-P4 | 10 meters |
R2SS-P9 | R8LL-P7 | 10 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R6LL-P4 | 10 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R8UL-P7 | 10 meters |
R2SS-P16 | R6UL-P4 | 10 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R5LL-P6 | 10 meters |
R2SS-P19 | R7LL-P7 | 10 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R10UL-P3 | 10 meters |
R2SS-P22 | R5LL-P3 | 10 meters |
R2SS-P23 | R1UL-P34 | 5 meters |
R2SS-P24 | R9UL-P3 | 10 meters |
R2SS-P25 | R10UL-P34 | 10 meters |
R2SS-P26 | R6UL-P36 | 10 meters |
R2SS-P27 | R1LL-P1 | 5 meters |
R2SS-P28 | R5UL-P2 | 10 meters |
R2SS-P29 | R6LL-P36 | 10 meters |
R2SS-P30 | R9LL-P3 | 10 meters |
R2SS-P31 | R10LL-P3 | 10 meters |
R2SS-P32 | R10LL-P4 | 10 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R6LL-P31 | 10 meters |
R3SS-P8 | R5UL-P6 | 5 meters |
R3SS-P9 | R7UL-P4 | 10 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R8LL-P4 | 10 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R7LL-P4 | 10 meters |
R3SS-P16 | R5LL-P31 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R8UL-P4 | 10 meters |
R3SS-P19 | R6UL-P6 | 10 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R10UL-P5 | 10 meters |
R3SS-P22 | R5LL-P34 | 5 meters |
R3SS-P23 | R1UL-P1 | 5 meters |
R3SS-P24 | R9UL-P5 | 10 meters |
R3SS-P25 | R7UL-P34 | 10 meters |
R3SS-P26 | R6UL-P2 | 10 meters |
R3SS-P27 | R1LL-P2 | 5 meters |
R3SS-P28 | R2UL-P2 | 5 meters |
R3SS-P29 | R6LL-P3 | 10 meters |
R3SS-P30 | R9LL-P5 | 10 meters |
R3SS-P31 | R10LL-P5 | 10 meters |
R3SS-P32 | R10LL-P36 | 10 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R8LL-P6 | 10 meters |
R4SS-P8 | R7UL-P6 | 10 meters |
R4SS-P9 | R6LL-P33 | 5 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R5UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R6UL-P31 | 5 meters |
R4SS-P16 | R8UL-P6 | 10 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R7LL-P6 | 10 meters |
R4SS-P19 | R5LL-P33 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R10UL-P7 | 10 meters |
R4SS-P22 | R2LL-P2 | 5 meters |
R4SS-P23 | R1UL-P2 | 10 meters |
R4SS-P24 | R9UL-P7 | 10 meters |
R4SS-P25 | R7UL-P3 | 10 meters |
R4SS-P26 | R6UL-P1 | 5 meters |
R4SS-P27 | R1LL-P34 | 10 meters |
R4SS-P28 | R2UL-P3 | 5 meters |
R4SS-P29 | R6LL-P34 | 5 meters |
R4SS-P30 | R9LL-P7 | 10 meters |
R4SS-P31 | R7LL-P36 | 10 meters |
R4SS-P32 | R10LL-P7 | 10 meters |
R5SS-P5 | R1UL-P30 | 10 meters |
R5SS-P6 | R2UL-P7 | 10 meters |
R5SS-P7 | R5UL-P30 | 3 meters |
R5SS-P8 | R6LL-P30 | 5 meters |
R5SS-P9 | R7UL-P31 | 5 meters |
R5SS-P10 | R4UL-P5 | 5 meters |
R5SS-P11 | R3UL-P32 | 5 meters |
R5SS-P12 | R8LL-P31 | 10 meters |
R5SS-P13 | R1LL-P7 | 10 meters |
R5SS-P14 | R2LL-P33 | 10 meters |
R5SS-P15 | R5LL-P30 | 3 meters |
R5SS-P16 | R7LL-P31 | 5 meters |
R5SS-P17 | R4LL-P7 | 5 meters |
R5SS-P18 | R6UL-P33 | 5 meters |
R5SS-P19 | R8UL-P31 | 10 meters |
R5SS-P20 | R3LL-P5 | 5 meters |
R5SS-P21 | R10UL-P30 | 10 meters |
R5SS-P22 | R2LL-P35 | 10 meters |
R5SS-P23 | R3UL-P34 | 5 meters |
R5SS-P24 | R9UL-P30 | 10 meters |
R5SS-P25 | R7UL-P1 | 5 meters |
R5SS-P26 | R8UL-P3 | 10 meters |
R5SS-P27 | R1LL-P3 | 10 meters |
R5SS-P28 | R2UL-P1 | 10 meters |
R5SS-P29 | R6LL-P35 | 5 meters |
R5SS-P30 | R9LL-P31 | 10 meters |
R5SS-P31 | R7LL-P3 | 5 meters |
R5SS-P32 | R10LL-P31 | 10 meters |
R6SS-P5 | R1UL-P32 | 10 meters |
R6SS-P6 | R2UL-P33 | 10 meters |
R6SS-P7 | R5UL-P7 | 5 meters |
R6SS-P8 | R6LL-P32 | 3 meters |
R6SS-P9 | R7UL-P33 | 5 meters |
R6SS-P10 | R4UL-P30 | 5 meters |
R6SS-P11 | R3UL-P7 | 10 meters |
R6SS-P12 | R8LL-P33 | 5 meters |
R6SS-P13 | R1LL-P32 | 10 meters |
R6SS-P14 | R2LL-P7 | 10 meters |
R6SS-P15 | R5LL-P4 | 5 meters |
R6SS-P16 | R6UL-P30 | 3 meters |
R6SS-P17 | R4LL-P6 | 5 meters |
R6SS-P18 | R7LL-P33 | 5 meters |
R6SS-P19 | R8UL-P33 | 5 meters |
R6SS-P20 | R3LL-P30 | 10 meters |
R6SS-P21 | R10UL-P31 | 10 meters |
R6SS-P22 | R2LL-P1 | 10 meters |
R6SS-P23 | R3UL-P1 | 10 meters |
R6SS-P24 | R9UL-P31 | 10 meters |
R6SS-P25 | R7UL-P35 | 5 meters |
R6SS-P26 | R8UL-P36 | 5 meters |
R6SS-P27 | R3LL-P35 | 10 meters |
R6SS-P28 | R2UL-P35 | 10 meters |
R6SS-P29 | R8LL-P3 | 5 meters |
R6SS-P30 | R9LL-P32 | 10 meters |
R6SS-P31 | R7LL-P34 | 5 meters |
R6SS-P32 | R10LL-P32 | 10 meters |
R7SS-P5 | R1UL-P33 | 10 meters |
R7SS-P6 | R2UL-P32 | 10 meters |
R7SS-P7 | R5UL-P32 | 5 meters |
R7SS-P8 | R6LL-P6 | 5 meters |
R7SS-P9 | R7UL-P30 | 3 meters |
R7SS-P10 | R4UL-P31 | 10 meters |
R7SS-P11 | R3UL-P31 | 10 meters |
R7SS-P12 | R8LL-P30 | 5 meters |
R7SS-P13 | R1LL-P6 | 10 meters |
R7SS-P14 | R2LL-P32 | 10 meters |
R7SS-P15 | R5LL-P5 | 5 meters |
R7SS-P16 | R6UL-P5 | 5 meters |
R7SS-P17 | R4LL-P32 | 10 meters |
R7SS-P18 | R7LL-P30 | 3 meters |
R7SS-P19 | R8UL-P30 | 5 meters |
R7SS-P20 | R3LL-P7 | 10 meters |
R7SS-P21 | R10UL-P32 | 10 meters |
R7SS-P22 | R2LL-P34 | 10 meters |
R7SS-P23 | R3UL-P35 | 10 meters |
R7SS-P24 | R9UL-P32 | 5 meters |
R7SS-P25 | R9UL-P2 | 5 meters |
R7SS-P26 | R8UL-P34 | 5 meters |
R7SS-P27 | R3LL-P1 | 10 meters |
R7SS-P28 | R4UL-P36 | 10 meters |
R7SS-P29 | R8LL-P1 | 5 meters |
R7SS-P30 | R9LL-P33 | 5 meters |
R7SS-P31 | R7LL-P35 | 3 meters |
R7SS-P32 | R10LL-P33 | 10 meters |
R8SS-P5 | R1UL-P7 | 10 meters |
R8SS-P6 | R2UL-P30 | 10 meters |
R8SS-P7 | R5UL-P31 | 10 meters |
R8SS-P8 | R6LL-P7 | 5 meters |
R8SS-P9 | R7UL-P32 | 5 meters |
R8SS-P10 | R4UL-P4 | 10 meters |
R8SS-P11 | R3UL-P33 | 10 meters |
R8SS-P12 | R7LL-P32 | 5 meters |
R8SS-P13 | R1LL-P33 | 10 meters |
R8SS-P14 | R2LL-P30 | 10 meters |
R8SS-P15 | R5LL-P32 | 10 meters |
R8SS-P16 | R6UL-P32 | 5 meters |
R8SS-P17 | R4LL-P33 | 10 meters |
R8SS-P18 | R8LL-P32 | 3 meters |
R8SS-P19 | R8UL-P32 | 3 meters |
R8SS-P20 | R3LL-P6 | 10 meters |
R8SS-P21 | R10UL-P33 | 5 meters |
R8SS-P22 | R4LL-P36 | 10 meters |
R8SS-P23 | R3UL-P36 | 10 meters |
R8SS-P24 | R9UL-P33 | 5 meters |
R8SS-P25 | R9UL-P34 | 5 meters |
R8SS-P26 | R8UL-P35 | 3 meters |
R8SS-P27 | R3LL-P36 | 10 meters |
R8SS-P28 | R4UL-P1 | 10 meters |
R8SS-P29 | R8LL-P34 | 3 meters |
R8SS-P30 | R9LL-P34 | 5 meters |
R8SS-P31 | R9LL-P4 | 5 meters |
R8SS-P32 | R10LL-P34 | 5 meters |
R9SS-P5 | R1UL-P36 | 10 meters |
R9SS-P6 | R2UL-P36 | 10 meters |
R9SS-P7 | R5UL-P35 | 10 meters |
R9SS-P8 | R6LL-P1 | 10 meters |
R9SS-P9 | R7UL-P2 | 5 meters |
R9SS-P10 | R4UL-P34 | 10 meters |
R9SS-P11 | R3UL-P2 | 10 meters |
R9SS-P12 | R7LL-P1 | 5 meters |
R9SS-P13 | R1LL-P36 | 10 meters |
R9SS-P14 | R2LL-P3 | 10 meters |
R9SS-P15 | R5LL-P1 | 10 meters |
R9SS-P16 | R6UL-P3 | 10 meters |
R9SS-P17 | R4LL-P1 | 10 meters |
R9SS-P18 | R8LL-P2 | 5 meters |
R9SS-P19 | R8UL-P1 | 5 meters |
R9SS-P20 | R3LL-P3 | 10 meters |
R9SS-P21 | R10UL-P35 | 5 meters |
R9SS-P22 | R4LL-P35 | 10 meters |
R9SS-P23 | R5UL-P36 | 10 meters |
R9SS-P24 | R9UL-P35 | 3 meters |
R9SS-P25 | R9UL-P36 | 3 meters |
R9SS-P26 | R10UL-P36 | 5 meters |
R9SS-P27 | R3LL-P34 | 10 meters |
R9SS-P28 | R4UL-P35 | 10 meters |
R9SS-P29 | R8LL-P35 | 5 meters |
R9SS-P30 | R9LL-P35 | 3 meters |
R9SS-P31 | R9LL-P36 | 3 meters |
R9SS-P32 | R10LL-P35 | 5 meters |
R10SS-P5 | R1UL-P35 | 15 meters |
R10SS-P6 | R2UL-P34 | 10 meters |
R10SS-P7 | R5UL-P1 | 10 meters |
R10SS-P8 | R6LL-P2 | 10 meters |
R10SS-P9 | R7UL-P36 | 10 meters |
R10SS-P10 | R4UL-P3 | 10 meters |
R10SS-P11 | R3UL-P3 | 10 meters |
R10SS-P12 | R7LL-P2 | 10 meters |
R10SS-P13 | R1LL-P35 | 15 meters |
R10SS-P14 | R2LL-P36 | 10 meters |
R10SS-P15 | R5LL-P35 | 10 meters |
R10SS-P16 | R6UL-P35 | 10 meters |
R10SS-P17 | R4LL-P2 | 10 meters |
R10SS-P18 | R8LL-P36 | 5 meters |
R10SS-P19 | R8UL-P2 | 5 meters |
R10SS-P20 | R3LL-P2 | 10 meters |
R10SS-P21 | R10UL-P4 | 3 meters |
R10SS-P22 | R4LL-P34 | 10 meters |
R10SS-P23 | R5UL-P34 | 10 meters |
R10SS-P24 | R9UL-P4 | 5 meters |
R10SS-P25 | R9UL-P6 | 5 meters |
R10SS-P26 | R10UL-P6 | 3 meters |
R10SS-P27 | R5LL-P36 | 10 meters |
R10SS-P28 | R4UL-P2 | 10 meters |
R10SS-P29 | R10LL-P6 | 3 meters |
R10SS-P30 | R9LL-P6 | 5 meters |
R10SS-P31 | R9LL-P30 | 5 meters |
R10SS-P32 | R10LL-P30 | 3 meters |
Eleven-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect eleven racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, interconnecting 10 or more of these racks requires modification to the following cabling tables. Contact Oracle for further details.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a 11 rack system.
Table 22-64 Leaf Switch Connections for the First Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R1UL-P1 to R3SS-P23 | 5 meters |
R1UL-P2 to R11SS-P5 | 15 meters |
R1UL-P3 to R1SS-P23 | 3 meters |
R1UL-P4 to R4SS-P5 | 10 meters |
R1UL-P5 to R1SS-P5 | 3 meters |
R1UL-P6 to R3SS-P5 | 5 meters |
R1UL-P7 to R8SS-P5 | 10 meters |
R1UL-P30 to R5SS-P5 | 10 meters |
R1UL-P31 to R2SS-P5 | 5 meters |
R1UL-P32 to R6SS-P5 | 10 meters |
R1UL-P33 to R7SS-P5 | 10 meters |
R1UL-P34 to R2SS-P23 | 5 meters |
R1UL-P35 to R10SS-P5 | 15 meters |
R1UL-P36 to R9SS-P5 | 10 meters |
R1LL-P1 to R2SS-P22 | 5 meters |
R1LL-P2 to R3SS-P22 | 5 meters |
R1LL-P3 to R11SS-P13 | 15 meters |
R1LL-P4 to R3SS-P13 | 5 meters |
R1LL-P5 to R1SS-P13 | 3 meters |
R1LL-P6 to R7SS-P13 | 10 meters |
R1LL-P7 to R5SS-P13 | 10 meters |
R1LL-P30 to R4SS-P13 | 10 meters |
R1LL-P31 to R2SS-P13 | 5 meters |
R1LL-P32 to R6SS-P13 | 10 meters |
R1LL-P33 to R8SS-P13 | 10 meters |
R1LL-P34 to R4SS-P22 | 10 meters |
R1LL-P35 to R10SS-P13 | 15 meters |
R1LL-P36 to R9SS-P13 | 10 meters |
Table 22-65 Leaf Switch Connections for the Second Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R2UL-P1 to R5SS-P26 | 10 meters |
R2UL-P2 to R3SS-P26 | 5 meters |
R2UL-P3 to R4SS-P26 | 5 meters |
R2UL-P4 to R4SS-P6 | 5 meters |
R2UL-P5 to R1SS-P6 | 5 meters |
R2UL-P6 to R3SS-P6 | 5 meters |
R2UL-P7 to R5SS-P6 | 10 meters |
R2UL-P30 to R8SS-P6 | 10 meters |
R2UL-P31 to R2SS-P6 | 3 meters |
R2UL-P32 to R7SS-P6 | 10 meters |
R2UL-P33 to R6SS-P6 | 10 meters |
R2UL-P34 to R10SS-P6 | 10 meters |
R2UL-P35 to R11SS-P6 | 15 meters |
R2UL-P36 to R9SS-P6 | 10 meters |
R2LL-P1 to R6SS-P23 | 10 meters |
R2LL-P2 to R4SS-P23 | 5 meters |
R2LL-P3 to R9SS-P14 | 10 meters |
R2LL-P4 to R4SS-P14 | 5 meters |
R2LL-P5 to R1SS-P14 | 5 meters |
R2LL-P6 to R3SS-P14 | 5 meters |
R2LL-P7 to R6SS-P14 | 10 meters |
R2LL-P30 to R8SS-P14 | 10 meters |
R2LL-P31 to R2SS-P14 | 3 meters |
R2LL-P32 to R7SS-P14 | 10 meters |
R2LL-P33 to R5SS-P14 | 10 meters |
R2LL-P34 to R11SS-P14 | 15 meters |
R2LL-P35 to R5SS-P23 | 10 meters |
R2LL-P36 to R10SS-P14 | 10 meters |
Table 22-66 Leaf Switch Connections for the Third Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R3UL-P1 to R6SS-P22 | 10 meters |
R3UL-P2 to R9SS-P11 | 10 meters |
R3UL-P3 to R10SS-P11 | 10 meters |
R3UL-P4 to R4SS-P11 | 5 meters |
R3UL-P5 to R1SS-P11 | 5 meters |
R3UL-P6 to R2SS-P11 | 5 meters |
R3UL-P7 to R6SS-P11 | 10 meters |
R3UL-P30 to R3SS-P11 | 3 meters |
R3UL-P31 to R7SS-P11 | 10 meters |
R3UL-P32 to R5SS-P11 | 5 meters |
R3UL-P33 to R8SS-P11 | 10 meters |
R3UL-P34 to R5SS-P22 | 5 meters |
R3UL-P35 to R7SS-P22 | 10 meters |
R3UL-P36 to R11SS-P11 | 10 meters |
R3LL-P1 to R7SS-P26 | 10 meters |
R3LL-P2 to R10SS-P20 | 10 meters |
R3LL-P3 to R9SS-P20 | 10 meters |
R3LL-P4 to R1SS-P20 | 5 meters |
R3LL-P5 to R5SS-P20 | 5 meters |
R3LL-P6 to R8SS-P20 | 10 meters |
R3LL-P7 to R7SS-P20 | 10 meters |
R3LL-P30 to R6SS-P20 | 10 meters |
R3LL-P31 to R2SS-P20 | 5 meters |
R3LL-P32 to R3SS-P20 | 3 meters |
R3LL-P33 to R4SS-P20 | 5 meters |
R3LL-P34 to R11SS-P20 | 10 meters |
R3LL-P35 to R6SS-P26 | 10 meters |
R3LL-P36 to R8SS-P26 | 10 meters |
Table 22-67 Leaf Switch Connections for the Fourth Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R4UL-P1 to R8SS-P23 | 10 meters |
R4UL-P2 to R11SS-P10 | 10 meters |
R4UL-P3 to R10SS-P10 | 10 meters |
R4UL-P4 to R8SS-P10 | 10 meters |
R4UL-P5 to R5SS-P10 | 5 meters |
R4UL-P6 to R2SS-P10 | 5 meters |
R4UL-P7 to R1SS-P10 | 10 meters |
R4UL-P30 to R6SS-P10 | 5 meters |
R4UL-P31 to R7SS-P10 | 10 meters |
R4UL-P32 to R4SS-P10 | 3 meters |
R4UL-P33 to R3SS-P10 | 5 meters |
R4UL-P34 to R9SS-P10 | 10 meters |
R4UL-P35 to R9SS-P23 | 10 meters |
R4UL-P36 to R7SS-P23 | 10 meters |
R4LL-P1 to R9SS-P17 | 10 meters |
R4LL-P2 to R10SS-P17 | 10 meters |
R4LL-P3 to R11SS-P17 | 10 meters |
R4LL-P4 to R2SS-P17 | 5 meters |
R4LL-P5 to R1SS-P17 | 10 meters |
R4LL-P6 to R6SS-P17 | 5 meters |
R4LL-P7 to R5SS-P17 | 5 meters |
R4LL-P30 to R4SS-P17 | 3 meters |
R4LL-P31 to R3SS-P17 | 5 meters |
R4LL-P32 to R7SS-P17 | 10 meters |
R4LL-P33 to R8SS-P17 | 10 meters |
R4LL-P34 to R10SS-P22 | 10 meters |
R4LL-P35 to R9SS-P22 | 10 meters |
R4LL-P36 to R8SS-P22 | 10 meters |
Table 22-68 Leaf Switch Connections for the Fifth Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R5UL-P1 to R10SS-P7 | 10 meters |
R5UL-P2 to R11SS-P26 | 10 meters |
R5UL-P3 to R11SS-P7 | 10 meters |
R5UL-P4 to R2SS-P8 | 10 meters |
R5UL-P5 to R1SS-P8 | 10 meters |
R5UL-P6 to R3SS-P8 | 5 meters |
R5UL-P7 to R6SS-P7 | 5 meters |
R5UL-P30 to R5SS-P7 | 3 meters |
R5UL-P31 to R8SS-P7 | 10 meters |
R5UL-P32 to R7SS-P7 | 5 meters |
R5UL-P33 to R4SS-P12 | 5 meters |
R5UL-P34 to R10SS-P26 | 10 meters |
R5UL-P35 to R9SS-P7 | 10 meters |
R5UL-P36 to R9SS-P26 | 10 meters |
R5LL-P1 to R9SS-P15 | 10 meters |
R5LL-P2 to R1SS-P22 | 10 meters |
R5LL-P3 to R11SS-P15 | 10 meters |
R5LL-P4 to R6SS-P15 | 5 meters |
R5LL-P5 to R7SS-P15 | 5 meters |
R5LL-P6 to R2SS-P18 | 10 meters |
R5LL-P7 to R1SS-P18 | 10 meters |
R5LL-P30 to R5SS-P15 | 3 meters |
R5LL-P31 to R3SS-P16 | 5 meters |
R5LL-P32 to R8SS-P15 | 10 meters |
R5LL-P33 to R4SS-P19 | 5 meters |
R5LL-P34 to R11SS-P23 | 10 meters |
R5LL-P35 to R10SS-P15 | 10 meters |
R5LL-P36 to R10SS-P23 | 10 meters |
Table 22-69 Leaf Switch Connections for the Sixth Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R6UL-P1 to R11SS-P22 | 10 meters |
R6UL-P2 to R11SS-P16 | 10 meters |
R6UL-P3 to R9SS-P16 | 10 meters |
R6UL-P4 to R2SS-P16 | 10 meters |
R6UL-P5 to R7SS-P16 | 5 meters |
R6UL-P6 to R3SS-P19 | 10 meters |
R6UL-P7 to R1SS-P16 | 10 meters |
R6UL-P30 to R6SS-P16 | 3 meters |
R6UL-P31 to R4SS-P15 | 5 meters |
R6UL-P32 to R8SS-P16 | 5 meters |
R6UL-P33 to R5SS-P18 | 5 meters |
R6UL-P34 to R1SS-P26 | 10 meters |
R6UL-P35 to R10SS-P16 | 10 meters |
R6UL-P36 to R2SS-P26 | 10 meters |
R6LL-P1 to R9SS-P8 | 10 meters |
R6LL-P2 to R10SS-P8 | 10 meters |
R6LL-P3 to R3SS-P31 | 10 meters |
R6LL-P4 to R2SS-P12 | 10 meters |
R6LL-P5 to R1SS-P12 | 10 meters |
R6LL-P6 to R7SS-P8 | 5 meters |
R6LL-P7 to R8SS-P8 | 5 meters |
R6LL-P30 to R5SS-P8 | 5 meters |
R6LL-P31 to R3SS-P7 | 10 meters |
R6LL-P32 to R6SS-P8 | 3 meters |
R6LL-P33 to R4SS-P9 | 5 meters |
R6LL-P34 to R1SS-P31 | 10 meters |
R6LL-P35 to R11SS-P8 | 10 meters |
R6LL-P36 to R2SS-P31 | 10 meters |
Table 22-70 Leaf Switch Connections for the Seventh Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R7UL-P1 to R2SS-P27 | 10 meters |
R7UL-P2 to R9SS-P9 | 5 meters |
R7UL-P3 to R4SS-P27 | 10 meters |
R7UL-P4 to R3SS-P9 | 10 meters |
R7UL-P5 to R1SS-P9 | 10 meters |
R7UL-P6 to R4SS-P8 | 10 meters |
R7UL-P7 to R2SS-P7 | 10 meters |
R7UL-P30 to R7SS-P9 | 3 meters |
R7UL-P31 to R5SS-P9 | 5 meters |
R7UL-P32 to R8SS-P9 | 5 meters |
R7UL-P33 to R6SS-P9 | 5 meters |
R7UL-P34 to R3SS-P27 | 10 meters |
R7UL-P35 to R11SS-P9 | 10 meters |
R7UL-P36 to R10SS-P9 | 10 meters |
R7LL-P1 to R9SS-P12 | 5 meters |
R7LL-P2 to R10SS-P12 | 10 meters |
R7LL-P3 to R5SS-P30 | 5 meters |
R7LL-P4 to R3SS-P15 | 10 meters |
R7LL-P5 to R1SS-P19 | 10 meters |
R7LL-P6 to R4SS-P18 | 10 meters |
R7LL-P7 to R2SS-P19 | 10 meters |
R7LL-P30 to R7SS-P18 | 3 meters |
R7LL-P31 to R5SS-P16 | 5 meters |
R7LL-P32 to R8SS-P12 | 5 meters |
R7LL-P33 to R6SS-P18 | 5 meters |
R7LL-P34 to R3SS-P30 | 10 meters |
R7LL-P35 to R11SS-P12 | 10 meters |
R7LL-P36 to R4SS-P30 | 10 meters |
Table 22-71 Leaf Switch Connections for the Eighth Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R8UL-P1 to R9SS-P19 | 5 meters |
R8UL-P2 to R10SS-P19 | 5 meters |
R8UL-P3 to R5SS-P31 | 10 meters |
R8UL-P4 to R3SS-P18 | 10 meters |
R8UL-P5 to R1SS-P15 | 10 meters |
R8UL-P6 to R4SS-P16 | 10 meters |
R8UL-P7 to R2SS-P15 | 10 meters |
R8UL-P30 to R7SS-P19 | 5 meters |
R8UL-P31 to R5SS-P19 | 10 meters |
R8UL-P32 to R8SS-P19 | 3 meters |
R8UL-P33 to R6SS-P19 | 5 meters |
R8UL-P34 to R4SS-P31 | 10 meters |
R8UL-P35 to R11SS-P19 | 10 meters |
R8UL-P36 to R6SS-P31 | 5 meters |
R8LL-P1 to R7SS-P27 | 5 meters |
R8LL-P2 to R9SS-P18 | 5 meters |
R8LL-P3 to R6SS-P27 | 5 meters |
R8LL-P4 to R3SS-P12 | 10 meters |
R8LL-P5 to R1SS-P7 | 10 meters |
R8LL-P6 to R4SS-P7 | 10 meters |
R8LL-P7 to R2SS-P9 | 10 meters |
R8LL-P30 to R7SS-P12 | 5 meters |
R8LL-P31 to R5SS-P12 | 10 meters |
R8LL-P32 to R8SS-P18 | 3 meters |
R8LL-P33 to R6SS-P12 | 5 meters |
R8LL-P34 to R5SS-P27 | 10 meters |
R8LL-P35 to R11SS-P18 | 10 meters |
R8LL-P36 to R10SS-P18 | 5 meters |
Table 22-72 Leaf Switch Connections for the Ninth Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R9UL-P1 to R1SS-P24 | 10 meters |
R9UL-P2 to R7SS-P30 | 5 meters |
R9UL-P3 to R2SS-P24 | 10 meters |
R9UL-P4 to R10SS-P24 | 5 meters |
R9UL-P5 to R3SS-P24 | 10 meters |
R9UL-P6 to R11SS-P24 | 5 meters |
R9UL-P7 to R4SS-P24 | 10 meters |
R9UL-P30 to R5SS-P24 | 10 meters |
R9UL-P31 to R6SS-P24 | 10 meters |
R9UL-P32 to R7SS-P24 | 5 meters |
R9UL-P33 to R8SS-P24 | 5 meters |
R9UL-P34 to R8SS-P30 | 5 meters |
R9UL-P35 to R9SS-P24 | 3 meters |
R9UL-P36 to R6SS-P30 | 10 meters |
R9LL-P1 to R1SS-P29 | 10 meters |
R9LL-P2 to R11SS-P29 | 5 meters |
R9LL-P3 to R2SS-P29 | 10 meters |
R9LL-P4 to R8SS-P31 | 5 meters |
R9LL-P5 to R3SS-P29 | 10 meters |
R9LL-P6 to R10SS-P29 | 5 meters |
R9LL-P7 to R4SS-P29 | 10 meters |
R9LL-P30 to R7SS-P31 | 5 meters |
R9LL-P31 to R5SS-P29 | 10 meters |
R9LL-P32 to R6SS-P29 | 10 meters |
R9LL-P33 to R7SS-P29 | 5 meters |
R9LL-P34 to R8SS-P29 | 5 meters |
R9LL-P35 to R9SS-P29 | 3 meters |
R9LL-P36 to R9SS-P31 | 3 meters |
Table 22-73 Leaf Switch Connections for the Tenth Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R10UL-P1 to R1SS-P21 | 15 meters |
R10UL-P2 to R11SS-P21 | 5 meters |
R10UL-P3 to R2SS-P21 | 10 meters |
R10UL-P4 to R10SS-P21 | 3 meters |
R10UL-P5 to R3SS-P21 | 10 meters |
R10UL-P6 to R10SS-P27 | 3 meters |
R10UL-P7 to R4SS-P21 | 10 meters |
R10UL-P30 to R5SS-P21 | 10 meters |
R10UL-P31 to R6SS-P21 | 10 meters |
R10UL-P32 to R7SS-P21 | 10 meters |
R10UL-P33 to R8SS-P21 | 5 meters |
R10UL-P34 to R8SS-P27 | 5 meters |
R10UL-P35 to R9SS-P21 | 5 meters |
R10UL-P36 to R9SS-P27 | 5 meters |
R10LL-P1 to R1SS-P32 | 15 meters |
R10LL-P2 to R9SS-P30 | 5 meters |
R10LL-P3 to R2SS-P32 | 10 meters |
R10LL-P4 to R11SS-P30 | 5 meters |
R10LL-P5 to R3SS-P32 | 10 meters |
R10LL-P6 to R10SS-P30 | 3 meters |
R10LL-P7 to R4SS-P32 | 10 meters |
R10LL-P30 to R10SS-P32 | 3 meters |
R10LL-P31 to R5SS-P32 | 10 meters |
R10LL-P32 to R6SS-P32 | 10 meters |
R10LL-P33 to R7SS-P32 | 10 meters |
R10LL-P34 to R8SS-P32 | 5 meters |
R10LL-P35 to R9SS-P32 | 5 meters |
R10LL-P36 to R11SS-P32 | 5 meters |
Table 22-74 Leaf Switch Connections for the Eleventh Rack in a 11 Rack System
Connection | Cable Length |
---|---|
R11UL-P1 to R1SS-P25 | 15 meters |
R11UL-P2 to R11SS-P25 | 3 meters |
R11UL-P3 to R2SS-P25 | 15 meters |
R11UL-P4 to R10SS-P25 | 5 meters |
R11UL-P5 to R3SS-P25 | 10 meters |
R11UL-P6 to R10SS-P31 | 5 meters |
R11UL-P7 to R4SS-P25 | 10 meters |
R11UL-P30 to R5SS-P25 | 10 meters |
R11UL-P31 to R6SS-P25 | 10 meters |
R11UL-P32 to R7SS-P25 | 10 meters |
R11UL-P33 to R8SS-P25 | 10 meters |
R11UL-P34 to R11SS-P31 | 3 meters |
R11UL-P35 to R9SS-P25 | 5 meters |
R11UL-P36 to R1SS-P27 | 15 meters |
R11LL-P1 to R1SS-P28 | 15 meters |
R11LL-P2 to R1SS-P30 | 15 meters |
R11LL-P3 to R2SS-P28 | 15 meters |
R11LL-P4 to R11SS-P28 | 3 meters |
R11LL-P5 to R3SS-P28 | 10 meters |
R11LL-P6 to R10SS-P28 | 5 meters |
R11LL-P7 to R4SS-P28 | 10 meters |
R11LL-P30 to R2SS-P30 | 15 meters |
R11LL-P31 to R5SS-P28 | 10 meters |
R11LL-P32 to R6SS-P28 | 10 meters |
R11LL-P33 to R7SS-P28 | 10 meters |
R11LL-P34 to R8SS-P28 | 10 meters |
R11LL-P35 to R9SS-P28 | 5 meters |
R11LL-P36 to R11SS-P27 | 3 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-75 Eleven-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R8LL-P5 | 10 meters |
R1SS-P8 | R5UL-P5 | 10 meters |
R1SS-P9 | R7UL-P5 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R6LL-P5 | 10 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R8UL-P5 | 10 meters |
R1SS-P16 | R6UL-P7 | 10 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R5LL-P7 | 10 meters |
R1SS-P19 | R7LL-P5 | 10 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R10UL-P1 | 15 meters |
R1SS-P22 | R5LL-P2 | 10 meters |
R1SS-P23 | R1UL-P3 | 3 meters |
R1SS-P24 | R9UL-P1 | 10 meters |
R1SS-P25 | R11UL-P1 | 15 meters |
R1SS-P26 | R6UL-P34 | 10 meters |
R1SS-P27 | R11UL-P36 | 15 meters |
R1SS-P28 | R11LL-P1 | 15 meters |
R1SS-P29 | R9LL-P1 | 10 meters |
R1SS-P30 | R11LL-P2 | 15 meters |
R1SS-P31 | R6LL-P34 | 10 meters |
R1SS-P32 | R10LL-P1 | 15 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R7UL-P7 | 10 meters |
R2SS-P8 | R5UL-P4 | 10 meters |
R2SS-P9 | R8LL-P7 | 10 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R6LL-P4 | 10 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R8UL-P7 | 10 meters |
R2SS-P16 | R6UL-P4 | 10 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R5LL-P6 | 10 meters |
R2SS-P19 | R7LL-P7 | 10 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R10UL-P3 | 10 meters |
R2SS-P22 | R1LL-P1 | 5 meters |
R2SS-P23 | R1UL-P34 | 5 meters |
R2SS-P24 | R9UL-P3 | 10 meters |
R2SS-P25 | R11UL-P3 | 15 meters |
R2SS-P26 | R6UL-P36 | 10 meters |
R2SS-P27 | R7UL-P1 | 10 meters |
R2SS-P28 | R11LL-P3 | 15 meters |
R2SS-P29 | R9LL-P3 | 10 meters |
R2SS-P30 | R11LL-P30 | 15 meters |
R2SS-P31 | R6LL-P36 | 10 meters |
R2SS-P32 | R10LL-P3 | 10 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R6LL-P31 | 10 meters |
R3SS-P8 | R5UL-P6 | 5 meters |
R3SS-P9 | R7UL-P4 | 10 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R8LL-P4 | 10 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R7LL-P4 | 10 meters |
R3SS-P16 | R5LL-P31 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R8UL-P4 | 10 meters |
R3SS-P19 | R6UL-P6 | 10 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R10UL-P5 | 10 meters |
R3SS-P22 | R1LL-P2 | 5 meters |
R3SS-P23 | R1UL-P1 | 5 meters |
R3SS-P24 | R9UL-P5 | 10 meters |
R3SS-P25 | R11UL-P5 | 10 meters |
R3SS-P26 | R2UL-P2 | 5 meters |
R3SS-P27 | R7UL-P34 | 10 meters |
R3SS-P28 | R11LL-P5 | 10 meters |
R3SS-P29 | R9LL-P5 | 10 meters |
R3SS-P30 | R7LL-P34 | 10 meters |
R3SS-P31 | R6LL-P3 | 10 meters |
R3SS-P32 | R10LL-P5 | 10 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R8LL-P6 | 10 meters |
R4SS-P8 | R7UL-P6 | 10 meters |
R4SS-P9 | R6LL-P33 | 5 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R5UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R6UL-P31 | 5 meters |
R4SS-P16 | R8UL-P6 | 10 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R7LL-P6 | 10 meters |
R4SS-P19 | R5LL-P33 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R10UL-P7 | 10 meters |
R4SS-P22 | R1LL-P34 | 10 meters |
R4SS-P23 | R2LL-P2 | 5 meters |
R4SS-P24 | R9UL-P7 | 10 meters |
R4SS-P25 | R11UL-P7 | 10 meters |
R4SS-P26 | R2UL-P3 | 5 meters |
R4SS-P27 | R7UL-P3 | 10 meters |
R4SS-P28 | R11LL-P7 | 10 meters |
R4SS-P29 | R9LL-P7 | 10 meters |
R4SS-P30 | R7LL-P36 | 10 meters |
R4SS-P31 | R8UL-P34 | 10 meters |
R4SS-P32 | R10LL-P7 | 10 meters |
R5SS-P5 | R1UL-P30 | 10 meters |
R5SS-P6 | R2UL-P7 | 10 meters |
R5SS-P7 | R5UL-P30 | 3 meters |
R5SS-P8 | R6LL-P30 | 5 meters |
R5SS-P9 | R7UL-P31 | 5 meters |
R5SS-P10 | R4UL-P5 | 5 meters |
R5SS-P11 | R3UL-P32 | 5 meters |
R5SS-P12 | R8LL-P31 | 10 meters |
R5SS-P13 | R1LL-P7 | 10 meters |
R5SS-P14 | R2LL-P33 | 10 meters |
R5SS-P15 | R5LL-P30 | 3 meters |
R5SS-P16 | R7LL-P31 | 5 meters |
R5SS-P17 | R4LL-P7 | 5 meters |
R5SS-P18 | R6UL-P33 | 5 meters |
R5SS-P19 | R8UL-P31 | 10 meters |
R5SS-P20 | R3LL-P5 | 5 meters |
R5SS-P21 | R10UL-P30 | 10 meters |
R5SS-P22 | R3UL-P34 | 5 meters |
R5SS-P23 | R2LL-P35 | 10 meters |
R5SS-P24 | R9UL-P30 | 10 meters |
R5SS-P25 | R11UL-P30 | 10 meters |
R5SS-P26 | R2UL-P1 | 10 meters |
R5SS-P27 | R8LL-P34 | 10 meters |
R5SS-P28 | R11LL-P31 | 10 meters |
R5SS-P29 | R9LL-P31 | 10 meters |
R5SS-P30 | R7LL-P3 | 5 meters |
R5SS-P31 | R8UL-P3 | 10 meters |
R5SS-P32 | R10LL-P31 | 10 meters |
R6SS-P5 | R1UL-P32 | 10 meters |
R6SS-P6 | R2UL-P33 | 10 meters |
R6SS-P7 | R5UL-P7 | 5 meters |
R6SS-P8 | R6LL-P32 | 3 meters |
R6SS-P9 | R7UL-P33 | 5 meters |
R6SS-P10 | R4UL-P30 | 5 meters |
R6SS-P11 | R3UL-P7 | 10 meters |
R6SS-P12 | R8LL-P33 | 5 meters |
R6SS-P13 | R1LL-P32 | 10 meters |
R6SS-P14 | R2LL-P7 | 10 meters |
R6SS-P15 | R5LL-P4 | 5 meters |
R6SS-P16 | R6UL-P30 | 3 meters |
R6SS-P17 | R4LL-P6 | 5 meters |
R6SS-P18 | R7LL-P33 | 5 meters |
R6SS-P19 | R8UL-P33 | 5 meters |
R6SS-P20 | R3LL-P30 | 10 meters |
R6SS-P21 | R10UL-P31 | 10 meters |
R6SS-P22 | R3UL-P1 | 10 meters |
R6SS-P23 | R2LL-P1 | 10 meters |
R6SS-P24 | R9UL-P31 | 10 meters |
R6SS-P25 | R11UL-P31 | 10 meters |
R6SS-P26 | R3LL-P35 | 10 meters |
R6SS-P27 | R8LL-P3 | 5 meters |
R6SS-P28 | R11LL-P32 | 10 meters |
R6SS-P29 | R9LL-P32 | 10 meters |
R6SS-P30 | R9UL-P36 | 10 meters |
R6SS-P31 | R8UL-P36 | 5 meters |
R6SS-P32 | R10LL-P32 | 10 meters |
R7SS-P5 | R1UL-P33 | 10 meters |
R7SS-P6 | R2UL-P32 | 10 meters |
R7SS-P7 | R5UL-P32 | 5 meters |
R7SS-P8 | R6LL-P6 | 5 meters |
R7SS-P9 | R7UL-P30 | 3 meters |
R7SS-P10 | R4UL-P31 | 10 meters |
R7SS-P11 | R3UL-P31 | 10 meters |
R7SS-P12 | R8LL-P30 | 5 meters |
R7SS-P13 | R1LL-P6 | 10 meters |
R7SS-P14 | R2LL-P32 | 10 meters |
R7SS-P15 | R5LL-P5 | 5 meters |
R7SS-P16 | R6UL-P5 | 5 meters |
R7SS-P17 | R4LL-P32 | 10 meters |
R7SS-P18 | R7LL-P30 | 3 meters |
R7SS-P19 | R8UL-P30 | 5 meters |
R7SS-P20 | R3LL-P7 | 10 meters |
R7SS-P21 | R10UL-P32 | 10 meters |
R7SS-P22 | R3UL-P35 | 10 meters |
R7SS-P23 | R4UL-P36 | 10 meters |
R7SS-P24 | R9UL-P32 | 5 meters |
R7SS-P25 | R11UL-P32 | 10 meters |
R7SS-P26 | R3LL-P1 | 10 meters |
R7SS-P27 | R8LL-P1 | 5 meters |
R7SS-P28 | R11LL-P33 | 10 meters |
R7SS-P29 | R9LL-P33 | 5 meters |
R7SS-P30 | R9UL-P2 | 5 meters |
R7SS-P31 | R9LL-P30 | 5 meters |
R7SS-P32 | R10LL-P33 | 10 meters |
R8SS-P5 | R1UL-P7 | 10 meters |
R8SS-P6 | R2UL-P30 | 10 meters |
R8SS-P7 | R5UL-P31 | 10 meters |
R8SS-P8 | R6LL-P7 | 5 meters |
R8SS-P9 | R7UL-P32 | 5 meters |
R8SS-P10 | R4UL-P4 | 10 meters |
R8SS-P11 | R3UL-P33 | 10 meters |
R8SS-P12 | R7LL-P32 | 5 meters |
R8SS-P13 | R1LL-P33 | 10 meters |
R8SS-P14 | R2LL-P30 | 10 meters |
R8SS-P15 | R5LL-P32 | 10 meters |
R8SS-P16 | R6UL-P32 | 5 meters |
R8SS-P17 | R4LL-P33 | 10 meters |
R8SS-P18 | R8LL-P32 | 3 meters |
R8SS-P19 | R8UL-P32 | 3 meters |
R8SS-P20 | R3LL-P6 | 10 meters |
R8SS-P21 | R10UL-P33 | 5 meters |
R8SS-P22 | R4LL-P36 | 10 meters |
R8SS-P23 | R4UL-P1 | 10 meters |
R8SS-P24 | R9UL-P33 | 5 meters |
R8SS-P25 | R11UL-P33 | 10 meters |
R8SS-P26 | R3LL-P36 | 10 meters |
R8SS-P27 | R10UL-P34 | 5 meters |
R8SS-P28 | R11LL-P34 | 10 meters |
R8SS-P29 | R9LL-P34 | 5 meters |
R8SS-P30 | R9UL-P34 | 5 meters |
R8SS-P31 | R9LL-P4 | 5 meters |
R8SS-P32 | R10LL-P34 | 5 meters |
R9SS-P5 | R1UL-P36 | 10 meters |
R9SS-P6 | R2UL-P36 | 10 meters |
R9SS-P7 | R5UL-P35 | 10 meters |
R9SS-P8 | R6LL-P1 | 10 meters |
R9SS-P9 | R7UL-P2 | 5 meters |
R9SS-P10 | R4UL-P34 | 10 meters |
R9SS-P11 | R3UL-P2 | 10 meters |
R9SS-P12 | R7LL-P1 | 5 meters |
R9SS-P13 | R1LL-P36 | 10 meters |
R9SS-P14 | R2LL-P3 | 10 meters |
R9SS-P15 | R5LL-P1 | 10 meters |
R9SS-P16 | R6UL-P3 | 10 meters |
R9SS-P17 | R4LL-P1 | 10 meters |
R9SS-P18 | R8LL-P2 | 5 meters |
R9SS-P19 | R8UL-P1 | 5 meters |
R9SS-P20 | R3LL-P3 | 10 meters |
R9SS-P21 | R10UL-P35 | 5 meters |
R9SS-P22 | R4LL-P35 | 10 meters |
R9SS-P23 | R4UL-P35 | 10 meters |
R9SS-P24 | R9UL-P35 | 3 meters |
R9SS-P25 | R11UL-P35 | 5 meters |
R9SS-P26 | R5UL-P36 | 10 meters |
R9SS-P27 | R10UL-P36 | 5 meters |
R9SS-P28 | R11LL-P35 | 5 meters |
R9SS-P29 | R9LL-P35 | 3 meters |
R9SS-P30 | R10LL-P2 | 5 meters |
R9SS-P31 | R9LL-P36 | 3 meters |
R9SS-P32 | R10LL-P35 | 5 meters |
R10SS-P5 | R1UL-P35 | 15 meters |
R10SS-P6 | R2UL-P34 | 10 meters |
R10SS-P7 | R5UL-P1 | 10 meters |
R10SS-P8 | R6LL-P2 | 10 meters |
R10SS-P9 | R7UL-P36 | 10 meters |
R10SS-P10 | R4UL-P3 | 10 meters |
R10SS-P11 | R3UL-P3 | 10 meters |
R10SS-P12 | R7LL-P2 | 10 meters |
R10SS-P13 | R1LL-P35 | 15 meters |
R10SS-P14 | R2LL-P36 | 10 meters |
R10SS-P15 | R5LL-P35 | 10 meters |
R10SS-P16 | R6UL-P35 | 10 meters |
R10SS-P17 | R4LL-P2 | 10 meters |
R10SS-P18 | R8LL-P36 | 5 meters |
R10SS-P19 | R8UL-P2 | 5 meters |
R10SS-P20 | R3LL-P2 | 10 meters |
R10SS-P21 | R10UL-P4 | 3 meters |
R10SS-P22 | R4LL-P34 | 10 meters |
R10SS-P23 | R5LL-P36 | 10 meters |
R10SS-P24 | R9UL-P4 | 5 meters |
R10SS-P25 | R11UL-P4 | 5 meters |
R10SS-P26 | R5UL-P34 | 10 meters |
R10SS-P27 | R10UL-P6 | 3 meters |
R10SS-P28 | R11LL-P6 | 5 meters |
R10SS-P29 | R9LL-P6 | 5 meters |
R10SS-P30 | R10LL-P6 | 3 meters |
R10SS-P31 | R11UL-P6 | 5 meters |
R10SS-P32 | R10LL-P30 | 3 meters |
R11SS-P5 | R1UL-P2 | 15 meters |
R11SS-P6 | R2UL-P35 | 15 meters |
R11SS-P7 | R5UL-P3 | 10 meters |
R11SS-P8 | R6LL-P35 | 10 meters |
R11SS-P9 | R7UL-P35 | 10 meters |
R11SS-P10 | R4UL-P2 | 10 meters |
R11SS-P11 | R3UL-P36 | 10 meters |
R11SS-P12 | R7LL-P35 | 10 meters |
R11SS-P13 | R1LL-P3 | 15 meters |
R11SS-P14 | R2LL-P34 | 15 meters |
R11SS-P15 | R5LL-P3 | 10 meters |
R11SS-P16 | R6UL-P2 | 10 meters |
R11SS-P17 | R4LL-P3 | 10 meters |
R11SS-P18 | R8LL-P35 | 10 meters |
R11SS-P19 | R8UL-P35 | 10 meters |
R11SS-P20 | R3LL-P34 | 10 meters |
R11SS-P21 | R10UL-P2 | 5 meters |
R11SS-P22 | R6UL-P1 | 10 meters |
R11SS-P23 | R5LL-P34 | 10 meters |
R11SS-P24 | R9UL-P6 | 5 meters |
R11SS-P25 | R11UL-P2 | 3 meters |
R11SS-P26 | R5UL-P2 | 10 meters |
R11SS-P27 | R11LL-P36 | 3 meters |
R11SS-P28 | R11LL-P4 | 3 meters |
R11SS-P29 | R9LL-P2 | 5 meters |
R11SS-P30 | R10LL-P4 | 5 meters |
R11SS-P31 | R11UL-P34 | 3 meters |
R11SS-P32 | R10LL-P36 | 5 meters |
Twelve-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect twelve racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, interconnecting 10 or more of these racks requires modification to the following cabling tables. Contact Oracle for further details.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a 12 rack system.
Table 22-76 Leaf Switch Connections for the First Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R1UL-P1 to R12SS-P5 | 15 meters |
R1UL-P2 to R11SS-P5 | 15 meters |
R1UL-P3 to R1SS-P23 | 3 meters |
R1UL-P4 to R4SS-P5 | 10 meters |
R1UL-P5 to R1SS-P5 | 3 meters |
R1UL-P6 to R3SS-P5 | 5 meters |
R1UL-P7 to R8SS-P5 | 10 meters |
R1UL-P30 to R5SS-P5 | 10 meters |
R1UL-P31 to R2SS-P5 | 5 meters |
R1UL-P32 to R6SS-P5 | 10 meters |
R1UL-P33 to R7SS-P5 | 10 meters |
R1UL-P34 to R2SS-P23 | 5 meters |
R1UL-P35 to R10SS-P5 | 15 meters |
R1UL-P36 to R9SS-P5 | 10 meters |
R1LL-P1 to R2SS-P22 | 5 meters |
R1LL-P2 to R3SS-P22 | 5 meters |
R1LL-P3 to R11SS-P13 | 15 meters |
R1LL-P4 to R3SS-P13 | 5 meters |
R1LL-P5 to R1SS-P13 | 3 meters |
R1LL-P6 to R7SS-P13 | 10 meters |
R1LL-P7 to R5SS-P13 | 10 meters |
R1LL-P30 to R4SS-P13 | 10 meters |
R1LL-P31 to R2SS-P13 | 5 meters |
R1LL-P32 to R6SS-P13 | 10 meters |
R1LL-P33 to R8SS-P13 | 10 meters |
R1LL-P34 to R12SS-P13 | 15 meters |
R1LL-P35 to R10SS-P13 | 15 meters |
R1LL-P36 to R9SS-P13 | 10 meters |
Table 22-77 Leaf Switch Connections for the Second Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R2UL-P1 to R12SS-P6 | 15 meters |
R2UL-P2 to R3SS-P23 | 5 meters |
R2UL-P3 to R4SS-P23 | 5 meters |
R2UL-P4 to R4SS-P6 | 5 meters |
R2UL-P5 to R1SS-P6 | 5 meters |
R2UL-P6 to R3SS-P6 | 5 meters |
R2UL-P7 to R5SS-P6 | 10 meters |
R2UL-P30 to R8SS-P6 | 10 meters |
R2UL-P31 to R2SS-P6 | 3 meters |
R2UL-P32 to R7SS-P6 | 10 meters |
R2UL-P33 to R6SS-P6 | 10 meters |
R2UL-P34 to R10SS-P6 | 10 meters |
R2UL-P35 to R11SS-P6 | 15 meters |
R2UL-P36 to R9SS-P6 | 10 meters |
R2LL-P1 to R12SS-P14 | 15 meters |
R2LL-P2 to R4SS-P22 | 5 meters |
R2LL-P3 to R9SS-P14 | 10 meters |
R2LL-P4 to R4SS-P14 | 5 meters |
R2LL-P5 to R1SS-P14 | 5 meters |
R2LL-P6 to R3SS-P14 | 5 meters |
R2LL-P7 to R6SS-P14 | 10 meters |
R2LL-P30 to R8SS-P14 | 10 meters |
R2LL-P31 to R2SS-P14 | 3 meters |
R2LL-P32 to R7SS-P14 | 10 meters |
R2LL-P33 to R5SS-P14 | 10 meters |
R2LL-P34 to R11SS-P14 | 15 meters |
R2LL-P35 to R5SS-P22 | 10 meters |
R2LL-P36 to R10SS-P14 | 10 meters |
Table 22-78 Leaf Switch Connections for the Third Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R3UL-P1 to R6SS-P23 | 10 meters |
R3UL-P2 to R9SS-P11 | 10 meters |
R3UL-P3 to R10SS-P11 | 10 meters |
R3UL-P4 to R4SS-P11 | 5 meters |
R3UL-P5 to R1SS-P11 | 5 meters |
R3UL-P6 to R2SS-P11 | 5 meters |
R3UL-P7 to R6SS-P11 | 10 meters |
R3UL-P30 to R3SS-P11 | 3 meters |
R3UL-P31 to R7SS-P11 | 10 meters |
R3UL-P32 to R5SS-P11 | 5 meters |
R3UL-P33 to R8SS-P11 | 10 meters |
R3UL-P34 to R5SS-P23 | 5 meters |
R3UL-P35 to R12SS-P11 | 15 meters |
R3UL-P36 to R11SS-P11 | 10 meters |
R3LL-P1 to R7SS-P22 | 10 meters |
R3LL-P2 to R10SS-P20 | 10 meters |
R3LL-P3 to R9SS-P20 | 10 meters |
R3LL-P4 to R1SS-P20 | 5 meters |
R3LL-P5 to R5SS-P20 | 5 meters |
R3LL-P6 to R8SS-P20 | 10 meters |
R3LL-P7 to R7SS-P20 | 10 meters |
R3LL-P30 to R6SS-P20 | 10 meters |
R3LL-P31 to R2SS-P20 | 5 meters |
R3LL-P32 to R3SS-P20 | 3 meters |
R3LL-P33 to R4SS-P20 | 5 meters |
R3LL-P34 to R11SS-P20 | 10 meters |
R3LL-P35 to R6SS-P22 | 10 meters |
R3LL-P36 to R12SS-P20 | 15 meters |
Table 22-79 Leaf Switch Connections for the Fourth Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R4UL-P1 to R8SS-P23 | 10 meters |
R4UL-P2 to R11SS-P10 | 10 meters |
R4UL-P3 to R10SS-P10 | 10 meters |
R4UL-P4 to R8SS-P10 | 10 meters |
R4UL-P5 to R5SS-P10 | 5 meters |
R4UL-P6 to R2SS-P10 | 5 meters |
R4UL-P7 to R1SS-P10 | 10 meters |
R4UL-P30 to R6SS-P10 | 5 meters |
R4UL-P31 to R7SS-P10 | 10 meters |
R4UL-P32 to R4SS-P10 | 3 meters |
R4UL-P33 to R3SS-P10 | 5 meters |
R4UL-P34 to R9SS-P10 | 10 meters |
R4UL-P35 to R12SS-P10 | 10 meters |
R4UL-P36 to R7SS-P23 | 10 meters |
R4LL-P1 to R9SS-P17 | 10 meters |
R4LL-P2 to R10SS-P17 | 10 meters |
R4LL-P3 to R11SS-P17 | 10 meters |
R4LL-P4 to R2SS-P17 | 5 meters |
R4LL-P5 to R1SS-P17 | 10 meters |
R4LL-P6 to R6SS-P17 | 5 meters |
R4LL-P7 to R5SS-P17 | 5 meters |
R4LL-P30 to R4SS-P17 | 3 meters |
R4LL-P31 to R3SS-P17 | 5 meters |
R4LL-P32 to R7SS-P17 | 10 meters |
R4LL-P33 to R8SS-P17 | 10 meters |
R4LL-P34 to R12SS-P17 | 10 meters |
R4LL-P35 to R9SS-P22 | 10 meters |
R4LL-P36 to R8SS-P22 | 10 meters |
Table 22-80 Leaf Switch Connections for the Fifth Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R5UL-P1 to R10SS-P7 | 10 meters |
R5UL-P2 to R12SS-P7 | 10 meters |
R5UL-P3 to R11SS-P7 | 10 meters |
R5UL-P4 to R2SS-P8 | 10 meters |
R5UL-P5 to R1SS-P8 | 10 meters |
R5UL-P6 to R3SS-P8 | 5 meters |
R5UL-P7 to R6SS-P7 | 5 meters |
R5UL-P30 to R5SS-P7 | 3 meters |
R5UL-P31 to R8SS-P7 | 10 meters |
R5UL-P32 to R7SS-P7 | 5 meters |
R5UL-P33 to R4SS-P12 | 5 meters |
R5UL-P34 to R10SS-P23 | 10 meters |
R5UL-P35 to R9SS-P7 | 10 meters |
R5UL-P36 to R9SS-P23 | 10 meters |
R5LL-P1 to R9SS-P15 | 10 meters |
R5LL-P2 to R12SS-P15 | 10 meters |
R5LL-P3 to R11SS-P15 | 10 meters |
R5LL-P4 to R6SS-P15 | 5 meters |
R5LL-P5 to R7SS-P15 | 5 meters |
R5LL-P6 to R2SS-P18 | 10 meters |
R5LL-P7 to R1SS-P18 | 10 meters |
R5LL-P30 to R5SS-P15 | 3 meters |
R5LL-P31 to R3SS-P16 | 5 meters |
R5LL-P32 to R8SS-P15 | 10 meters |
R5LL-P33 to R4SS-P19 | 5 meters |
R5LL-P34 to R11SS-P22 | 10 meters |
R5LL-P35 to R10SS-P15 | 10 meters |
R5LL-P36 to R10SS-P22 | 10 meters |
Table 22-81 Leaf Switch Connections for the Sixth Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R6UL-P1 to R11SS-P23 | 10 meters |
R6UL-P2 to R11SS-P16 | 10 meters |
R6UL-P3 to R9SS-P16 | 10 meters |
R6UL-P4 to R2SS-P16 | 10 meters |
R6UL-P5 to R7SS-P16 | 5 meters |
R6UL-P6 to R3SS-P19 | 10 meters |
R6UL-P7 to R1SS-P16 | 10 meters |
R6UL-P30 to R6SS-P16 | 3 meters |
R6UL-P31 to R4SS-P15 | 5 meters |
R6UL-P32 to R8SS-P16 | 5 meters |
R6UL-P33 to R5SS-P18 | 5 meters |
R6UL-P34 to R12SS-P16 | 10 meters |
R6UL-P35 to R10SS-P16 | 10 meters |
R6UL-P36 to R12SS-P23 | 10 meters |
R6LL-P1 to R9SS-P8 | 10 meters |
R6LL-P2 to R10SS-P8 | 10 meters |
R6LL-P3 to R1SS-P22 | 10 meters |
R6LL-P4 to R2SS-P12 | 10 meters |
R6LL-P5 to R1SS-P12 | 10 meters |
R6LL-P6 to R7SS-P8 | 5 meters |
R6LL-P7 to R8SS-P8 | 5 meters |
R6LL-P30 to R5SS-P8 | 5 meters |
R6LL-P31 to R3SS-P7 | 10 meters |
R6LL-P32 to R6SS-P8 | 3 meters |
R6LL-P33 to R4SS-P9 | 5 meters |
R6LL-P34 to R12SS-P22 | 10 meters |
R6LL-P35 to R11SS-P8 | 10 meters |
R6LL-P36 to R12SS-P8 | 10 meters |
Table 22-82 Leaf Switch Connections for the Seventh Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R7UL-P1 to R2SS-P26 | 10 meters |
R7UL-P2 to R9SS-P9 | 5 meters |
R7UL-P3 to R1SS-P26 | 10 meters |
R7UL-P4 to R3SS-P9 | 10 meters |
R7UL-P5 to R1SS-P9 | 10 meters |
R7UL-P6 to R4SS-P8 | 10 meters |
R7UL-P7 to R2SS-P7 | 10 meters |
R7UL-P30 to R7SS-P9 | 3 meters |
R7UL-P31 to R5SS-P9 | 5 meters |
R7UL-P32 to R8SS-P9 | 5 meters |
R7UL-P33 to R6SS-P9 | 5 meters |
R7UL-P34 to R12SS-P9 | 10 meters |
R7UL-P35 to R11SS-P9 | 10 meters |
R7UL-P36 to R10SS-P9 | 10 meters |
R7LL-P1 to R9SS-P12 | 5 meters |
R7LL-P2 to R10SS-P12 | 10 meters |
R7LL-P3 to R3SS-P30 | 10 meters |
R7LL-P4 to R3SS-P15 | 10 meters |
R7LL-P5 to R1SS-P19 | 10 meters |
R7LL-P6 to R4SS-P18 | 10 meters |
R7LL-P7 to R2SS-P19 | 10 meters |
R7LL-P30 to R7SS-P18 | 3 meters |
R7LL-P31 to R5SS-P16 | 5 meters |
R7LL-P32 to R8SS-P12 | 5 meters |
R7LL-P33 to R6SS-P18 | 5 meters |
R7LL-P34 to R12SS-P12 | 10 meters |
R7LL-P35 to R11SS-P12 | 10 meters |
R7LL-P36 to R2SS-P30 | 10 meters |
Table 22-83 Leaf Switch Connections for the Eighth Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R8UL-P1 to R9SS-P19 | 5 meters |
R8UL-P2 to R10SS-P19 | 5 meters |
R8UL-P3 to R3SS-P26 | 10 meters |
R8UL-P4 to R3SS-P18 | 10 meters |
R8UL-P5 to R1SS-P15 | 10 meters |
R8UL-P6 to R4SS-P16 | 10 meters |
R8UL-P7 to R2SS-P15 | 10 meters |
R8UL-P30 to R7SS-P19 | 5 meters |
R8UL-P31 to R5SS-P19 | 10 meters |
R8UL-P32 to R8SS-P19 | 3 meters |
R8UL-P33 to R6SS-P19 | 5 meters |
R8UL-P34 to R12SS-P19 | 10 meters |
R8UL-P35 to R11SS-P19 | 10 meters |
R8UL-P36 to R4SS-P26 | 10 meters |
R8LL-P1 to R5SS-P30 | 10 meters |
R8LL-P2 to R9SS-P18 | 5 meters |
R8LL-P3 to R4SS-P30 | 10 meters |
R8LL-P4 to R3SS-P12 | 10 meters |
R8LL-P5 to R1SS-P7 | 10 meters |
R8LL-P6 to R4SS-P7 | 10 meters |
R8LL-P7 to R2SS-P9 | 10 meters |
R8LL-P30 to R7SS-P12 | 5 meters |
R8LL-P31 to R5SS-P12 | 10 meters |
R8LL-P32 to R8SS-P18 | 3 meters |
R8LL-P33 to R6SS-P12 | 5 meters |
R8LL-P34 to R12SS-P18 | 10 meters |
R8LL-P35 to R11SS-P18 | 10 meters |
R8LL-P36 to R10SS-P18 | 5 meters |
Table 22-84 Leaf Switch Connections for the Ninth Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R9UL-P1 to R1SS-P24 | 10 meters |
R9UL-P2 to R5SS-P26 | 10 meters |
R9UL-P3 to R2SS-P24 | 10 meters |
R9UL-P4 to R10SS-P24 | 5 meters |
R9UL-P5 to R3SS-P24 | 10 meters |
R9UL-P6 to R11SS-P24 | 5 meters |
R9UL-P7 to R4SS-P24 | 10 meters |
R9UL-P30 to R5SS-P24 | 10 meters |
R9UL-P31 to R6SS-P24 | 10 meters |
R9UL-P32 to R7SS-P24 | 5 meters |
R9UL-P33 to R8SS-P24 | 5 meters |
R9UL-P34 to R6SS-P26 | 10 meters |
R9UL-P35 to R9SS-P24 | 3 meters |
R9UL-P36 to R12SS-P24 | 10 meters |
R9LL-P1 to R1SS-P29 | 10 meters |
R9LL-P2 to R11SS-P29 | 5 meters |
R9LL-P3 to R2SS-P29 | 10 meters |
R9LL-P4 to R6SS-P30 | 10 meters |
R9LL-P5 to R3SS-P29 | 10 meters |
R9LL-P6 to R10SS-P29 | 5 meters |
R9LL-P7 to R4SS-P29 | 10 meters |
R9LL-P30 to R12SS-P29 | 10 meters |
R9LL-P31 to R5SS-P29 | 10 meters |
R9LL-P32 to R6SS-P29 | 10 meters |
R9LL-P33 to R7SS-P29 | 5 meters |
R9LL-P34 to R8SS-P29 | 5 meters |
R9LL-P35 to R9SS-P29 | 3 meters |
R9LL-P36 to R7SS-P30 | 5 meters |
Table 22-85 Leaf Switch Connections for the Tenth Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R10UL-P1 to R1SS-P21 | 15 meters |
R10UL-P2 to R11SS-P21 | 5 meters |
R10UL-P3 to R2SS-P21 | 10 meters |
R10UL-P4 to R10SS-P21 | 3 meters |
R10UL-P5 to R3SS-P21 | 10 meters |
R10UL-P6 to R8SS-P26 | 5 meters |
R10UL-P7 to R4SS-P21 | 10 meters |
R10UL-P30 to R5SS-P21 | 10 meters |
R10UL-P31 to R6SS-P21 | 10 meters |
R10UL-P32 to R7SS-P21 | 10 meters |
R10UL-P33 to R8SS-P21 | 5 meters |
R10UL-P34 to R12SS-P21 | 5 meters |
R10UL-P35 to R9SS-P21 | 5 meters |
R10UL-P36 to R7SS-P26 | 10 meters |
R10LL-P1 to R1SS-P31 | 15 meters |
R10LL-P2 to R12SS-P31 | 5 meters |
R10LL-P3 to R2SS-P31 | 10 meters |
R10LL-P4 to R11SS-P31 | 5 meters |
R10LL-P5 to R3SS-P31 | 10 meters |
R10LL-P6 to R10SS-P31 | 3 meters |
R10LL-P7 to R4SS-P31 | 10 meters |
R10LL-P30 to R8SS-P31 | 5 meters |
R10LL-P31 to R5SS-P31 | 10 meters |
R10LL-P32 to R6SS-P31 | 10 meters |
R10LL-P33 to R7SS-P31 | 10 meters |
R10LL-P34 to R8SS-P30 | 5 meters |
R10LL-P35 to R9SS-P30 | 5 meters |
R10LL-P36 to R9SS-P31 | 5 meters |
Table 22-86 Leaf Switch Connections for the Eleventh Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R11UL-P1 to R1SS-P25 | 15 meters |
R11UL-P2 to R11SS-P25 | 3 meters |
R11UL-P3 to R2SS-P25 | 15 meters |
R11UL-P4 to R10SS-P25 | 5 meters |
R11UL-P5 to R3SS-P25 | 10 meters |
R11UL-P6 to R10SS-P26 | 5 meters |
R11UL-P7 to R4SS-P25 | 10 meters |
R11UL-P30 to R5SS-P25 | 10 meters |
R11UL-P31 to R6SS-P25 | 10 meters |
R11UL-P32 to R7SS-P25 | 10 meters |
R11UL-P33 to R8SS-P25 | 10 meters |
R11UL-P34 to R12SS-P25 | 5 meters |
R11UL-P35 to R9SS-P25 | 5 meters |
R11UL-P36 to R9SS-P26 | 5 meters |
R11LL-P1 to R1SS-P28 | 15 meters |
R11LL-P2 to R10SS-P30 | 5 meters |
R11LL-P3 to R2SS-P28 | 15 meters |
R11LL-P4 to R11SS-P28 | 3 meters |
R11LL-P5 to R3SS-P28 | 10 meters |
R11LL-P6 to R10SS-P28 | 5 meters |
R11LL-P7 to R4SS-P28 | 10 meters |
R11LL-P30 to R11SS-P30 | 3 meters |
R11LL-P31 to R5SS-P28 | 10 meters |
R11LL-P32 to R6SS-P28 | 10 meters |
R11LL-P33 to R7SS-P28 | 10 meters |
R11LL-P34 to R8SS-P28 | 10 meters |
R11LL-P35 to R9SS-P28 | 5 meters |
R11LL-P36 to R12SS-P28 | 5 meters |
Table 22-87 Leaf Switch Connections for the Twelfth Rack in a 12 Rack System
Connection | Cable Length |
---|---|
R12UL-P1 to R1SS-P27 | 15 meters |
R12UL-P2 to R11SS-P27 | 5 meters |
R12UL-P3 to R2SS-P27 | 15 meters |
R12UL-P4 to R10SS-P27 | 5 meters |
R12UL-P5 to R3SS-P27 | 15 meters |
R12UL-P6 to R11SS-P26 | 5 meters |
R12UL-P7 to R4SS-P27 | 10 meters |
R12UL-P30 to R5SS-P27 | 10 meters |
R12UL-P31 to R6SS-P27 | 10 meters |
R12UL-P32 to R7SS-P27 | 10 meters |
R12UL-P33 to R8SS-P27 | 10 meters |
R12UL-P34 to R12SS-P27 | 3 meters |
R12UL-P35 to R9SS-P27 | 10 meters |
R12UL-P36 to R12SS-P26 | 3 meters |
R12LL-P1 to R1SS-P32 | 15 meters |
R12LL-P2 to R1SS-P30 | 15 meters |
R12LL-P3 to R2SS-P32 | 15 meters |
R12LL-P4 to R11SS-P32 | 5 meters |
R12LL-P5 to R3SS-P32 | 15 meters |
R12LL-P6 to R10SS-P32 | 5 meters |
R12LL-P7 to R4SS-P32 | 10 meters |
R12LL-P30 to R12SS-P30 | 3 meters |
R12LL-P31 to R5SS-P32 | 10 meters |
R12LL-P32 to R6SS-P32 | 10 meters |
R12LL-P33 to R7SS-P32 | 10 meters |
R12LL-P34 to R8SS-P32 | 10 meters |
R12LL-P35 to R9SS-P32 | 10 meters |
R12LL-P36 to R12SS-P32 | 3 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-88 Twelve-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R8LL-P5 | 10 meters |
R1SS-P8 | R5UL-P5 | 10 meters |
R1SS-P9 | R7UL-P5 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R6LL-P5 | 10 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R8UL-P5 | 10 meters |
R1SS-P16 | R6UL-P7 | 10 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R5LL-P7 | 10 meters |
R1SS-P19 | R7LL-P5 | 10 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R10UL-P1 | 15 meters |
R1SS-P22 | R6LL-P3 | 10 meters |
R1SS-P23 | R1UL-P3 | 3 meters |
R1SS-P24 | R9UL-P1 | 10 meters |
R1SS-P25 | R11UL-P1 | 15 meters |
R1SS-P26 | R7UL-P3 | 10 meters |
R1SS-P27 | R12UL-P1 | 15 meters |
R1SS-P28 | R11LL-P1 | 15 meters |
R1SS-P29 | R9LL-P1 | 10 meters |
R1SS-P30 | R12LL-P2 | 15 meters |
R1SS-P31 | R10LL-P1 | 15 meters |
R1SS-P32 | R12LL-P1 | 15 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R7UL-P7 | 10 meters |
R2SS-P8 | R5UL-P4 | 10 meters |
R2SS-P9 | R8LL-P7 | 10 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R6LL-P4 | 10 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R8UL-P7 | 10 meters |
R2SS-P16 | R6UL-P4 | 10 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R5LL-P6 | 10 meters |
R2SS-P19 | R7LL-P7 | 10 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R10UL-P3 | 10 meters |
R2SS-P22 | R1LL-P1 | 5 meters |
R2SS-P23 | R1UL-P34 | 5 meters |
R2SS-P24 | R9UL-P3 | 10 meters |
R2SS-P25 | R11UL-P3 | 15 meters |
R2SS-P26 | R7UL-P1 | 10 meters |
R2SS-P27 | R12UL-P3 | 15 meters |
R2SS-P28 | R11LL-P3 | 15 meters |
R2SS-P29 | R9LL-P3 | 10 meters |
R2SS-P30 | R7LL-P36 | 10 meters |
R2SS-P31 | R10LL-P3 | 10 meters |
R2SS-P32 | R12LL-P3 | 15 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R6LL-P31 | 10 meters |
R3SS-P8 | R5UL-P6 | 5 meters |
R3SS-P9 | R7UL-P4 | 10 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R8LL-P4 | 10 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R7LL-P4 | 10 meters |
R3SS-P16 | R5LL-P31 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R8UL-P4 | 10 meters |
R3SS-P19 | R6UL-P6 | 10 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R10UL-P5 | 10 meters |
R3SS-P22 | R1LL-P2 | 5 meters |
R3SS-P23 | R2UL-P2 | 5 meters |
R3SS-P24 | R9UL-P5 | 10 meters |
R3SS-P25 | R11UL-P5 | 10 meters |
R3SS-P26 | R8UL-P3 | 10 meters |
R3SS-P27 | R12UL-P5 | 15 meters |
R3SS-P28 | R11LL-P5 | 10 meters |
R3SS-P29 | R9LL-P5 | 10 meters |
R3SS-P30 | R7LL-P3 | 10 meters |
R3SS-P31 | R10LL-P5 | 10 meters |
R3SS-P32 | R12LL-P5 | 15 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R8LL-P6 | 10 meters |
R4SS-P8 | R7UL-P6 | 10 meters |
R4SS-P9 | R6LL-P33 | 5 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R5UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R6UL-P31 | 5 meters |
R4SS-P16 | R8UL-P6 | 10 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R7LL-P6 | 10 meters |
R4SS-P19 | R5LL-P33 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R10UL-P7 | 10 meters |
R4SS-P22 | R2LL-P2 | 5 meters |
R4SS-P23 | R2UL-P3 | 5 meters |
R4SS-P24 | R9UL-P7 | 10 meters |
R4SS-P25 | R11UL-P7 | 10 meters |
R4SS-P26 | R8UL-P36 | 10 meters |
R4SS-P27 | R12UL-P7 | 10 meters |
R4SS-P28 | R11LL-P7 | 10 meters |
R4SS-P29 | R9LL-P7 | 10 meters |
R4SS-P30 | R8LL-P3 | 10 meters |
R4SS-P31 | R10LL-P7 | 10 meters |
R4SS-P32 | R12LL-P7 | 10 meters |
R5SS-P5 | R1UL-P30 | 10 meters |
R5SS-P6 | R2UL-P7 | 10 meters |
R5SS-P7 | R5UL-P30 | 3 meters |
R5SS-P8 | R6LL-P30 | 5 meters |
R5SS-P9 | R7UL-P31 | 5 meters |
R5SS-P10 | R4UL-P5 | 5 meters |
R5SS-P11 | R3UL-P32 | 5 meters |
R5SS-P12 | R8LL-P31 | 10 meters |
R5SS-P13 | R1LL-P7 | 10 meters |
R5SS-P14 | R2LL-P33 | 10 meters |
R5SS-P15 | R5LL-P30 | 3 meters |
R5SS-P16 | R7LL-P31 | 5 meters |
R5SS-P17 | R4LL-P7 | 5 meters |
R5SS-P18 | R6UL-P33 | 5 meters |
R5SS-P19 | R8UL-P31 | 10 meters |
R5SS-P20 | R3LL-P5 | 5 meters |
R5SS-P21 | R10UL-P30 | 10 meters |
R5SS-P22 | R2LL-P35 | 10 meters |
R5SS-P23 | R3UL-P34 | 5 meters |
R5SS-P24 | R9UL-P30 | 10 meters |
R5SS-P25 | R11UL-P30 | 10 meters |
R5SS-P26 | R9UL-P2 | 10 meters |
R5SS-P27 | R12UL-P30 | 10 meters |
R5SS-P28 | R11LL-P31 | 10 meters |
R5SS-P29 | R9LL-P31 | 10 meters |
R5SS-P30 | R8LL-P1 | 10 meters |
R5SS-P31 | R10LL-P31 | 10 meters |
R5SS-P32 | R12LL-P31 | 10 meters |
R6SS-P5 | R1UL-P32 | 10 meters |
R6SS-P6 | R2UL-P33 | 10 meters |
R6SS-P7 | R5UL-P7 | 5 meters |
R6SS-P8 | R6LL-P32 | 3 meters |
R6SS-P9 | R7UL-P33 | 5 meters |
R6SS-P10 | R4UL-P30 | 5 meters |
R6SS-P11 | R3UL-P7 | 10 meters |
R6SS-P12 | R8LL-P33 | 5 meters |
R6SS-P13 | R1LL-P32 | 10 meters |
R6SS-P14 | R2LL-P7 | 10 meters |
R6SS-P15 | R5LL-P4 | 5 meters |
R6SS-P16 | R6UL-P30 | 3 meters |
R6SS-P17 | R4LL-P6 | 5 meters |
R6SS-P18 | R7LL-P33 | 5 meters |
R6SS-P19 | R8UL-P33 | 5 meters |
R6SS-P20 | R3LL-P30 | 10 meters |
R6SS-P21 | R10UL-P31 | 10 meters |
R6SS-P22 | R3LL-P35 | 10 meters |
R6SS-P23 | R3UL-P1 | 10 meters |
R6SS-P24 | R9UL-P31 | 10 meters |
R6SS-P25 | R11UL-P31 | 10 meters |
R6SS-P26 | R9UL-P34 | 10 meters |
R6SS-P27 | R12UL-P31 | 10 meters |
R6SS-P28 | R11LL-P32 | 10 meters |
R6SS-P29 | R9LL-P32 | 10 meters |
R6SS-P30 | R9LL-P4 | 10 meters |
R6SS-P31 | R10LL-P32 | 10 meters |
R6SS-P32 | R12LL-P32 | 10 meters |
R7SS-P5 | R1UL-P33 | 10 meters |
R7SS-P6 | R2UL-P32 | 10 meters |
R7SS-P7 | R5UL-P32 | 5 meters |
R7SS-P8 | R6LL-P6 | 5 meters |
R7SS-P9 | R7UL-P30 | 3 meters |
R7SS-P10 | R4UL-P31 | 10 meters |
R7SS-P11 | R3UL-P31 | 10 meters |
R7SS-P12 | R8LL-P30 | 5 meters |
R7SS-P13 | R1LL-P6 | 10 meters |
R7SS-P14 | R2LL-P32 | 10 meters |
R7SS-P15 | R5LL-P5 | 5 meters |
R7SS-P16 | R6UL-P5 | 5 meters |
R7SS-P17 | R4LL-P32 | 10 meters |
R7SS-P18 | R7LL-P30 | 3 meters |
R7SS-P19 | R8UL-P30 | 5 meters |
R7SS-P20 | R3LL-P7 | 10 meters |
R7SS-P21 | R10UL-P32 | 10 meters |
R7SS-P22 | R3LL-P1 | 10 meters |
R7SS-P23 | R4UL-P36 | 10 meters |
R7SS-P24 | R9UL-P32 | 5 meters |
R7SS-P25 | R11UL-P32 | 10 meters |
R7SS-P26 | R10UL-P36 | 10 meters |
R7SS-P27 | R12UL-P32 | 10 meters |
R7SS-P28 | R11LL-P33 | 10 meters |
R7SS-P29 | R9LL-P33 | 5 meters |
R7SS-P30 | R9LL-P36 | 5 meters |
R7SS-P31 | R10LL-P33 | 10 meters |
R7SS-P32 | R12LL-P33 | 10 meters |
R8SS-P5 | R1UL-P7 | 10 meters |
R8SS-P6 | R2UL-P30 | 10 meters |
R8SS-P7 | R5UL-P31 | 10 meters |
R8SS-P8 | R6LL-P7 | 5 meters |
R8SS-P9 | R7UL-P32 | 5 meters |
R8SS-P10 | R4UL-P4 | 10 meters |
R8SS-P11 | R3UL-P33 | 10 meters |
R8SS-P12 | R7LL-P32 | 5 meters |
R8SS-P13 | R1LL-P33 | 10 meters |
R8SS-P14 | R2LL-P30 | 10 meters |
R8SS-P15 | R5LL-P32 | 10 meters |
R8SS-P16 | R6UL-P32 | 5 meters |
R8SS-P17 | R4LL-P33 | 10 meters |
R8SS-P18 | R8LL-P32 | 3 meters |
R8SS-P19 | R8UL-P32 | 3 meters |
R8SS-P20 | R3LL-P6 | 10 meters |
R8SS-P21 | R10UL-P33 | 5 meters |
R8SS-P22 | R4LL-P36 | 10 meters |
R8SS-P23 | R4UL-P1 | 10 meters |
R8SS-P24 | R9UL-P33 | 5 meters |
R8SS-P25 | R11UL-P33 | 10 meters |
R8SS-P26 | R10UL-P6 | 5 meters |
R8SS-P27 | R12UL-P33 | 10 meters |
R8SS-P28 | R11LL-P34 | 10 meters |
R8SS-P29 | R9LL-P34 | 5 meters |
R8SS-P30 | R10LL-P34 | 5 meters |
R8SS-P31 | R10LL-P30 | 5 meters |
R8SS-P32 | R12LL-P34 | 10 meters |
R9SS-P5 | R1UL-P36 | 10 meters |
R9SS-P6 | R2UL-P36 | 10 meters |
R9SS-P7 | R5UL-P35 | 10 meters |
R9SS-P8 | R6LL-P1 | 10 meters |
R9SS-P9 | R7UL-P2 | 5 meters |
R9SS-P10 | R4UL-P34 | 10 meters |
R9SS-P11 | R3UL-P2 | 10 meters |
R9SS-P12 | R7LL-P1 | 5 meters |
R9SS-P13 | R1LL-P36 | 10 meters |
R9SS-P14 | R2LL-P3 | 10 meters |
R9SS-P15 | R5LL-P1 | 10 meters |
R9SS-P16 | R6UL-P3 | 10 meters |
R9SS-P17 | R4LL-P1 | 10 meters |
R9SS-P18 | R8LL-P2 | 5 meters |
R9SS-P19 | R8UL-P1 | 5 meters |
R9SS-P20 | R3LL-P3 | 10 meters |
R9SS-P21 | R10UL-P35 | 5 meters |
R9SS-P22 | R4LL-P35 | 10 meters |
R9SS-P23 | R5UL-P36 | 10 meters |
R9SS-P24 | R9UL-P35 | 3 meters |
R9SS-P25 | R11UL-P35 | 5 meters |
R9SS-P26 | R11UL-P36 | 5 meters |
R9SS-P27 | R12UL-P35 | 10 meters |
R9SS-P28 | R11LL-P35 | 5 meters |
R9SS-P29 | R9LL-P35 | 3 meters |
R9SS-P30 | R10LL-P35 | 5 meters |
R9SS-P31 | R10LL-P36 | 5 meters |
R9SS-P32 | R12LL-P35 | 10 meters |
R10SS-P5 | R1UL-P35 | 15 meters |
R10SS-P6 | R2UL-P34 | 10 meters |
R10SS-P7 | R5UL-P1 | 10 meters |
R10SS-P8 | R6LL-P2 | 10 meters |
R10SS-P9 | R7UL-P36 | 10 meters |
R10SS-P10 | R4UL-P3 | 10 meters |
R10SS-P11 | R3UL-P3 | 10 meters |
R10SS-P12 | R7LL-P2 | 10 meters |
R10SS-P13 | R1LL-P35 | 15 meters |
R10SS-P14 | R2LL-P36 | 10 meters |
R10SS-P15 | R5LL-P35 | 10 meters |
R10SS-P16 | R6UL-P35 | 10 meters |
R10SS-P17 | R4LL-P2 | 10 meters |
R10SS-P18 | R8LL-P36 | 5 meters |
R10SS-P19 | R8UL-P2 | 5 meters |
R10SS-P20 | R3LL-P2 | 10 meters |
R10SS-P21 | R10UL-P4 | 3 meters |
R10SS-P22 | R5LL-P36 | 10 meters |
R10SS-P23 | R5UL-P34 | 10 meters |
R10SS-P24 | R9UL-P4 | 5 meters |
R10SS-P25 | R11UL-P4 | 5 meters |
R10SS-P26 | R11UL-P6 | 5 meters |
R10SS-P27 | R12UL-P4 | 5 meters |
R10SS-P28 | R11LL-P6 | 5 meters |
R10SS-P29 | R9LL-P6 | 5 meters |
R10SS-P30 | R11LL-P2 | 5 meters |
R10SS-P31 | R10LL-P6 | 3 meters |
R10SS-P32 | R12LL-P6 | 5 meters |
R11SS-P5 | R1UL-P2 | 15 meters |
R11SS-P6 | R2UL-P35 | 15 meters |
R11SS-P7 | R5UL-P3 | 10 meters |
R11SS-P8 | R6LL-P35 | 10 meters |
R11SS-P9 | R7UL-P35 | 10 meters |
R11SS-P10 | R4UL-P2 | 10 meters |
R11SS-P11 | R3UL-P36 | 10 meters |
R11SS-P12 | R7LL-P35 | 10 meters |
R11SS-P13 | R1LL-P3 | 15 meters |
R11SS-P14 | R2LL-P34 | 15 meters |
R11SS-P15 | R5LL-P3 | 10 meters |
R11SS-P16 | R6UL-P2 | 10 meters |
R11SS-P17 | R4LL-P3 | 10 meters |
R11SS-P18 | R8LL-P35 | 10 meters |
R11SS-P19 | R8UL-P35 | 10 meters |
R11SS-P20 | R3LL-P34 | 10 meters |
R11SS-P21 | R10UL-P2 | 5 meters |
R11SS-P22 | R5LL-P34 | 10 meters |
R11SS-P23 | R6UL-P1 | 10 meters |
R11SS-P24 | R9UL-P6 | 5 meters |
R11SS-P25 | R11UL-P2 | 3 meters |
R11SS-P26 | R12UL-P6 | 5 meters |
R11SS-P27 | R12UL-P2 | 5 meters |
R11SS-P28 | R11LL-P4 | 3 meters |
R11SS-P29 | R9LL-P2 | 5 meters |
R11SS-P30 | R11LL-P30 | 3 meters |
R11SS-P31 | R10LL-P4 | 5 meters |
R11SS-P32 | R12LL-P4 | 5 meters |
R12SS-P5 | R1UL-P1 | 15 meters |
R12SS-P6 | R2UL-P1 | 15 meters |
R12SS-P7 | R5UL-P2 | 10 meters |
R12SS-P8 | R6LL-P36 | 10 meters |
R12SS-P9 | R7UL-P34 | 10 meters |
R12SS-P10 | R4UL-P35 | 10 meters |
R12SS-P11 | R3UL-P35 | 15 meters |
R12SS-P12 | R7LL-P34 | 10 meters |
R12SS-P13 | R1LL-P34 | 15 meters |
R12SS-P14 | R2LL-P1 | 15 meters |
R12SS-P15 | R5LL-P2 | 10 meters |
R12SS-P16 | R6UL-P34 | 10 meters |
R12SS-P17 | R4LL-P34 | 10 meters |
R12SS-P18 | R8LL-P34 | 10 meters |
R12SS-P19 | R8UL-P34 | 10 meters |
R12SS-P20 | R3LL-P36 | 15 meters |
R12SS-P21 | R10UL-P34 | 5 meters |
R12SS-P22 | R6LL-P34 | 10 meters |
R12SS-P23 | R6UL-P36 | 10 meters |
R12SS-P24 | R9UL-P36 | 10 meters |
R12SS-P25 | R11UL-P34 | 5 meters |
R12SS-P26 | R12UL-P36 | 3 meters |
R12SS-P27 | R12UL-P34 | 3 meters |
R12SS-P28 | R11LL-P36 | 5 meters |
R12SS-P29 | R9LL-P30 | 10 meters |
R12SS-P30 | R12LL-P30 | 3 meters |
R12SS-P31 | R10LL-P2 | 5 meters |
R12SS-P32 | R12LL-P36 | 3 meters |
Thirteen-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect thirteen racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, interconnecting 10 or more of these racks requires modification to the following cabling tables. Contact Oracle for further details.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a 13 rack system.
Table 22-89 Leaf Switch Connections for the First Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R1UL-P1 to R12SS-P5 | 15 meters |
R1UL-P2 to R11SS-P5 | 15 meters |
R1UL-P3 to R1SS-P23 | 3 meters |
R1UL-P4 to R4SS-P5 | 10 meters |
R1UL-P5 to R1SS-P5 | 3 meters |
R1UL-P6 to R3SS-P5 | 5 meters |
R1UL-P7 to R8SS-P5 | 10 meters |
R1UL-P30 to R5SS-P5 | 10 meters |
R1UL-P31 to R2SS-P5 | 5 meters |
R1UL-P32 to R6SS-P5 | 10 meters |
R1UL-P33 to R7SS-P5 | 10 meters |
R1UL-P34 to R13SS-P5 | 15 meters |
R1UL-P35 to R10SS-P5 | 15 meters |
R1UL-P36 to R9SS-P5 | 10 meters |
R1LL-P1 to R2SS-P23 | 5 meters |
R1LL-P2 to R13SS-P13 | 15 meters |
R1LL-P3 to R11SS-P13 | 15 meters |
R1LL-P4 to R3SS-P13 | 5 meters |
R1LL-P5 to R1SS-P13 | 3 meters |
R1LL-P6 to R7SS-P13 | 10 meters |
R1LL-P7 to R5SS-P13 | 10 meters |
R1LL-P30 to R4SS-P13 | 10 meters |
R1LL-P31 to R2SS-P13 | 5 meters |
R1LL-P32 to R6SS-P13 | 10 meters |
R1LL-P33 to R8SS-P13 | 10 meters |
R1LL-P34 to R12SS-P13 | 15 meters |
R1LL-P35 to R10SS-P13 | 15 meters |
R1LL-P36 to R9SS-P13 | 10 meters |
Table 22-90 Leaf Switch Connections for the Second Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R2UL-P1 to R12SS-P6 | 15 meters |
R2UL-P2 to R3SS-P23 | 5 meters |
R2UL-P3 to R13SS-P6 | 15 meters |
R2UL-P4 to R4SS-P6 | 5 meters |
R2UL-P5 to R1SS-P6 | 5 meters |
R2UL-P6 to R3SS-P6 | 5 meters |
R2UL-P7 to R5SS-P6 | 10 meters |
R2UL-P30 to R8SS-P6 | 10 meters |
R2UL-P31 to R2SS-P6 | 3 meters |
R2UL-P32 to R7SS-P6 | 10 meters |
R2UL-P33 to R6SS-P6 | 10 meters |
R2UL-P34 to R10SS-P6 | 10 meters |
R2UL-P35 to R11SS-P6 | 15 meters |
R2UL-P36 to R9SS-P6 | 10 meters |
R2LL-P1 to R12SS-P14 | 15 meters |
R2LL-P2 to R4SS-P23 | 5 meters |
R2LL-P3 to R9SS-P14 | 10 meters |
R2LL-P4 to R4SS-P14 | 5 meters |
R2LL-P5 to R1SS-P14 | 5 meters |
R2LL-P6 to R3SS-P14 | 5 meters |
R2LL-P7 to R6SS-P14 | 10 meters |
R2LL-P30 to R8SS-P14 | 10 meters |
R2LL-P31 to R2SS-P14 | 3 meters |
R2LL-P32 to R7SS-P14 | 10 meters |
R2LL-P33 to R5SS-P14 | 10 meters |
R2LL-P34 to R11SS-P14 | 15 meters |
R2LL-P35 to R13SS-P14 | 15 meters |
R2LL-P36 to R10SS-P14 | 10 meters |
Table 22-91 Leaf Switch Connections for the Third Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R3UL-P1 to R13SS-P11 | 15 meters |
R3UL-P2 to R9SS-P11 | 10 meters |
R3UL-P3 to R10SS-P11 | 10 meters |
R3UL-P4 to R4SS-P11 | 5 meters |
R3UL-P5 to R1SS-P11 | 5 meters |
R3UL-P6 to R2SS-P11 | 5 meters |
R3UL-P7 to R6SS-P11 | 10 meters |
R3UL-P30 to R3SS-P11 | 3 meters |
R3UL-P31 to R7SS-P11 | 10 meters |
R3UL-P32 to R5SS-P11 | 5 meters |
R3UL-P33 to R8SS-P11 | 10 meters |
R3UL-P34 to R5SS-P23 | 5 meters |
R3UL-P35 to R12SS-P11 | 15 meters |
R3UL-P36 to R11SS-P11 | 10 meters |
R3LL-P1 to R13SS-P20 | 15 meters |
R3LL-P2 to R10SS-P20 | 10 meters |
R3LL-P3 to R9SS-P20 | 10 meters |
R3LL-P4 to R1SS-P20 | 5 meters |
R3LL-P5 to R5SS-P20 | 5 meters |
R3LL-P6 to R8SS-P20 | 10 meters |
R3LL-P7 to R7SS-P20 | 10 meters |
R3LL-P30 to R6SS-P20 | 10 meters |
R3LL-P31 to R2SS-P20 | 5 meters |
R3LL-P32 to R3SS-P20 | 3 meters |
R3LL-P33 to R4SS-P20 | 5 meters |
R3LL-P34 to R11SS-P20 | 10 meters |
R3LL-P35 to R6SS-P23 | 10 meters |
R3LL-P36 to R12SS-P20 | 15 meters |
Table 22-92 Leaf Switch Connections for the Fourth Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R4UL-P1 to R13SS-P10 | 15 meters |
R4UL-P2 to R11SS-P10 | 10 meters |
R4UL-P3 to R10SS-P10 | 10 meters |
R4UL-P4 to R8SS-P10 | 10 meters |
R4UL-P5 to R5SS-P10 | 5 meters |
R4UL-P6 to R2SS-P10 | 5 meters |
R4UL-P7 to R1SS-P10 | 10 meters |
R4UL-P30 to R6SS-P10 | 5 meters |
R4UL-P31 to R7SS-P10 | 10 meters |
R4UL-P32 to R4SS-P10 | 3 meters |
R4UL-P33 to R3SS-P10 | 5 meters |
R4UL-P34 to R9SS-P10 | 10 meters |
R4UL-P35 to R12SS-P10 | 10 meters |
R4UL-P36 to R7SS-P23 | 10 meters |
R4LL-P1 to R9SS-P17 | 10 meters |
R4LL-P2 to R10SS-P17 | 10 meters |
R4LL-P3 to R11SS-P17 | 10 meters |
R4LL-P4 to R2SS-P17 | 5 meters |
R4LL-P5 to R1SS-P17 | 10 meters |
R4LL-P6 to R6SS-P17 | 5 meters |
R4LL-P7 to R5SS-P17 | 5 meters |
R4LL-P30 to R4SS-P17 | 3 meters |
R4LL-P31 to R3SS-P17 | 5 meters |
R4LL-P32 to R7SS-P17 | 10 meters |
R4LL-P33 to R8SS-P17 | 10 meters |
R4LL-P34 to R12SS-P17 | 10 meters |
R4LL-P35 to R13SS-P17 | 15 meters |
R4LL-P36 to R8SS-P23 | 10 meters |
Table 22-93 Leaf Switch Connections for the Fifth Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R5UL-P1 to R10SS-P7 | 10 meters |
R5UL-P2 to R12SS-P7 | 10 meters |
R5UL-P3 to R11SS-P7 | 10 meters |
R5UL-P4 to R2SS-P8 | 10 meters |
R5UL-P5 to R1SS-P8 | 10 meters |
R5UL-P6 to R3SS-P8 | 5 meters |
R5UL-P7 to R6SS-P7 | 5 meters |
R5UL-P30 to R5SS-P7 | 3 meters |
R5UL-P31 to R8SS-P7 | 10 meters |
R5UL-P32 to R7SS-P7 | 5 meters |
R5UL-P33 to R4SS-P12 | 5 meters |
R5UL-P34 to R13SS-P7 | 10 meters |
R5UL-P35 to R9SS-P7 | 10 meters |
R5UL-P36 to R9SS-P23 | 10 meters |
R5LL-P1 to R9SS-P15 | 10 meters |
R5LL-P2 to R12SS-P15 | 10 meters |
R5LL-P3 to R11SS-P15 | 10 meters |
R5LL-P4 to R6SS-P15 | 5 meters |
R5LL-P5 to R7SS-P15 | 5 meters |
R5LL-P6 to R2SS-P18 | 10 meters |
R5LL-P7 to R1SS-P18 | 10 meters |
R5LL-P30 to R5SS-P15 | 3 meters |
R5LL-P31 to R3SS-P16 | 5 meters |
R5LL-P32 to R8SS-P15 | 10 meters |
R5LL-P33 to R4SS-P19 | 5 meters |
R5LL-P34 to R13SS-P15 | 10 meters |
R5LL-P35 to R10SS-P15 | 10 meters |
R5LL-P36 to R10SS-P23 | 10 meters |
Table 22-94 Leaf Switch Connections for the Sixth Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R6UL-P1 to R11SS-P23 | 10 meters |
R6UL-P2 to R11SS-P16 | 10 meters |
R6UL-P3 to R9SS-P16 | 10 meters |
R6UL-P4 to R2SS-P16 | 10 meters |
R6UL-P5 to R7SS-P16 | 5 meters |
R6UL-P6 to R3SS-P19 | 10 meters |
R6UL-P7 to R1SS-P16 | 10 meters |
R6UL-P30 to R6SS-P16 | 3 meters |
R6UL-P31 to R4SS-P15 | 5 meters |
R6UL-P32 to R8SS-P16 | 5 meters |
R6UL-P33 to R5SS-P18 | 5 meters |
R6UL-P34 to R12SS-P16 | 10 meters |
R6UL-P35 to R10SS-P16 | 10 meters |
R6UL-P36 to R13SS-P16 | 10 meters |
R6LL-P1 to R9SS-P8 | 10 meters |
R6LL-P2 to R10SS-P8 | 10 meters |
R6LL-P3 to R13SS-P8 | 10 meters |
R6LL-P4 to R2SS-P12 | 10 meters |
R6LL-P5 to R1SS-P12 | 10 meters |
R6LL-P6 to R7SS-P8 | 5 meters |
R6LL-P7 to R8SS-P8 | 5 meters |
R6LL-P30 to R5SS-P8 | 5 meters |
R6LL-P31 to R3SS-P7 | 10 meters |
R6LL-P32 to R6SS-P8 | 3 meters |
R6LL-P33 to R4SS-P9 | 5 meters |
R6LL-P34 to R12SS-P23 | 10 meters |
R6LL-P35 to R11SS-P8 | 10 meters |
R6LL-P36 to R12SS-P8 | 10 meters |
Table 22-95 Leaf Switch Connections for the Seventh Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R7UL-P1 to R13SS-P23 | 10 meters |
R7UL-P2 to R9SS-P9 | 5 meters |
R7UL-P3 to R13SS-P9 | 10 meters |
R7UL-P4 to R3SS-P9 | 10 meters |
R7UL-P5 to R1SS-P9 | 10 meters |
R7UL-P6 to R4SS-P8 | 10 meters |
R7UL-P7 to R2SS-P7 | 10 meters |
R7UL-P30 to R7SS-P9 | 3 meters |
R7UL-P31 to R5SS-P9 | 5 meters |
R7UL-P32 to R8SS-P9 | 5 meters |
R7UL-P33 to R6SS-P9 | 5 meters |
R7UL-P34 to R12SS-P9 | 10 meters |
R7UL-P35 to R11SS-P9 | 10 meters |
R7UL-P36 to R10SS-P9 | 10 meters |
R7LL-P1 to R9SS-P12 | 5 meters |
R7LL-P2 to R10SS-P12 | 10 meters |
R7LL-P3 to R1SS-P26 | 10 meters |
R7LL-P4 to R3SS-P15 | 10 meters |
R7LL-P5 to R1SS-P19 | 10 meters |
R7LL-P6 to R4SS-P18 | 10 meters |
R7LL-P7 to R2SS-P19 | 10 meters |
R7LL-P30 to R7SS-P18 | 3 meters |
R7LL-P31 to R5SS-P16 | 5 meters |
R7LL-P32 to R8SS-P12 | 5 meters |
R7LL-P33 to R6SS-P18 | 5 meters |
R7LL-P34 to R12SS-P12 | 10 meters |
R7LL-P35 to R11SS-P12 | 10 meters |
R7LL-P36 to R13SS-P12 | 10 meters |
Table 22-96 Leaf Switch Connections for the Eighth Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R8UL-P1 to R9SS-P19 | 5 meters |
R8UL-P2 to R10SS-P19 | 5 meters |
R8UL-P3 to R2SS-P26 | 10 meters |
R8UL-P4 to R3SS-P18 | 10 meters |
R8UL-P5 to R1SS-P15 | 10 meters |
R8UL-P6 to R4SS-P16 | 10 meters |
R8UL-P7 to R2SS-P15 | 10 meters |
R8UL-P30 to R7SS-P19 | 5 meters |
R8UL-P31 to R5SS-P19 | 10 meters |
R8UL-P32 to R8SS-P19 | 3 meters |
R8UL-P33 to R6SS-P19 | 5 meters |
R8UL-P34 to R12SS-P19 | 10 meters |
R8UL-P35 to R11SS-P19 | 10 meters |
R8UL-P36 to R13SS-P19 | 10 meters |
R8LL-P1 to R13SS-P18 | 10 meters |
R8LL-P2 to R9SS-P18 | 5 meters |
R8LL-P3 to R3SS-P26 | 10 meters |
R8LL-P4 to R3SS-P12 | 10 meters |
R8LL-P5 to R1SS-P7 | 10 meters |
R8LL-P6 to R4SS-P7 | 10 meters |
R8LL-P7 to R2SS-P9 | 10 meters |
R8LL-P30 to R7SS-P12 | 5 meters |
R8LL-P31 to R5SS-P12 | 10 meters |
R8LL-P32 to R8SS-P18 | 3 meters |
R8LL-P33 to R6SS-P12 | 5 meters |
R8LL-P34 to R12SS-P18 | 10 meters |
R8LL-P35 to R11SS-P18 | 10 meters |
R8LL-P36 to R10SS-P18 | 5 meters |
Table 22-97 Leaf Switch Connections for the Ninth Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R9UL-P1 to R1SS-P24 | 10 meters |
R9UL-P2 to R4SS-P26 | 10 meters |
R9UL-P3 to R2SS-P24 | 10 meters |
R9UL-P4 to R10SS-P24 | 5 meters |
R9UL-P5 to R3SS-P24 | 10 meters |
R9UL-P6 to R11SS-P24 | 5 meters |
R9UL-P7 to R4SS-P24 | 10 meters |
R9UL-P30 to R5SS-P24 | 10 meters |
R9UL-P31 to R6SS-P24 | 10 meters |
R9UL-P32 to R7SS-P24 | 5 meters |
R9UL-P33 to R8SS-P24 | 5 meters |
R9UL-P34 to R13SS-P24 | 10 meters |
R9UL-P35 to R9SS-P24 | 3 meters |
R9UL-P36 to R12SS-P24 | 10 meters |
R9LL-P1 to R1SS-P29 | 10 meters |
R9LL-P2 to R11SS-P29 | 5 meters |
R9LL-P3 to R2SS-P29 | 10 meters |
R9LL-P4 to R13SS-P29 | 10 meters |
R9LL-P5 to R3SS-P29 | 10 meters |
R9LL-P6 to R10SS-P29 | 5 meters |
R9LL-P7 to R4SS-P29 | 10 meters |
R9LL-P30 to R12SS-P29 | 10 meters |
R9LL-P31 to R5SS-P29 | 10 meters |
R9LL-P32 to R6SS-P29 | 10 meters |
R9LL-P33 to R7SS-P29 | 5 meters |
R9LL-P34 to R8SS-P29 | 5 meters |
R9LL-P35 to R9SS-P29 | 3 meters |
R9LL-P36 to R5SS-P26 | 10 meters |
Table 22-98 Leaf Switch Connections for the Tenth Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R10UL-P1 to R1SS-P21 | 15 meters |
R10UL-P2 to R11SS-P21 | 5 meters |
R10UL-P3 to R2SS-P21 | 10 meters |
R10UL-P4 to R10SS-P21 | 3 meters |
R10UL-P5 to R3SS-P21 | 10 meters |
R10UL-P6 to R13SS-P21 | 10 meters |
R10UL-P7 to R4SS-P21 | 10 meters |
R10UL-P30 to R5SS-P21 | 10 meters |
R10UL-P31 to R6SS-P21 | 10 meters |
R10UL-P32 to R7SS-P21 | 10 meters |
R10UL-P33 to R8SS-P21 | 5 meters |
R10UL-P34 to R12SS-P21 | 5 meters |
R10UL-P35 to R9SS-P21 | 5 meters |
R10UL-P36 to R6SS-P26 | 10 meters |
R10LL-P1 to R1SS-P31 | 15 meters |
R10LL-P2 to R12SS-P31 | 5 meters |
R10LL-P3 to R2SS-P31 | 10 meters |
R10LL-P4 to R11SS-P31 | 5 meters |
R10LL-P5 to R3SS-P31 | 10 meters |
R10LL-P6 to R10SS-P31 | 3 meters |
R10LL-P7 to R4SS-P31 | 10 meters |
R10LL-P30 to R7SS-P26 | 10 meters |
R10LL-P31 to R5SS-P31 | 10 meters |
R10LL-P32 to R6SS-P31 | 10 meters |
R10LL-P33 to R7SS-P31 | 10 meters |
R10LL-P34 to R8SS-P31 | 5 meters |
R10LL-P35 to R9SS-P31 | 5 meters |
R10LL-P36 to R13SS-P31 | 10 meters |
Table 22-99 Leaf Switch Connections for the Eleventh Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R11UL-P1 to R1SS-P25 | 15 meters |
R11UL-P2 to R11SS-P25 | 3 meters |
R11UL-P3 to R2SS-P25 | 15 meters |
R11UL-P4 to R10SS-P25 | 5 meters |
R11UL-P5 to R3SS-P25 | 10 meters |
R11UL-P6 to R13SS-P25 | 5 meters |
R11UL-P7 to R4SS-P25 | 10 meters |
R11UL-P30 to R5SS-P25 | 10 meters |
R11UL-P31 to R6SS-P25 | 10 meters |
R11UL-P32 to R7SS-P25 | 10 meters |
R11UL-P33 to R8SS-P25 | 10 meters |
R11UL-P34 to R12SS-P25 | 5 meters |
R11UL-P35 to R9SS-P25 | 5 meters |
R11UL-P36 to R8SS-P26 | 10 meters |
R11LL-P1 to R1SS-P28 | 15 meters |
R11LL-P2 to R13SS-P28 | 5 meters |
R11LL-P3 to R2SS-P28 | 15 meters |
R11LL-P4 to R11SS-P28 | 3 meters |
R11LL-P5 to R3SS-P28 | 10 meters |
R11LL-P6 to R10SS-P28 | 5 meters |
R11LL-P7 to R4SS-P28 | 10 meters |
R11LL-P30 to R9SS-P26 | 5 meters |
R11LL-P31 to R5SS-P28 | 10 meters |
R11LL-P32 to R6SS-P28 | 10 meters |
R11LL-P33 to R7SS-P28 | 10 meters |
R11LL-P34 to R8SS-P28 | 10 meters |
R11LL-P35 to R9SS-P28 | 5 meters |
R11LL-P36 to R12SS-P28 | 5 meters |
Table 22-100 Leaf Switch Connections for the Twelfth Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R12UL-P1 to R1SS-P22 | 15 meters |
R12UL-P2 to R11SS-P22 | 5 meters |
R12UL-P3 to R2SS-P22 | 15 meters |
R12UL-P4 to R10SS-P22 | 5 meters |
R12UL-P5 to R3SS-P22 | 15 meters |
R12UL-P6 to R10SS-P26 | 5 meters |
R12UL-P7 to R4SS-P22 | 10 meters |
R12UL-P30 to R5SS-P22 | 10 meters |
R12UL-P31 to R6SS-P22 | 10 meters |
R12UL-P32 to R7SS-P22 | 10 meters |
R12UL-P33 to R8SS-P22 | 10 meters |
R12UL-P34 to R12SS-P22 | 3 meters |
R12UL-P35 to R9SS-P22 | 10 meters |
R12UL-P36 to R13SS-P22 | 5 meters |
R12LL-P1 to R1SS-P32 | 15 meters |
R12LL-P2 to R11SS-P26 | 5 meters |
R12LL-P3 to R2SS-P32 | 15 meters |
R12LL-P4 to R11SS-P32 | 5 meters |
R12LL-P5 to R3SS-P32 | 15 meters |
R12LL-P6 to R10SS-P32 | 5 meters |
R12LL-P7 to R4SS-P32 | 10 meters |
R12LL-P30 to R13SS-P32 | 5 meters |
R12LL-P31 to R5SS-P32 | 10 meters |
R12LL-P32 to R6SS-P32 | 10 meters |
R12LL-P33 to R7SS-P32 | 10 meters |
R12LL-P34 to R8SS-P32 | 10 meters |
R12LL-P35 to R9SS-P32 | 10 meters |
R12LL-P36 to R12SS-P32 | 3 meters |
Table 22-101 Leaf Switch Connections for the Thirteenth Rack in a 13 Rack System
Connection | Cable Length |
---|---|
R13UL-P1 to R1SS-P27 | 15 meters |
R13UL-P2 to R11SS-P27 | 5 meters |
R13UL-P3 to R2SS-P27 | 15 meters |
R13UL-P4 to R10SS-P27 | 10 meters |
R13UL-P5 to R3SS-P27 | 15 meters |
R13UL-P6 to R12SS-P26 | 5 meters |
R13UL-P7 to R4SS-P27 | 15 meters |
R13UL-P30 to R5SS-P27 | 10 meters |
R13UL-P31 to R6SS-P27 | 10 meters |
R13UL-P32 to R7SS-P27 | 10 meters |
R13UL-P33 to R8SS-P27 | 10 meters |
R13UL-P34 to R12SS-P27 | 5 meters |
R13UL-P35 to R9SS-P27 | 10 meters |
R13UL-P36 to R13SS-P27 | 3 meters |
R13LL-P1 to R1SS-P30 | 15 meters |
R13LL-P2 to R13SS-P26 | 3 meters |
R13LL-P3 to R2SS-P30 | 15 meters |
R13LL-P4 to R11SS-P30 | 5 meters |
R13LL-P5 to R3SS-P30 | 15 meters |
R13LL-P6 to R10SS-P30 | 10 meters |
R13LL-P7 to R4SS-P30 | 15 meters |
R13LL-P30 to R13SS-P30 | 3 meters |
R13LL-P31 to R5SS-P30 | 10 meters |
R13LL-P32 to R6SS-P30 | 10 meters |
R13LL-P33 to R7SS-P30 | 10 meters |
R13LL-P34 to R8SS-P30 | 10 meters |
R13LL-P35 to R9SS-P30 | 10 meters |
R13LL-P36 to R12SS-P30 | 5 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-102 Thirteen-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R8LL-P5 | 10 meters |
R1SS-P8 | R5UL-P5 | 10 meters |
R1SS-P9 | R7UL-P5 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R6LL-P5 | 10 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R8UL-P5 | 10 meters |
R1SS-P16 | R6UL-P7 | 10 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R5LL-P7 | 10 meters |
R1SS-P19 | R7LL-P5 | 10 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R10UL-P1 | 15 meters |
R1SS-P22 | R12UL-P1 | 15 meters |
R1SS-P23 | R1UL-P3 | 3 meters |
R1SS-P24 | R9UL-P1 | 10 meters |
R1SS-P25 | R11UL-P1 | 15 meters |
R1SS-P26 | R7LL-P3 | 10 meters |
R1SS-P27 | R13UL-P1 | 15 meters |
R1SS-P28 | R11LL-P1 | 15 meters |
R1SS-P29 | R9LL-P1 | 10 meters |
R1SS-P30 | R13LL-P1 | 15 meters |
R1SS-P31 | R10LL-P1 | 15 meters |
R1SS-P32 | R12LL-P1 | 15 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R7UL-P7 | 10 meters |
R2SS-P8 | R5UL-P4 | 10 meters |
R2SS-P9 | R8LL-P7 | 10 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R6LL-P4 | 10 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R8UL-P7 | 10 meters |
R2SS-P16 | R6UL-P4 | 10 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R5LL-P6 | 10 meters |
R2SS-P19 | R7LL-P7 | 10 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R10UL-P3 | 10 meters |
R2SS-P22 | R12UL-P3 | 15 meters |
R2SS-P23 | R1LL-P1 | 5 meters |
R2SS-P24 | R9UL-P3 | 10 meters |
R2SS-P25 | R11UL-P3 | 15 meters |
R2SS-P26 | R8UL-P3 | 10 meters |
R2SS-P27 | R13UL-P3 | 15 meters |
R2SS-P28 | R11LL-P3 | 15 meters |
R2SS-P29 | R9LL-P3 | 10 meters |
R2SS-P30 | R13LL-P3 | 15 meters |
R2SS-P31 | R10LL-P3 | 10 meters |
R2SS-P32 | R12LL-P3 | 15 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R6LL-P31 | 10 meters |
R3SS-P8 | R5UL-P6 | 5 meters |
R3SS-P9 | R7UL-P4 | 10 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R8LL-P4 | 10 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R7LL-P4 | 10 meters |
R3SS-P16 | R5LL-P31 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R8UL-P4 | 10 meters |
R3SS-P19 | R6UL-P6 | 10 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R10UL-P5 | 10 meters |
R3SS-P22 | R12UL-P5 | 15 meters |
R3SS-P23 | R2UL-P2 | 5 meters |
R3SS-P24 | R9UL-P5 | 10 meters |
R3SS-P25 | R11UL-P5 | 10 meters |
R3SS-P26 | R8LL-P3 | 10 meters |
R3SS-P27 | R13UL-P5 | 15 meters |
R3SS-P28 | R11LL-P5 | 10 meters |
R3SS-P29 | R9LL-P5 | 10 meters |
R3SS-P30 | R13LL-P5 | 15 meters |
R3SS-P31 | R10LL-P5 | 10 meters |
R3SS-P32 | R12LL-P5 | 15 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R8LL-P6 | 10 meters |
R4SS-P8 | R7UL-P6 | 10 meters |
R4SS-P9 | R6LL-P33 | 5 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R5UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R6UL-P31 | 5 meters |
R4SS-P16 | R8UL-P6 | 10 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R7LL-P6 | 10 meters |
R4SS-P19 | R5LL-P33 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R10UL-P7 | 10 meters |
R4SS-P22 | R12UL-P7 | 10 meters |
R4SS-P23 | R2LL-P2 | 5 meters |
R4SS-P24 | R9UL-P7 | 10 meters |
R4SS-P25 | R11UL-P7 | 10 meters |
R4SS-P26 | R9UL-P2 | 10 meters |
R4SS-P27 | R13UL-P7 | 15 meters |
R4SS-P28 | R11LL-P7 | 10 meters |
R4SS-P29 | R9LL-P7 | 10 meters |
R4SS-P30 | R13LL-P7 | 15 meters |
R4SS-P31 | R10LL-P7 | 10 meters |
R4SS-P32 | R12LL-P7 | 10 meters |
R5SS-P5 | R1UL-P30 | 10 meters |
R5SS-P6 | R2UL-P7 | 10 meters |
R5SS-P7 | R5UL-P30 | 3 meters |
R5SS-P8 | R6LL-P30 | 5 meters |
R5SS-P9 | R7UL-P31 | 5 meters |
R5SS-P10 | R4UL-P5 | 5 meters |
R5SS-P11 | R3UL-P32 | 5 meters |
R5SS-P12 | R8LL-P31 | 10 meters |
R5SS-P13 | R1LL-P7 | 10 meters |
R5SS-P14 | R2LL-P33 | 10 meters |
R5SS-P15 | R5LL-P30 | 3 meters |
R5SS-P16 | R7LL-P31 | 5 meters |
R5SS-P17 | R4LL-P7 | 5 meters |
R5SS-P18 | R6UL-P33 | 5 meters |
R5SS-P19 | R8UL-P31 | 10 meters |
R5SS-P20 | R3LL-P5 | 5 meters |
R5SS-P21 | R10UL-P30 | 10 meters |
R5SS-P22 | R12UL-P30 | 10 meters |
R5SS-P23 | R3UL-P34 | 5 meters |
R5SS-P24 | R9UL-P30 | 10 meters |
R5SS-P25 | R11UL-P30 | 10 meters |
R5SS-P26 | R9LL-P36 | 10 meters |
R5SS-P27 | R13UL-P30 | 10 meters |
R5SS-P28 | R11LL-P31 | 10 meters |
R5SS-P29 | R9LL-P31 | 10 meters |
R5SS-P30 | R13LL-P31 | 10 meters |
R5SS-P31 | R10LL-P31 | 10 meters |
R5SS-P32 | R12LL-P31 | 10 meters |
R6SS-P5 | R1UL-P32 | 10 meters |
R6SS-P6 | R2UL-P33 | 10 meters |
R6SS-P7 | R5UL-P7 | 5 meters |
R6SS-P8 | R6LL-P32 | 3 meters |
R6SS-P9 | R7UL-P33 | 5 meters |
R6SS-P10 | R4UL-P30 | 5 meters |
R6SS-P11 | R3UL-P7 | 10 meters |
R6SS-P12 | R8LL-P33 | 5 meters |
R6SS-P13 | R1LL-P32 | 10 meters |
R6SS-P14 | R2LL-P7 | 10 meters |
R6SS-P15 | R5LL-P4 | 5 meters |
R6SS-P16 | R6UL-P30 | 3 meters |
R6SS-P17 | R4LL-P6 | 5 meters |
R6SS-P18 | R7LL-P33 | 5 meters |
R6SS-P19 | R8UL-P33 | 5 meters |
R6SS-P20 | R3LL-P30 | 10 meters |
R6SS-P21 | R10UL-P31 | 10 meters |
R6SS-P22 | R12UL-P31 | 10 meters |
R6SS-P23 | R3LL-P35 | 10 meters |
R6SS-P24 | R9UL-P31 | 10 meters |
R6SS-P25 | R11UL-P31 | 10 meters |
R6SS-P26 | R10UL-P36 | 10 meters |
R6SS-P27 | R13UL-P31 | 10 meters |
R6SS-P28 | R11LL-P32 | 10 meters |
R6SS-P29 | R9LL-P32 | 10 meters |
R6SS-P30 | R13LL-P32 | 10 meters |
R6SS-P31 | R10LL-P32 | 10 meters |
R6SS-P32 | R12LL-P32 | 10 meters |
R7SS-P5 | R1UL-P33 | 10 meters |
R7SS-P6 | R2UL-P32 | 10 meters |
R7SS-P7 | R5UL-P32 | 5 meters |
R7SS-P8 | R6LL-P6 | 5 meters |
R7SS-P9 | R7UL-P30 | 3 meters |
R7SS-P10 | R4UL-P31 | 10 meters |
R7SS-P11 | R3UL-P31 | 10 meters |
R7SS-P12 | R8LL-P30 | 5 meters |
R7SS-P13 | R1LL-P6 | 10 meters |
R7SS-P14 | R2LL-P32 | 10 meters |
R7SS-P15 | R5LL-P5 | 5 meters |
R7SS-P16 | R6UL-P5 | 5 meters |
R7SS-P17 | R4LL-P32 | 10 meters |
R7SS-P18 | R7LL-P30 | 3 meters |
R7SS-P19 | R8UL-P30 | 5 meters |
R7SS-P20 | R3LL-P7 | 10 meters |
R7SS-P21 | R10UL-P32 | 10 meters |
R7SS-P22 | R12UL-P32 | 10 meters |
R7SS-P23 | R4UL-P36 | 10 meters |
R7SS-P24 | R9UL-P32 | 5 meters |
R7SS-P25 | R11UL-P32 | 10 meters |
R7SS-P26 | R10LL-P30 | 10 meters |
R7SS-P27 | R13UL-P32 | 10 meters |
R7SS-P28 | R11LL-P33 | 10 meters |
R7SS-P29 | R9LL-P33 | 5 meters |
R7SS-P30 | R13LL-P33 | 10 meters |
R7SS-P31 | R10LL-P33 | 10 meters |
R7SS-P32 | R12LL-P33 | 10 meters |
R8SS-P5 | R1UL-P7 | 10 meters |
R8SS-P6 | R2UL-P30 | 10 meters |
R8SS-P7 | R5UL-P31 | 10 meters |
R8SS-P8 | R6LL-P7 | 5 meters |
R8SS-P9 | R7UL-P32 | 5 meters |
R8SS-P10 | R4UL-P4 | 10 meters |
R8SS-P11 | R3UL-P33 | 10 meters |
R8SS-P12 | R7LL-P32 | 5 meters |
R8SS-P13 | R1LL-P33 | 10 meters |
R8SS-P14 | R2LL-P30 | 10 meters |
R8SS-P15 | R5LL-P32 | 10 meters |
R8SS-P16 | R6UL-P32 | 5 meters |
R8SS-P17 | R4LL-P33 | 10 meters |
R8SS-P18 | R8LL-P32 | 3 meters |
R8SS-P19 | R8UL-P32 | 3 meters |
R8SS-P20 | R3LL-P6 | 10 meters |
R8SS-P21 | R10UL-P33 | 5 meters |
R8SS-P22 | R12UL-P33 | 10 meters |
R8SS-P23 | R4LL-P36 | 10 meters |
R8SS-P24 | R9UL-P33 | 5 meters |
R8SS-P25 | R11UL-P33 | 10 meters |
R8SS-P26 | R11UL-P36 | 10 meters |
R8SS-P27 | R13UL-P33 | 10 meters |
R8SS-P28 | R11LL-P34 | 10 meters |
R8SS-P29 | R9LL-P34 | 5 meters |
R8SS-P30 | R13LL-P34 | 10 meters |
R8SS-P31 | R10LL-P34 | 5 meters |
R8SS-P32 | R12LL-P34 | 10 meters |
R9SS-P5 | R1UL-P36 | 10 meters |
R9SS-P6 | R2UL-P36 | 10 meters |
R9SS-P7 | R5UL-P35 | 10 meters |
R9SS-P8 | R6LL-P1 | 10 meters |
R9SS-P9 | R7UL-P2 | 5 meters |
R9SS-P10 | R4UL-P34 | 10 meters |
R9SS-P11 | R3UL-P2 | 10 meters |
R9SS-P12 | R7LL-P1 | 5 meters |
R9SS-P13 | R1LL-P36 | 10 meters |
R9SS-P14 | R2LL-P3 | 10 meters |
R9SS-P15 | R5LL-P1 | 10 meters |
R9SS-P16 | R6UL-P3 | 10 meters |
R9SS-P17 | R4LL-P1 | 10 meters |
R9SS-P18 | R8LL-P2 | 5 meters |
R9SS-P19 | R8UL-P1 | 5 meters |
R9SS-P20 | R3LL-P3 | 10 meters |
R9SS-P21 | R10UL-P35 | 5 meters |
R9SS-P22 | R12UL-P35 | 10 meters |
R9SS-P23 | R5UL-P36 | 10 meters |
R9SS-P24 | R9UL-P35 | 3 meters |
R9SS-P25 | R11UL-P35 | 5 meters |
R9SS-P26 | R11LL-P30 | 5 meters |
R9SS-P27 | R13UL-P35 | 10 meters |
R9SS-P28 | R11LL-P35 | 5 meters |
R9SS-P29 | R9LL-P35 | 3 meters |
R9SS-P30 | R13LL-P35 | 10 meters |
R9SS-P31 | R10LL-P35 | 5 meters |
R9SS-P32 | R12LL-P35 | 10 meters |
R10SS-P5 | R1UL-P35 | 15 meters |
R10SS-P6 | R2UL-P34 | 10 meters |
R10SS-P7 | R5UL-P1 | 10 meters |
R10SS-P8 | R6LL-P2 | 10 meters |
R10SS-P9 | R7UL-P36 | 10 meters |
R10SS-P10 | R4UL-P3 | 10 meters |
R10SS-P11 | R3UL-P3 | 10 meters |
R10SS-P12 | R7LL-P2 | 10 meters |
R10SS-P13 | R1LL-P35 | 15 meters |
R10SS-P14 | R2LL-P36 | 10 meters |
R10SS-P15 | R5LL-P35 | 10 meters |
R10SS-P16 | R6UL-P35 | 10 meters |
R10SS-P17 | R4LL-P2 | 10 meters |
R10SS-P18 | R8LL-P36 | 5 meters |
R10SS-P19 | R8UL-P2 | 5 meters |
R10SS-P20 | R3LL-P2 | 10 meters |
R10SS-P21 | R10UL-P4 | 3 meters |
R10SS-P22 | R12UL-P4 | 5 meters |
R10SS-P23 | R5LL-P36 | 10 meters |
R10SS-P24 | R9UL-P4 | 5 meters |
R10SS-P25 | R11UL-P4 | 5 meters |
R10SS-P26 | R12UL-P6 | 5 meters |
R10SS-P27 | R13UL-P4 | 10 meters |
R10SS-P28 | R11LL-P6 | 5 meters |
R10SS-P29 | R9LL-P6 | 5 meters |
R10SS-P30 | R13LL-P6 | 10 meters |
R10SS-P31 | R10LL-P6 | 3 meters |
R10SS-P32 | R12LL-P6 | 5 meters |
R11SS-P5 | R1UL-P2 | 15 meters |
R11SS-P6 | R2UL-P35 | 15 meters |
R11SS-P7 | R5UL-P3 | 10 meters |
R11SS-P8 | R6LL-P35 | 10 meters |
R11SS-P9 | R7UL-P35 | 10 meters |
R11SS-P10 | R4UL-P2 | 10 meters |
R11SS-P11 | R3UL-P36 | 10 meters |
R11SS-P12 | R7LL-P35 | 10 meters |
R11SS-P13 | R1LL-P3 | 15 meters |
R11SS-P14 | R2LL-P34 | 15 meters |
R11SS-P15 | R5LL-P3 | 10 meters |
R11SS-P16 | R6UL-P2 | 10 meters |
R11SS-P17 | R4LL-P3 | 10 meters |
R11SS-P18 | R8LL-P35 | 10 meters |
R11SS-P19 | R8UL-P35 | 10 meters |
R11SS-P20 | R3LL-P34 | 10 meters |
R11SS-P21 | R10UL-P2 | 5 meters |
R11SS-P22 | R12UL-P2 | 5 meters |
R11SS-P23 | R6UL-P1 | 10 meters |
R11SS-P24 | R9UL-P6 | 5 meters |
R11SS-P25 | R11UL-P2 | 3 meters |
R11SS-P26 | R12LL-P2 | 5 meters |
R11SS-P27 | R13UL-P2 | 5 meters |
R11SS-P28 | R11LL-P4 | 3 meters |
R11SS-P29 | R9LL-P2 | 5 meters |
R11SS-P30 | R13LL-P4 | 5 meters |
R11SS-P31 | R10LL-P4 | 5 meters |
R11SS-P32 | R12LL-P4 | 5 meters |
R12SS-P5 | R1UL-P1 | 15 meters |
R12SS-P6 | R2UL-P1 | 15 meters |
R12SS-P7 | R5UL-P2 | 10 meters |
R12SS-P8 | R6LL-P36 | 10 meters |
R12SS-P9 | R7UL-P34 | 10 meters |
R12SS-P10 | R4UL-P35 | 10 meters |
R12SS-P11 | R3UL-P35 | 15 meters |
R12SS-P12 | R7LL-P34 | 10 meters |
R12SS-P13 | R1LL-P34 | 15 meters |
R12SS-P14 | R2LL-P1 | 15 meters |
R12SS-P15 | R5LL-P2 | 10 meters |
R12SS-P16 | R6UL-P34 | 10 meters |
R12SS-P17 | R4LL-P34 | 10 meters |
R12SS-P18 | R8LL-P34 | 10 meters |
R12SS-P19 | R8UL-P34 | 10 meters |
R12SS-P20 | R3LL-P36 | 15 meters |
R12SS-P21 | R10UL-P34 | 5 meters |
R12SS-P22 | R12UL-P34 | 3 meters |
R12SS-P23 | R6LL-P34 | 10 meters |
R12SS-P24 | R9UL-P36 | 10 meters |
R12SS-P25 | R11UL-P34 | 5 meters |
R12SS-P26 | R13UL-P6 | 5 meters |
R12SS-P27 | R13UL-P34 | 5 meters |
R12SS-P28 | R11LL-P36 | 5 meters |
R12SS-P29 | R9LL-P30 | 10 meters |
R12SS-P30 | R13LL-P36 | 5 meters |
R12SS-P31 | R10LL-P2 | 5 meters |
R12SS-P32 | R12LL-P36 | 3 meters |
R13SS-P5 | R1UL-P34 | 15 meters |
R13SS-P6 | R2UL-P3 | 15 meters |
R13SS-P7 | R5UL-P34 | 10 meters |
R13SS-P8 | R6LL-P3 | 10 meters |
R13SS-P9 | R7UL-P3 | 10 meters |
R13SS-P10 | R4UL-P1 | 15 meters |
R13SS-P11 | R3UL-P1 | 15 meters |
R13SS-P12 | R7LL-P36 | 10 meters |
R13SS-P13 | R1LL-P2 | 15 meters |
R13SS-P14 | R2LL-P35 | 15 meters |
R13SS-P15 | R5LL-P34 | 10 meters |
R13SS-P16 | R6UL-P36 | 10 meters |
R13SS-P17 | R4LL-P35 | 15 meters |
R13SS-P18 | R8LL-P1 | 10 meters |
R13SS-P19 | R8UL-P36 | 10 meters |
R13SS-P20 | R3LL-P1 | 15 meters |
R13SS-P21 | R10UL-P6 | 10 meters |
R13SS-P22 | R12UL-P36 | 5 meters |
R13SS-P23 | R7UL-P1 | 10 meters |
R13SS-P24 | R9UL-P34 | 10 meters |
R13SS-P25 | R11UL-P6 | 5 meters |
R13SS-P26 | R13LL-P2 | 3 meters |
R13SS-P27 | R13UL-P36 | 3 meters |
R13SS-P28 | R11LL-P2 | 5 meters |
R13SS-P29 | R9LL-P4 | 10 meters |
R13SS-P30 | R13LL-P30 | 3 meters |
R13SS-P31 | R10LL-P36 | 10 meters |
R13SS-P32 | R12LL-P30 | 5 meters |
Fourteen-Rack Cabling for RA21 and Later Model Racks
This section provides the cabling details for RA21 and later models to connect fourteen racks using RoCE Network Fabric.
Note:
-
The following conventions are used in the cabling notation for connecting multiple racks together:
-
The abbreviation for the first rack is R1, the second rack is R2, and so on.
-
LL identifies a lower leaf switch and UL identifies an upper leaf switch.
-
SS identifies the spine switch, which is located in U1 on all racks.
-
A specific switch is identified by combining abbreviations. For example, R1LL identifies the lower leaf switch (LL) on the first rack (R1).
-
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in 2-socket systems (ZDLRA Rack X9M and later models).
-
At rack unit 21 (U21) and rack unit 23 (U23) in 8-socket systems (Recovery Appliance X9M-8).
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X9M-8 systems with three database servers and 11 storage servers only, the database servers and storage server require 23 leaf switch ports, which leaves only 13 inter-switch links on each leaf switch. Consequently, these systems cannot support 14 interconnected racks.
The following tables contain details for all of the RoCE Network Fabric cabling connections in a 14 rack system.
Table 22-103 Leaf Switch Connections for the First Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R1UL-P1 to R12SS-P5 | 15 meters |
R1UL-P2 to R11SS-P5 | 15 meters |
R1UL-P3 to R14SS-P5 | 15 meters |
R1UL-P4 to R4SS-P5 | 10 meters |
R1UL-P5 to R1SS-P5 | 3 meters |
R1UL-P6 to R3SS-P5 | 5 meters |
R1UL-P7 to R8SS-P5 | 10 meters |
R1UL-P30 to R5SS-P5 | 10 meters |
R1UL-P31 to R2SS-P5 | 5 meters |
R1UL-P32 to R6SS-P5 | 10 meters |
R1UL-P33 to R7SS-P5 | 10 meters |
R1UL-P34 to R13SS-P5 | 15 meters |
R1UL-P35 to R10SS-P5 | 15 meters |
R1UL-P36 to R9SS-P5 | 10 meters |
R1LL-P1 to R14SS-P13 | 15 meters |
R1LL-P2 to R13SS-P13 | 15 meters |
R1LL-P3 to R11SS-P13 | 15 meters |
R1LL-P4 to R3SS-P13 | 5 meters |
R1LL-P5 to R1SS-P13 | 3 meters |
R1LL-P6 to R7SS-P13 | 10 meters |
R1LL-P7 to R5SS-P13 | 10 meters |
R1LL-P30 to R4SS-P13 | 10 meters |
R1LL-P31 to R2SS-P13 | 5 meters |
R1LL-P32 to R6SS-P13 | 10 meters |
R1LL-P33 to R8SS-P13 | 10 meters |
R1LL-P34 to R12SS-P13 | 15 meters |
R1LL-P35 to R10SS-P13 | 15 meters |
R1LL-P36 to R9SS-P13 | 10 meters |
Table 22-104 Leaf Switch Connections for the Second Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R2UL-P1 to R12SS-P6 | 15 meters |
R2UL-P2 to R14SS-P6 | 15 meters |
R2UL-P3 to R13SS-P6 | 15 meters |
R2UL-P4 to R4SS-P6 | 5 meters |
R2UL-P5 to R1SS-P6 | 5 meters |
R2UL-P6 to R3SS-P6 | 5 meters |
R2UL-P7 to R5SS-P6 | 10 meters |
R2UL-P30 to R8SS-P6 | 10 meters |
R2UL-P31 to R2SS-P6 | 3 meters |
R2UL-P32 to R7SS-P6 | 10 meters |
R2UL-P33 to R6SS-P6 | 10 meters |
R2UL-P34 to R10SS-P6 | 10 meters |
R2UL-P35 to R11SS-P6 | 15 meters |
R2UL-P36 to R9SS-P6 | 10 meters |
R2LL-P1 to R12SS-P14 | 15 meters |
R2LL-P2 to R14SS-P14 | 15 meters |
R2LL-P3 to R9SS-P14 | 10 meters |
R2LL-P4 to R4SS-P14 | 5 meters |
R2LL-P5 to R1SS-P14 | 5 meters |
R2LL-P6 to R3SS-P14 | 5 meters |
R2LL-P7 to R6SS-P14 | 10 meters |
R2LL-P30 to R8SS-P14 | 10 meters |
R2LL-P31 to R2SS-P14 | 3 meters |
R2LL-P32 to R7SS-P14 | 10 meters |
R2LL-P33 to R5SS-P14 | 10 meters |
R2LL-P34 to R11SS-P14 | 15 meters |
R2LL-P35 to R13SS-P14 | 15 meters |
R2LL-P36 to R10SS-P14 | 10 meters |
Table 22-105 Leaf Switch Connections for the Third Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R3UL-P1 to R13SS-P11 | 15 meters |
R3UL-P2 to R9SS-P11 | 10 meters |
R3UL-P3 to R10SS-P11 | 10 meters |
R3UL-P4 to R4SS-P11 | 5 meters |
R3UL-P5 to R1SS-P11 | 5 meters |
R3UL-P6 to R2SS-P11 | 5 meters |
R3UL-P7 to R6SS-P11 | 10 meters |
R3UL-P30 to R3SS-P11 | 3 meters |
R3UL-P31 to R7SS-P11 | 10 meters |
R3UL-P32 to R5SS-P11 | 5 meters |
R3UL-P33 to R8SS-P11 | 10 meters |
R3UL-P34 to R14SS-P11 | 15 meters |
R3UL-P35 to R12SS-P11 | 15 meters |
R3UL-P36 to R11SS-P11 | 10 meters |
R3LL-P1 to R13SS-P20 | 15 meters |
R3LL-P2 to R10SS-P20 | 10 meters |
R3LL-P3 to R9SS-P20 | 10 meters |
R3LL-P4 to R1SS-P20 | 5 meters |
R3LL-P5 to R5SS-P20 | 5 meters |
R3LL-P6 to R8SS-P20 | 10 meters |
R3LL-P7 to R7SS-P20 | 10 meters |
R3LL-P30 to R6SS-P20 | 10 meters |
R3LL-P31 to R2SS-P20 | 5 meters |
R3LL-P32 to R3SS-P20 | 3 meters |
R3LL-P33 to R4SS-P20 | 5 meters |
R3LL-P34 to R11SS-P20 | 10 meters |
R3LL-P35 to R14SS-P20 | 15 meters |
R3LL-P36 to R12SS-P20 | 15 meters |
Table 22-106 Leaf Switch Connections for the Fourth Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R4UL-P1 to R13SS-P10 | 15 meters |
R4UL-P2 to R11SS-P10 | 10 meters |
R4UL-P3 to R10SS-P10 | 10 meters |
R4UL-P4 to R8SS-P10 | 10 meters |
R4UL-P5 to R5SS-P10 | 5 meters |
R4UL-P6 to R2SS-P10 | 5 meters |
R4UL-P7 to R1SS-P10 | 10 meters |
R4UL-P30 to R6SS-P10 | 5 meters |
R4UL-P31 to R7SS-P10 | 10 meters |
R4UL-P32 to R4SS-P10 | 3 meters |
R4UL-P33 to R3SS-P10 | 5 meters |
R4UL-P34 to R9SS-P10 | 10 meters |
R4UL-P35 to R12SS-P10 | 10 meters |
R4UL-P36 to R14SS-P10 | 15 meters |
R4LL-P1 to R9SS-P17 | 10 meters |
R4LL-P2 to R10SS-P17 | 10 meters |
R4LL-P3 to R11SS-P17 | 10 meters |
R4LL-P4 to R2SS-P17 | 5 meters |
R4LL-P5 to R1SS-P17 | 10 meters |
R4LL-P6 to R6SS-P17 | 5 meters |
R4LL-P7 to R5SS-P17 | 5 meters |
R4LL-P30 to R4SS-P17 | 3 meters |
R4LL-P31 to R3SS-P17 | 5 meters |
R4LL-P32 to R7SS-P17 | 10 meters |
R4LL-P33 to R8SS-P17 | 10 meters |
R4LL-P34 to R12SS-P17 | 10 meters |
R4LL-P35 to R13SS-P17 | 15 meters |
R4LL-P36 to R14SS-P17 | 15 meters |
Table 22-107 Leaf Switch Connections for the Fifth Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R5UL-P1 to R10SS-P7 | 10 meters |
R5UL-P2 to R12SS-P7 | 10 meters |
R5UL-P3 to R11SS-P7 | 10 meters |
R5UL-P4 to R2SS-P8 | 10 meters |
R5UL-P5 to R1SS-P8 | 10 meters |
R5UL-P6 to R3SS-P8 | 5 meters |
R5UL-P7 to R6SS-P7 | 5 meters |
R5UL-P30 to R5SS-P7 | 3 meters |
R5UL-P31 to R8SS-P7 | 10 meters |
R5UL-P32 to R7SS-P7 | 5 meters |
R5UL-P33 to R4SS-P12 | 5 meters |
R5UL-P34 to R13SS-P7 | 10 meters |
R5UL-P35 to R9SS-P7 | 10 meters |
R5UL-P36 to R14SS-P7 | 15 meters |
R5LL-P1 to R9SS-P15 | 10 meters |
R5LL-P2 to R12SS-P15 | 10 meters |
R5LL-P3 to R11SS-P15 | 10 meters |
R5LL-P4 to R6SS-P15 | 5 meters |
R5LL-P5 to R7SS-P15 | 5 meters |
R5LL-P6 to R2SS-P18 | 10 meters |
R5LL-P7 to R1SS-P18 | 10 meters |
R5LL-P30 to R5SS-P15 | 3 meters |
R5LL-P31 to R3SS-P16 | 5 meters |
R5LL-P32 to R8SS-P15 | 10 meters |
R5LL-P33 to R4SS-P19 | 5 meters |
R5LL-P34 to R13SS-P15 | 10 meters |
R5LL-P35 to R10SS-P15 | 10 meters |
R5LL-P36 to R14SS-P15 | 15 meters |
Table 22-108 Leaf Switch Connections for the Sixth Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R6UL-P1 to R14SS-P16 | 10 meters |
R6UL-P2 to R11SS-P16 | 10 meters |
R6UL-P3 to R9SS-P16 | 10 meters |
R6UL-P4 to R2SS-P16 | 10 meters |
R6UL-P5 to R7SS-P16 | 5 meters |
R6UL-P6 to R3SS-P19 | 10 meters |
R6UL-P7 to R1SS-P16 | 10 meters |
R6UL-P30 to R6SS-P16 | 3 meters |
R6UL-P31 to R4SS-P15 | 5 meters |
R6UL-P32 to R8SS-P16 | 5 meters |
R6UL-P33 to R5SS-P18 | 5 meters |
R6UL-P34 to R12SS-P16 | 10 meters |
R6UL-P35 to R10SS-P16 | 10 meters |
R6UL-P36 to R13SS-P16 | 10 meters |
R6LL-P1 to R9SS-P8 | 10 meters |
R6LL-P2 to R10SS-P8 | 10 meters |
R6LL-P3 to R13SS-P8 | 10 meters |
R6LL-P4 to R2SS-P12 | 10 meters |
R6LL-P5 to R1SS-P12 | 10 meters |
R6LL-P6 to R7SS-P8 | 5 meters |
R6LL-P7 to R8SS-P8 | 5 meters |
R6LL-P30 to R5SS-P8 | 5 meters |
R6LL-P31 to R3SS-P7 | 10 meters |
R6LL-P32 to R6SS-P8 | 3 meters |
R6LL-P33 to R4SS-P9 | 5 meters |
R6LL-P34 to R14SS-P8 | 10 meters |
R6LL-P35 to R11SS-P8 | 10 meters |
R6LL-P36 to R12SS-P8 | 10 meters |
Table 22-109 Leaf Switch Connections for the Seventh Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R7UL-P1 to R14SS-P9 | 10 meters |
R7UL-P2 to R9SS-P9 | 5 meters |
R7UL-P3 to R13SS-P9 | 10 meters |
R7UL-P4 to R3SS-P9 | 10 meters |
R7UL-P5 to R1SS-P9 | 10 meters |
R7UL-P6 to R4SS-P8 | 10 meters |
R7UL-P7 to R2SS-P7 | 10 meters |
R7UL-P30 to R7SS-P9 | 3 meters |
R7UL-P31 to R5SS-P9 | 5 meters |
R7UL-P32 to R8SS-P9 | 5 meters |
R7UL-P33 to R6SS-P9 | 5 meters |
R7UL-P34 to R12SS-P9 | 10 meters |
R7UL-P35 to R11SS-P9 | 10 meters |
R7UL-P36 to R10SS-P9 | 10 meters |
R7LL-P1 to R9SS-P12 | 5 meters |
R7LL-P2 to R10SS-P12 | 10 meters |
R7LL-P3 to R14SS-P12 | 10 meters |
R7LL-P4 to R3SS-P15 | 10 meters |
R7LL-P5 to R1SS-P19 | 10 meters |
R7LL-P6 to R4SS-P18 | 10 meters |
R7LL-P7 to R2SS-P19 | 10 meters |
R7LL-P30 to R7SS-P18 | 3 meters |
R7LL-P31 to R5SS-P16 | 5 meters |
R7LL-P32 to R8SS-P12 | 5 meters |
R7LL-P33 to R6SS-P18 | 5 meters |
R7LL-P34 to R12SS-P12 | 10 meters |
R7LL-P35 to R11SS-P12 | 10 meters |
R7LL-P36 to R13SS-P12 | 10 meters |
Table 22-110 Leaf Switch Connections for the Eighth Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R8UL-P1 to R9SS-P19 | 5 meters |
R8UL-P2 to R10SS-P19 | 5 meters |
R8UL-P3 to R14SS-P19 | 10 meters |
R8UL-P4 to R3SS-P18 | 10 meters |
R8UL-P5 to R1SS-P15 | 10 meters |
R8UL-P6 to R4SS-P16 | 10 meters |
R8UL-P7 to R2SS-P15 | 10 meters |
R8UL-P30 to R7SS-P19 | 5 meters |
R8UL-P31 to R5SS-P19 | 10 meters |
R8UL-P32 to R8SS-P19 | 3 meters |
R8UL-P33 to R6SS-P19 | 5 meters |
R8UL-P34 to R12SS-P19 | 10 meters |
R8UL-P35 to R11SS-P19 | 10 meters |
R8UL-P36 to R13SS-P19 | 10 meters |
R8LL-P1 to R13SS-P18 | 10 meters |
R8LL-P2 to R9SS-P18 | 5 meters |
R8LL-P3 to R14SS-P18 | 10 meters |
R8LL-P4 to R3SS-P12 | 10 meters |
R8LL-P5 to R1SS-P7 | 10 meters |
R8LL-P6 to R4SS-P7 | 10 meters |
R8LL-P7 to R2SS-P9 | 10 meters |
R8LL-P30 to R7SS-P12 | 5 meters |
R8LL-P31 to R5SS-P12 | 10 meters |
R8LL-P32 to R8SS-P18 | 3 meters |
R8LL-P33 to R6SS-P12 | 5 meters |
R8LL-P34 to R12SS-P18 | 10 meters |
R8LL-P35 to R11SS-P18 | 10 meters |
R8LL-P36 to R10SS-P18 | 5 meters |
Table 22-111 Leaf Switch Connections for the Ninth Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R9UL-P1 to R1SS-P21 | 10 meters |
R9UL-P2 to R14SS-P21 | 10 meters |
R9UL-P3 to R2SS-P21 | 10 meters |
R9UL-P4 to R10SS-P21 | 5 meters |
R9UL-P5 to R3SS-P21 | 10 meters |
R9UL-P6 to R11SS-P21 | 5 meters |
R9UL-P7 to R4SS-P21 | 10 meters |
R9UL-P30 to R5SS-P21 | 10 meters |
R9UL-P31 to R6SS-P21 | 10 meters |
R9UL-P32 to R7SS-P21 | 5 meters |
R9UL-P33 to R8SS-P21 | 5 meters |
R9UL-P34 to R13SS-P21 | 10 meters |
R9UL-P35 to R9SS-P21 | 3 meters |
R9UL-P36 to R12SS-P21 | 10 meters |
R9LL-P1 to R1SS-P22 | 10 meters |
R9LL-P2 to R11SS-P22 | 5 meters |
R9LL-P3 to R2SS-P22 | 10 meters |
R9LL-P4 to R13SS-P22 | 10 meters |
R9LL-P5 to R3SS-P22 | 10 meters |
R9LL-P6 to R10SS-P22 | 5 meters |
R9LL-P7 to R4SS-P22 | 10 meters |
R9LL-P30 to R12SS-P22 | 10 meters |
R9LL-P31 to R5SS-P22 | 10 meters |
R9LL-P32 to R6SS-P22 | 10 meters |
R9LL-P33 to R7SS-P22 | 5 meters |
R9LL-P34 to R8SS-P22 | 5 meters |
R9LL-P35 to R9SS-P22 | 3 meters |
R9LL-P36 to R14SS-P22 | 10 meters |
Table 22-112 Leaf Switch Connections for the Tenth Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R10UL-P1 to R1SS-P23 | 15 meters |
R10UL-P2 to R11SS-P23 | 5 meters |
R10UL-P3 to R2SS-P23 | 10 meters |
R10UL-P4 to R10SS-P23 | 3 meters |
R10UL-P5 to R3SS-P23 | 10 meters |
R10UL-P6 to R13SS-P23 | 10 meters |
R10UL-P7 to R4SS-P23 | 10 meters |
R10UL-P30 to R5SS-P23 | 10 meters |
R10UL-P31 to R6SS-P23 | 10 meters |
R10UL-P32 to R7SS-P23 | 10 meters |
R10UL-P33 to R8SS-P23 | 5 meters |
R10UL-P34 to R12SS-P23 | 5 meters |
R10UL-P35 to R9SS-P23 | 5 meters |
R10UL-P36 to R14SS-P23 | 10 meters |
R10LL-P1 to R1SS-P24 | 15 meters |
R10LL-P2 to R12SS-P24 | 5 meters |
R10LL-P3 to R2SS-P24 | 10 meters |
R10LL-P4 to R11SS-P24 | 5 meters |
R10LL-P5 to R3SS-P24 | 10 meters |
R10LL-P6 to R10SS-P24 | 3 meters |
R10LL-P7 to R4SS-P24 | 10 meters |
R10LL-P30 to R14SS-P24 | 10 meters |
R10LL-P31 to R5SS-P24 | 10 meters |
R10LL-P32 to R6SS-P24 | 10 meters |
R10LL-P33 to R7SS-P24 | 10 meters |
R10LL-P34 to R8SS-P24 | 5 meters |
R10LL-P35 to R9SS-P24 | 5 meters |
R10LL-P36 to R13SS-P24 | 10 meters |
Table 22-113 Leaf Switch Connections for the Eleventh Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R11UL-P1 to R1SS-P25 | 15 meters |
R11UL-P2 to R11SS-P25 | 3 meters |
R11UL-P3 to R2SS-P25 | 15 meters |
R11UL-P4 to R10SS-P25 | 5 meters |
R11UL-P5 to R3SS-P25 | 10 meters |
R11UL-P6 to R13SS-P25 | 5 meters |
R11UL-P7 to R4SS-P25 | 10 meters |
R11UL-P30 to R5SS-P25 | 10 meters |
R11UL-P31 to R6SS-P25 | 10 meters |
R11UL-P32 to R7SS-P25 | 10 meters |
R11UL-P33 to R8SS-P25 | 10 meters |
R11UL-P34 to R12SS-P25 | 5 meters |
R11UL-P35 to R9SS-P25 | 5 meters |
R11UL-P36 to R14SS-P25 | 10 meters |
R11LL-P1 to R1SS-P26 | 15 meters |
R11LL-P2 to R13SS-P26 | 5 meters |
R11LL-P3 to R2SS-P26 | 15 meters |
R11LL-P4 to R11SS-P26 | 3 meters |
R11LL-P5 to R3SS-P26 | 10 meters |
R11LL-P6 to R10SS-P26 | 5 meters |
R11LL-P7 to R4SS-P26 | 10 meters |
R11LL-P30 to R14SS-P26 | 10 meters |
R11LL-P31 to R5SS-P26 | 10 meters |
R11LL-P32 to R6SS-P26 | 10 meters |
R11LL-P33 to R7SS-P26 | 10 meters |
R11LL-P34 to R8SS-P26 | 10 meters |
R11LL-P35 to R9SS-P26 | 5 meters |
R11LL-P36 to R12SS-P26 | 5 meters |
Table 22-114 Leaf Switch Connections for the Twelfth Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R12UL-P1 to R1SS-P27 | 15 meters |
R12UL-P2 to R11SS-P27 | 5 meters |
R12UL-P3 to R2SS-P27 | 15 meters |
R12UL-P4 to R10SS-P27 | 5 meters |
R12UL-P5 to R3SS-P27 | 15 meters |
R12UL-P6 to R14SS-P27 | 5 meters |
R12UL-P7 to R4SS-P27 | 10 meters |
R12UL-P30 to R5SS-P27 | 10 meters |
R12UL-P31 to R6SS-P27 | 10 meters |
R12UL-P32 to R7SS-P27 | 10 meters |
R12UL-P33 to R8SS-P27 | 10 meters |
R12UL-P34 to R12SS-P27 | 3 meters |
R12UL-P35 to R9SS-P27 | 10 meters |
R12UL-P36 to R13SS-P27 | 5 meters |
R12LL-P1 to R1SS-P28 | 15 meters |
R12LL-P2 to R14SS-P28 | 5 meters |
R12LL-P3 to R2SS-P28 | 15 meters |
R12LL-P4 to R11SS-P28 | 5 meters |
R12LL-P5 to R3SS-P28 | 15 meters |
R12LL-P6 to R10SS-P28 | 5 meters |
R12LL-P7 to R4SS-P28 | 10 meters |
R12LL-P30 to R13SS-P28 | 5 meters |
R12LL-P31 to R5SS-P28 | 10 meters |
R12LL-P32 to R6SS-P28 | 10 meters |
R12LL-P33 to R7SS-P28 | 10 meters |
R12LL-P34 to R8SS-P28 | 10 meters |
R12LL-P35 to R9SS-P28 | 10 meters |
R12LL-P36 to R12SS-P28 | 3 meters |
Table 22-115 Leaf Switch Connections for the Thirteenth Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R13UL-P1 to R1SS-P29 | 15 meters |
R13UL-P2 to R11SS-P29 | 5 meters |
R13UL-P3 to R2SS-P29 | 15 meters |
R13UL-P4 to R10SS-P29 | 10 meters |
R13UL-P5 to R3SS-P29 | 15 meters |
R13UL-P6 to R14SS-P29 | 5 meters |
R13UL-P7 to R4SS-P29 | 15 meters |
R13UL-P30 to R5SS-P29 | 10 meters |
R13UL-P31 to R6SS-P29 | 10 meters |
R13UL-P32 to R7SS-P29 | 10 meters |
R13UL-P33 to R8SS-P29 | 10 meters |
R13UL-P34 to R12SS-P29 | 5 meters |
R13UL-P35 to R9SS-P29 | 10 meters |
R13UL-P36 to R13SS-P29 | 3 meters |
R13LL-P1 to R1SS-P30 | 15 meters |
R13LL-P2 to R14SS-P30 | 5 meters |
R13LL-P3 to R2SS-P30 | 15 meters |
R13LL-P4 to R11SS-P30 | 5 meters |
R13LL-P5 to R3SS-P30 | 15 meters |
R13LL-P6 to R10SS-P30 | 10 meters |
R13LL-P7 to R4SS-P30 | 15 meters |
R13LL-P30 to R13SS-P30 | 3 meters |
R13LL-P31 to R5SS-P30 | 10 meters |
R13LL-P32 to R6SS-P30 | 10 meters |
R13LL-P33 to R7SS-P30 | 10 meters |
R13LL-P34 to R8SS-P30 | 10 meters |
R13LL-P35 to R9SS-P30 | 10 meters |
R13LL-P36 to R12SS-P30 | 5 meters |
Table 22-116 Leaf Switch Connections for the Fourteenth Rack in a 14 Rack System
Connection | Cable Length |
---|---|
R14UL-P1 to R1SS-P31 | 15 meters |
R14UL-P2 to R11SS-P31 | 10 meters |
R14UL-P3 to R2SS-P31 | 15 meters |
R14UL-P4 to R10SS-P31 | 10 meters |
R14UL-P5 to R3SS-P31 | 15 meters |
R14UL-P6 to R14SS-P31 | 3 meters |
R14UL-P7 to R4SS-P31 | 15 meters |
R14UL-P30 to R5SS-P31 | 15 meters |
R14UL-P31 to R6SS-P31 | 10 meters |
R14UL-P32 to R7SS-P31 | 10 meters |
R14UL-P33 to R8SS-P31 | 10 meters |
R14UL-P34 to R12SS-P31 | 5 meters |
R14UL-P35 to R9SS-P31 | 10 meters |
R14UL-P36 to R13SS-P31 | 5 meters |
R14LL-P1 to R1SS-P32 | 15 meters |
R14LL-P2 to R14SS-P32 | 3 meters |
R14LL-P3 to R2SS-P32 | 15 meters |
R14LL-P4 to R11SS-P32 | 10 meters |
R14LL-P5 to R3SS-P32 | 15 meters |
R14LL-P6 to R10SS-P32 | 10 meters |
R14LL-P7 to R4SS-P32 | 15 meters |
R14LL-P30 to R13SS-P32 | 5 meters |
R14LL-P31 to R5SS-P32 | 15 meters |
R14LL-P32 to R6SS-P32 | 10 meters |
R14LL-P33 to R7SS-P32 | 10 meters |
R14LL-P34 to R8SS-P32 | 10 meters |
R14LL-P35 to R9SS-P32 | 10 meters |
R14LL-P36 to R12SS-P32 | 5 meters |
The following table contains all of the RoCE Network Fabric cabling connections from the previous tables. In this table, the connections are sorted by the spine switch port location.
Table 22-117 Fourteen-Rack System Connections Sorted By The Spine Switch Port Location
Spine Switch Port | Leaf Switch Port | Cable Length |
---|---|---|
R1SS-P5 | R1UL-P5 | 3 meters |
R1SS-P6 | R2UL-P5 | 5 meters |
R1SS-P7 | R8LL-P5 | 10 meters |
R1SS-P8 | R5UL-P5 | 10 meters |
R1SS-P9 | R7UL-P5 | 10 meters |
R1SS-P10 | R4UL-P7 | 10 meters |
R1SS-P11 | R3UL-P5 | 5 meters |
R1SS-P12 | R6LL-P5 | 10 meters |
R1SS-P13 | R1LL-P5 | 3 meters |
R1SS-P14 | R2LL-P5 | 5 meters |
R1SS-P15 | R8UL-P5 | 10 meters |
R1SS-P16 | R6UL-P7 | 10 meters |
R1SS-P17 | R4LL-P5 | 10 meters |
R1SS-P18 | R5LL-P7 | 10 meters |
R1SS-P19 | R7LL-P5 | 10 meters |
R1SS-P20 | R3LL-P4 | 5 meters |
R1SS-P21 | R9UL-P1 | 10 meters |
R1SS-P22 | R9LL-P1 | 10 meters |
R1SS-P23 | R10UL-P1 | 15 meters |
R1SS-P24 | R10LL-P1 | 15 meters |
R1SS-P25 | R11UL-P1 | 15 meters |
R1SS-P26 | R11LL-P1 | 15 meters |
R1SS-P27 | R12UL-P1 | 15 meters |
R1SS-P28 | R12LL-P1 | 15 meters |
R1SS-P29 | R13UL-P1 | 15 meters |
R1SS-P30 | R13LL-P1 | 15 meters |
R1SS-P31 | R14UL-P1 | 15 meters |
R1SS-P32 | R14LL-P1 | 15 meters |
R2SS-P5 | R1UL-P31 | 5 meters |
R2SS-P6 | R2UL-P31 | 3 meters |
R2SS-P7 | R7UL-P7 | 10 meters |
R2SS-P8 | R5UL-P4 | 10 meters |
R2SS-P9 | R8LL-P7 | 10 meters |
R2SS-P10 | R4UL-P6 | 5 meters |
R2SS-P11 | R3UL-P6 | 5 meters |
R2SS-P12 | R6LL-P4 | 10 meters |
R2SS-P13 | R1LL-P31 | 5 meters |
R2SS-P14 | R2LL-P31 | 3 meters |
R2SS-P15 | R8UL-P7 | 10 meters |
R2SS-P16 | R6UL-P4 | 10 meters |
R2SS-P17 | R4LL-P4 | 5 meters |
R2SS-P18 | R5LL-P6 | 10 meters |
R2SS-P19 | R7LL-P7 | 10 meters |
R2SS-P20 | R3LL-P31 | 5 meters |
R2SS-P21 | R9UL-P3 | 10 meters |
R2SS-P22 | R9LL-P3 | 10 meters |
R2SS-P23 | R10UL-P3 | 10 meters |
R2SS-P24 | R10LL-P3 | 10 meters |
R2SS-P25 | R11UL-P3 | 15 meters |
R2SS-P26 | R11LL-P3 | 15 meters |
R2SS-P27 | R12UL-P3 | 15 meters |
R2SS-P28 | R12LL-P3 | 15 meters |
R2SS-P29 | R13UL-P3 | 15 meters |
R2SS-P30 | R13LL-P3 | 15 meters |
R2SS-P31 | R14UL-P3 | 15 meters |
R2SS-P32 | R14LL-P3 | 15 meters |
R3SS-P5 | R1UL-P6 | 5 meters |
R3SS-P6 | R2UL-P6 | 5 meters |
R3SS-P7 | R6LL-P31 | 10 meters |
R3SS-P8 | R5UL-P6 | 5 meters |
R3SS-P9 | R7UL-P4 | 10 meters |
R3SS-P10 | R4UL-P33 | 5 meters |
R3SS-P11 | R3UL-P30 | 3 meters |
R3SS-P12 | R8LL-P4 | 10 meters |
R3SS-P13 | R1LL-P4 | 5 meters |
R3SS-P14 | R2LL-P6 | 5 meters |
R3SS-P15 | R7LL-P4 | 10 meters |
R3SS-P16 | R5LL-P31 | 5 meters |
R3SS-P17 | R4LL-P31 | 5 meters |
R3SS-P18 | R8UL-P4 | 10 meters |
R3SS-P19 | R6UL-P6 | 10 meters |
R3SS-P20 | R3LL-P32 | 3 meters |
R3SS-P21 | R9UL-P5 | 10 meters |
R3SS-P22 | R9LL-P5 | 10 meters |
R3SS-P23 | R10UL-P5 | 10 meters |
R3SS-P24 | R10LL-P5 | 10 meters |
R3SS-P25 | R11UL-P5 | 10 meters |
R3SS-P26 | R11LL-P5 | 10 meters |
R3SS-P27 | R12UL-P5 | 15 meters |
R3SS-P28 | R12LL-P5 | 15 meters |
R3SS-P29 | R13UL-P5 | 15 meters |
R3SS-P30 | R13LL-P5 | 15 meters |
R3SS-P31 | R14UL-P5 | 15 meters |
R3SS-P32 | R14LL-P5 | 15 meters |
R4SS-P5 | R1UL-P4 | 10 meters |
R4SS-P6 | R2UL-P4 | 5 meters |
R4SS-P7 | R8LL-P6 | 10 meters |
R4SS-P8 | R7UL-P6 | 10 meters |
R4SS-P9 | R6LL-P33 | 5 meters |
R4SS-P10 | R4UL-P32 | 3 meters |
R4SS-P11 | R3UL-P4 | 5 meters |
R4SS-P12 | R5UL-P33 | 5 meters |
R4SS-P13 | R1LL-P30 | 10 meters |
R4SS-P14 | R2LL-P4 | 5 meters |
R4SS-P15 | R6UL-P31 | 5 meters |
R4SS-P16 | R8UL-P6 | 10 meters |
R4SS-P17 | R4LL-P30 | 3 meters |
R4SS-P18 | R7LL-P6 | 10 meters |
R4SS-P19 | R5LL-P33 | 5 meters |
R4SS-P20 | R3LL-P33 | 5 meters |
R4SS-P21 | R9UL-P7 | 10 meters |
R4SS-P22 | R9LL-P7 | 10 meters |
R4SS-P23 | R10UL-P7 | 10 meters |
R4SS-P24 | R10LL-P7 | 10 meters |
R4SS-P25 | R11UL-P7 | 10 meters |
R4SS-P26 | R11LL-P7 | 10 meters |
R4SS-P27 | R12UL-P7 | 10 meters |
R4SS-P28 | R12LL-P7 | 10 meters |
R4SS-P29 | R13UL-P7 | 15 meters |
R4SS-P30 | R13LL-P7 | 15 meters |
R4SS-P31 | R14UL-P7 | 15 meters |
R4SS-P32 | R14LL-P7 | 15 meters |
R5SS-P5 | R1UL-P30 | 10 meters |
R5SS-P6 | R2UL-P7 | 10 meters |
R5SS-P7 | R5UL-P30 | 3 meters |
R5SS-P8 | R6LL-P30 | 5 meters |
R5SS-P9 | R7UL-P31 | 5 meters |
R5SS-P10 | R4UL-P5 | 5 meters |
R5SS-P11 | R3UL-P32 | 5 meters |
R5SS-P12 | R8LL-P31 | 10 meters |
R5SS-P13 | R1LL-P7 | 10 meters |
R5SS-P14 | R2LL-P33 | 10 meters |
R5SS-P15 | R5LL-P30 | 3 meters |
R5SS-P16 | R7LL-P31 | 5 meters |
R5SS-P17 | R4LL-P7 | 5 meters |
R5SS-P18 | R6UL-P33 | 5 meters |
R5SS-P19 | R8UL-P31 | 10 meters |
R5SS-P20 | R3LL-P5 | 5 meters |
R5SS-P21 | R9UL-P30 | 10 meters |
R5SS-P22 | R9LL-P31 | 10 meters |
R5SS-P23 | R10UL-P30 | 10 meters |
R5SS-P24 | R10LL-P31 | 10 meters |
R5SS-P25 | R11UL-P30 | 10 meters |
R5SS-P26 | R11LL-P31 | 10 meters |
R5SS-P27 | R12UL-P30 | 10 meters |
R5SS-P28 | R12LL-P31 | 10 meters |
R5SS-P29 | R13UL-P30 | 10 meters |
R5SS-P30 | R13LL-P31 | 10 meters |
R5SS-P31 | R14UL-P30 | 15 meters |
R5SS-P32 | R14LL-P31 | 15 meters |
R6SS-P5 | R1UL-P32 | 10 meters |
R6SS-P6 | R2UL-P33 | 10 meters |
R6SS-P7 | R5UL-P7 | 5 meters |
R6SS-P8 | R6LL-P32 | 3 meters |
R6SS-P9 | R7UL-P33 | 5 meters |
R6SS-P10 | R4UL-P30 | 5 meters |
R6SS-P11 | R3UL-P7 | 10 meters |
R6SS-P12 | R8LL-P33 | 5 meters |
R6SS-P13 | R1LL-P32 | 10 meters |
R6SS-P14 | R2LL-P7 | 10 meters |
R6SS-P15 | R5LL-P4 | 5 meters |
R6SS-P16 | R6UL-P30 | 3 meters |
R6SS-P17 | R4LL-P6 | 5 meters |
R6SS-P18 | R7LL-P33 | 5 meters |
R6SS-P19 | R8UL-P33 | 5 meters |
R6SS-P20 | R3LL-P30 | 10 meters |
R6SS-P21 | R9UL-P31 | 10 meters |
R6SS-P22 | R9LL-P32 | 10 meters |
R6SS-P23 | R10UL-P31 | 10 meters |
R6SS-P24 | R10LL-P32 | 10 meters |
R6SS-P25 | R11UL-P31 | 10 meters |
R6SS-P26 | R11LL-P32 | 10 meters |
R6SS-P27 | R12UL-P31 | 10 meters |
R6SS-P28 | R12LL-P32 | 10 meters |
R6SS-P29 | R13UL-P31 | 10 meters |
R6SS-P30 | R13LL-P32 | 10 meters |
R6SS-P31 | R14UL-P31 | 10 meters |
R6SS-P32 | R14LL-P32 | 10 meters |
R7SS-P5 | R1UL-P33 | 10 meters |
R7SS-P6 | R2UL-P32 | 10 meters |
R7SS-P7 | R5UL-P32 | 5 meters |
R7SS-P8 | R6LL-P6 | 5 meters |
R7SS-P9 | R7UL-P30 | 3 meters |
R7SS-P10 | R4UL-P31 | 10 meters |
R7SS-P11 | R3UL-P31 | 10 meters |
R7SS-P12 | R8LL-P30 | 5 meters |
R7SS-P13 | R1LL-P6 | 10 meters |
R7SS-P14 | R2LL-P32 | 10 meters |
R7SS-P15 | R5LL-P5 | 5 meters |
R7SS-P16 | R6UL-P5 | 5 meters |
R7SS-P17 | R4LL-P32 | 10 meters |
R7SS-P18 | R7LL-P30 | 3 meters |
R7SS-P19 | R8UL-P30 | 5 meters |
R7SS-P20 | R3LL-P7 | 10 meters |
R7SS-P21 | R9UL-P32 | 5 meters |
R7SS-P22 | R9LL-P33 | 5 meters |
R7SS-P23 | R10UL-P32 | 10 meters |
R7SS-P24 | R10LL-P33 | 10 meters |
R7SS-P25 | R11UL-P32 | 10 meters |
R7SS-P26 | R11LL-P33 | 10 meters |
R7SS-P27 | R12UL-P32 | 10 meters |
R7SS-P28 | R12LL-P33 | 10 meters |
R7SS-P29 | R13UL-P32 | 10 meters |
R7SS-P30 | R13LL-P33 | 10 meters |
R7SS-P31 | R14UL-P32 | 10 meters |
R7SS-P32 | R14LL-P33 | 10 meters |
R8SS-P5 | R1UL-P7 | 10 meters |
R8SS-P6 | R2UL-P30 | 10 meters |
R8SS-P7 | R5UL-P31 | 10 meters |
R8SS-P8 | R6LL-P7 | 5 meters |
R8SS-P9 | R7UL-P32 | 5 meters |
R8SS-P10 | R4UL-P4 | 10 meters |
R8SS-P11 | R3UL-P33 | 10 meters |
R8SS-P12 | R7LL-P32 | 5 meters |
R8SS-P13 | R1LL-P33 | 10 meters |
R8SS-P14 | R2LL-P30 | 10 meters |
R8SS-P15 | R5LL-P32 | 10 meters |
R8SS-P16 | R6UL-P32 | 5 meters |
R8SS-P17 | R4LL-P33 | 10 meters |
R8SS-P18 | R8LL-P32 | 3 meters |
R8SS-P19 | R8UL-P32 | 3 meters |
R8SS-P20 | R3LL-P6 | 10 meters |
R8SS-P21 | R9UL-P33 | 5 meters |
R8SS-P22 | R9LL-P34 | 5 meters |
R8SS-P23 | R10UL-P33 | 5 meters |
R8SS-P24 | R10LL-P34 | 5 meters |
R8SS-P25 | R11UL-P33 | 10 meters |
R8SS-P26 | R11LL-P34 | 10 meters |
R8SS-P27 | R12UL-P33 | 10 meters |
R8SS-P28 | R12LL-P34 | 10 meters |
R8SS-P29 | R13UL-P33 | 10 meters |
R8SS-P30 | R13LL-P34 | 10 meters |
R8SS-P31 | R14UL-P33 | 10 meters |
R8SS-P32 | R14LL-P34 | 10 meters |
R9SS-P5 | R1UL-P36 | 10 meters |
R9SS-P6 | R2UL-P36 | 10 meters |
R9SS-P7 | R5UL-P35 | 10 meters |
R9SS-P8 | R6LL-P1 | 10 meters |
R9SS-P9 | R7UL-P2 | 5 meters |
R9SS-P10 | R4UL-P34 | 10 meters |
R9SS-P11 | R3UL-P2 | 10 meters |
R9SS-P12 | R7LL-P1 | 5 meters |
R9SS-P13 | R1LL-P36 | 10 meters |
R9SS-P14 | R2LL-P3 | 10 meters |
R9SS-P15 | R5LL-P1 | 10 meters |
R9SS-P16 | R6UL-P3 | 10 meters |
R9SS-P17 | R4LL-P1 | 10 meters |
R9SS-P18 | R8LL-P2 | 5 meters |
R9SS-P19 | R8UL-P1 | 5 meters |
R9SS-P20 | R3LL-P3 | 10 meters |
R9SS-P21 | R9UL-P35 | 3 meters |
R9SS-P22 | R9LL-P35 | 3 meters |
R9SS-P23 | R10UL-P35 | 5 meters |
R9SS-P24 | R10LL-P35 | 5 meters |
R9SS-P25 | R11UL-P35 | 5 meters |
R9SS-P26 | R11LL-P35 | 5 meters |
R9SS-P27 | R12UL-P35 | 10 meters |
R9SS-P28 | R12LL-P35 | 10 meters |
R9SS-P29 | R13UL-P35 | 10 meters |
R9SS-P30 | R13LL-P35 | 10 meters |
R9SS-P31 | R14UL-P35 | 10 meters |
R9SS-P32 | R14LL-P35 | 10 meters |
R10SS-P5 | R1UL-P35 | 15 meters |
R10SS-P6 | R2UL-P34 | 10 meters |
R10SS-P7 | R5UL-P1 | 10 meters |
R10SS-P8 | R6LL-P2 | 10 meters |
R10SS-P9 | R7UL-P36 | 10 meters |
R10SS-P10 | R4UL-P3 | 10 meters |
R10SS-P11 | R3UL-P3 | 10 meters |
R10SS-P12 | R7LL-P2 | 10 meters |
R10SS-P13 | R1LL-P35 | 15 meters |
R10SS-P14 | R2LL-P36 | 10 meters |
R10SS-P15 | R5LL-P35 | 10 meters |
R10SS-P16 | R6UL-P35 | 10 meters |
R10SS-P17 | R4LL-P2 | 10 meters |
R10SS-P18 | R8LL-P36 | 5 meters |
R10SS-P19 | R8UL-P2 | 5 meters |
R10SS-P20 | R3LL-P2 | 10 meters |
R10SS-P21 | R9UL-P4 | 5 meters |
R10SS-P22 | R9LL-P6 | 5 meters |
R10SS-P23 | R10UL-P4 | 3 meters |
R10SS-P24 | R10LL-P6 | 3 meters |
R10SS-P25 | R11UL-P4 | 5 meters |
R10SS-P26 | R11LL-P6 | 5 meters |
R10SS-P27 | R12UL-P4 | 5 meters |
R10SS-P28 | R12LL-P6 | 5 meters |
R10SS-P29 | R13UL-P4 | 10 meters |
R10SS-P30 | R13LL-P6 | 10 meters |
R10SS-P31 | R14UL-P4 | 10 meters |
R10SS-P32 | R14LL-P6 | 10 meters |
R11SS-P5 | R1UL-P2 | 15 meters |
R11SS-P6 | R2UL-P35 | 15 meters |
R11SS-P7 | R5UL-P3 | 10 meters |
R11SS-P8 | R6LL-P35 | 10 meters |
R11SS-P9 | R7UL-P35 | 10 meters |
R11SS-P10 | R4UL-P2 | 10 meters |
R11SS-P11 | R3UL-P36 | 10 meters |
R11SS-P12 | R7LL-P35 | 10 meters |
R11SS-P13 | R1LL-P3 | 15 meters |
R11SS-P14 | R2LL-P34 | 15 meters |
R11SS-P15 | R5LL-P3 | 10 meters |
R11SS-P16 | R6UL-P2 | 10 meters |
R11SS-P17 | R4LL-P3 | 10 meters |
R11SS-P18 | R8LL-P35 | 10 meters |
R11SS-P19 | R8UL-P35 | 10 meters |
R11SS-P20 | R3LL-P34 | 10 meters |
R11SS-P21 | R9UL-P6 | 5 meters |
R11SS-P22 | R9LL-P2 | 5 meters |
R11SS-P23 | R10UL-P2 | 5 meters |
R11SS-P24 | R10LL-P4 | 5 meters |
R11SS-P25 | R11UL-P2 | 3 meters |
R11SS-P26 | R11LL-P4 | 3 meters |
R11SS-P27 | R12UL-P2 | 5 meters |
R11SS-P28 | R12LL-P4 | 5 meters |
R11SS-P29 | R13UL-P2 | 5 meters |
R11SS-P30 | R13LL-P4 | 5 meters |
R11SS-P31 | R14UL-P2 | 10 meters |
R11SS-P32 | R14LL-P4 | 10 meters |
R12SS-P5 | R1UL-P1 | 15 meters |
R12SS-P6 | R2UL-P1 | 15 meters |
R12SS-P7 | R5UL-P2 | 10 meters |
R12SS-P8 | R6LL-P36 | 10 meters |
R12SS-P9 | R7UL-P34 | 10 meters |
R12SS-P10 | R4UL-P35 | 10 meters |
R12SS-P11 | R3UL-P35 | 15 meters |
R12SS-P12 | R7LL-P34 | 10 meters |
R12SS-P13 | R1LL-P34 | 15 meters |
R12SS-P14 | R2LL-P1 | 15 meters |
R12SS-P15 | R5LL-P2 | 10 meters |
R12SS-P16 | R6UL-P34 | 10 meters |
R12SS-P17 | R4LL-P34 | 10 meters |
R12SS-P18 | R8LL-P34 | 10 meters |
R12SS-P19 | R8UL-P34 | 10 meters |
R12SS-P20 | R3LL-P36 | 15 meters |
R12SS-P21 | R9UL-P36 | 10 meters |
R12SS-P22 | R9LL-P30 | 10 meters |
R12SS-P23 | R10UL-P34 | 5 meters |
R12SS-P24 | R10LL-P2 | 5 meters |
R12SS-P25 | R11UL-P34 | 5 meters |
R12SS-P26 | R11LL-P36 | 5 meters |
R12SS-P27 | R12UL-P34 | 3 meters |
R12SS-P28 | R12LL-P36 | 3 meters |
R12SS-P29 | R13UL-P34 | 5 meters |
R12SS-P30 | R13LL-P36 | 5 meters |
R12SS-P31 | R14UL-P34 | 5 meters |
R12SS-P32 | R14LL-P36 | 5 meters |
R13SS-P5 | R1UL-P34 | 15 meters |
R13SS-P6 | R2UL-P3 | 15 meters |
R13SS-P7 | R5UL-P34 | 10 meters |
R13SS-P8 | R6LL-P3 | 10 meters |
R13SS-P9 | R7UL-P3 | 10 meters |
R13SS-P10 | R4UL-P1 | 15 meters |
R13SS-P11 | R3UL-P1 | 15 meters |
R13SS-P12 | R7LL-P36 | 10 meters |
R13SS-P13 | R1LL-P2 | 15 meters |
R13SS-P14 | R2LL-P35 | 15 meters |
R13SS-P15 | R5LL-P34 | 10 meters |
R13SS-P16 | R6UL-P36 | 10 meters |
R13SS-P17 | R4LL-P35 | 15 meters |
R13SS-P18 | R8LL-P1 | 10 meters |
R13SS-P19 | R8UL-P36 | 10 meters |
R13SS-P20 | R3LL-P1 | 15 meters |
R13SS-P21 | R9UL-P34 | 10 meters |
R13SS-P22 | R9LL-P4 | 10 meters |
R13SS-P23 | R10UL-P6 | 10 meters |
R13SS-P24 | R10LL-P36 | 10 meters |
R13SS-P25 | R11UL-P6 | 5 meters |
R13SS-P26 | R11LL-P2 | 5 meters |
R13SS-P27 | R12UL-P36 | 5 meters |
R13SS-P28 | R12LL-P30 | 5 meters |
R13SS-P29 | R13UL-P36 | 3 meters |
R13SS-P30 | R13LL-P30 | 3 meters |
R13SS-P31 | R14UL-P36 | 5 meters |
R13SS-P32 | R14LL-P30 | 5 meters |
R14SS-P5 | R1UL-P3 | 15 meters |
R14SS-P6 | R2UL-P2 | 15 meters |
R14SS-P7 | R5UL-P36 | 15 meters |
R14SS-P8 | R6LL-P34 | 10 meters |
R14SS-P9 | R7UL-P1 | 10 meters |
R14SS-P10 | R4UL-P36 | 15 meters |
R14SS-P11 | R3UL-P34 | 15 meters |
R14SS-P12 | R7LL-P3 | 10 meters |
R14SS-P13 | R1LL-P1 | 15 meters |
R14SS-P14 | R2LL-P2 | 15 meters |
R14SS-P15 | R5LL-P36 | 15 meters |
R14SS-P16 | R6UL-P1 | 10 meters |
R14SS-P17 | R4LL-P36 | 15 meters |
R14SS-P18 | R8LL-P3 | 10 meters |
R14SS-P19 | R8UL-P3 | 10 meters |
R14SS-P20 | R3LL-P35 | 15 meters |
R14SS-P21 | R9UL-P2 | 10 meters |
R14SS-P22 | R9LL-P36 | 10 meters |
R14SS-P23 | R10UL-P36 | 10 meters |
R14SS-P24 | R10LL-P30 | 10 meters |
R14SS-P25 | R11UL-P36 | 10 meters |
R14SS-P26 | R11LL-P30 | 10 meters |
R14SS-P27 | R12UL-P6 | 5 meters |
R14SS-P28 | R12LL-P2 | 5 meters |
R14SS-P29 | R13UL-P6 | 5 meters |
R14SS-P30 | R13LL-P2 | 5 meters |
R14SS-P31 | R14UL-P6 | 3 meters |
R14SS-P32 | R14LL-P2 | 3 meters |