22 Multi-Rack Cabling Tables for ZDLRA Rack X8M
This section contains multi-rack cabling tables for ZDLRA Rack X8M, which uses RoCE Network Fabric.
Understanding Multi-Rack Cabling for X8M Racks
Up to eight racks can be cabled together without external RDMA Network Fabric switches.
When cabling together multiple racks, each rack must contain three RDMA Network Fabric switches.
Two of the switches, known as leaf switches, connect to all of the database servers and storage servers in the rack. The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in Recovery Appliance X8M-2.
-
At rack unit 21 (U21) and 23 (U23) in Recovery Appliance X8M-8.
The third switch, known as the spine switch, interconnects the leaf switches in a multi-rack configuration. The spine switch is located at rack unit 1 (U1). If any rack does not include a spine switch, then order the expansion switch kit.
The procedures in this section assume the racks are adjacent to each other, standard routing in raised floor is used, and there are no obstacles in the raised floor. If these assumptions are not correct for your environment, then longer cables may be required for the connections.
Note:
By default, Oracle Exadata Database Machine X8M racks do not include spare cables or a third RoCE Network Fabric switch. To extend these racks, you must order the required cables and RoCE Network Fabric switch.The following diagram shows the default RDMA Network Fabric architecture for a single-rack system. Each rack has two leaf switches, with eight connections between the leaf switches. The database servers and storage servers are each connected to both leaf switches. Each server contains a dual-port RDMA Network Fabric card, with port 1 connected to the lower leaf switch and port 2 connected to the upper leaf switch.
When connecting up to eight racks together, remove the eight existing inter-switch connections between each leaf switch on each rack. From each leaf switch, distribute eight connections over the spine switches in all racks. In multi-rack environments, the leaf switches inside a rack are no longer directly interconnected, as shown in the following graphic:
As shown in the preceding graphic, each leaf switch in rack 1 has the following connections:
- Four connections to its internal spine switch
- Four connections to the spine switch in rack 2
The spine switch in rack 1 has the following connections:
- Four connections to each leaf switch in rack 1
- Four connections to each leaf switch in rack 2
As the number of racks increases from two to eight, the pattern continues as shown in the following graphic:
Figure 21-1 Connections Between Spine Switches and Leaf Switches for up to 8 Racks
As shown in the preceding graphic, each leaf switch has eight inter-switch connections distributed over all spine switches. Each spine switch has 16 inter-switch connections distributed over all leaf switches. The leaf switches are not directly interconnected with other leaf switches, and the spine switches are not directly interconnected with the other spine switches.
Preparing for Multi-Rack Cabling with X8M Racks
Racks can be added together to increase system capacity and performance. When cabling racks together, note the following:
-
The cable lengths shown in this document assume the racks are adjacent to each other. If the racks are not adjacent, or there are obstacles in the raised floor, or if you use overhead cabling, then longer cables may be required. For optical cables, the maximum supported cable length is 100 meters. For copper cables, the maximum supported cable length is 5 meters.
-
Oracle recommends that the names for the servers include the rack unit number. This helps identify the server during diagnostics.
-
When completing Oracle Exadata Deployment Assistant (OEDA) for the additional rack, you are prompted for SCAN addresses. However, these SCAN addresses are not used because the SCAN address from the original rack are used. Manually remove the new SCAN addresses from the generated installation files.
-
The software owner account names and group names, as well as their identifiers, must match the names and identifiers of the original rack.
-
If the additional grid disks are used with existing disk groups, then ensure the grid disk sizes for the new rack are the same as the original rack.
Note:
Recovery Appliance Eighth Racks, Quarter Racks, and Elastic Configurations are connected to other racks in the same fashion as larger racks are connected to each other. In other words, a spine switch must exist in each rack in order to interconnect with other racks.Perform the following tasks before cabling racks together:
-
Determine the number of racks that will be cabled together.
-
Order the parts needed to connect the racks.
To extend Recovery Appliance racks with RoCE Network Fabric, for each rack being added you must order extra cables, transceivers for longer cables, and a RoCE Network Fabric spine switch, if one is not already available.
When connecting four or more racks, or if you need longer cables for your environment, you must purchase additional 10 meter fiber cables with two QSFP28 SR transceivers to connect each end. The QSFP28 SR transceivers are needed for fiber cables over 5 meters in length.
The following table lists the number of racks, and cables needed to interconnect up to eight racks:
Number of Racks 3 Meter Cables Needed 5 Meter Cables Needed 10 Meter Cables Needed 2
16
16
0
3
16
32
0
4
16
40
8
5
16
46
18
6
17
49
30
7
19
51
42
8
16
52
60
-
Gather the following tools:
- Pen
- Note pad
- Flashlight
- Labels for cables and rack
- Cable ties (Oracle recommends hook and loop straps)
-
Determine a naming method for the rack prefixes. For example, if the original rack has the prefix
dbm01, then use the prefixdbm02for the second rack, the prefixdbm03for the third rack, and so on. -
Verify the racks have unique host names and IP addresses. All servers interconnected in the racks must have unique names and IP addresses.
Server names and IP addresses conventions may differ in the following cases:
-
Initial installation of all Recovery Appliance Racks: System address assignments and host names should be complete.
-
New Recovery Appliance Racks are added to an existing cluster: The new rack configuration should require unique host names and IP addresses for the new Recovery Appliance. The IP addresses on the same subnet cannot conflict with the existing systems.
-
Two existing Recovery Appliance Racks are clustered together: You can assign host names and IP addresses only if Recovery Appliances are already assigned unique host names and IP addresses, or the entire cluster must be reconfigured. The machines must be on the same subnet and not have conflicting IP addresses.
-
-
Ensure the IP addresses for the new servers are in the same subnet, and do not overlap with the currently-installed servers.
-
Check that the firmware on the original switches is at the same level as the new switches by using the
sh vercommand.It is highly recommended, though not mandatory, to use the same firmware version on all of the switches. If the firmware is not at the same level, you can apply a firmware patch to bring the switches up to the same firmware level.
Cabling Multiple Recovery Appliance X8M Racks
A spine switch must exist in the Recovery Appliance rack, regardless of size, to multi-rack with other racks.
Note:
To extend Recovery Appliance racks with RoCE Network Fabric, you must order cables, transceivers if needed, and a RoCE Network Fabric switch, if they are not already available.In the following steps, the number in parentheses also indicates the number of cables required.
-
Split each leaf switch uplink bundle by the number of spine switches (or racks) in such a way that the total count adds up to 8. This split is represented in parentheses for each example.
Example 1: For two racks, take 8 uplinks from each leaf switch and split evenly by 2. Four uplinks from each leaf switch go to
rack1-spineswitch, and four uplinks from each leaf switch go torack2-spineswitch ( 4 + 4 for each leaf switch).Example 2: For three racks, take 8 uplinks from each leaf switch and split evenly by 3. Three uplinks go to
rack1-spineswitch, three uplinks go torack2-spineswitch, two uplinks go torack3-spineswitch ( 3 + 3 + 2 for each leaf switch). -
Starting from the first available port on a different spine switch, round-robin the above split scheme for each leaf switch and spine switch.
For example, for three racks:
rack1-leaf1switch starts fromrack1-spineswitch for first split,rack2-spineswitch for second split,rack3-spineswitch for third splitrack2-leaf1switch starts fromrack2-spineswitch for first split,rack3-spineswitch for second split,rack1-spinefor third splitrack3-leaf1switch starts fromrack3-spineswitch for first split,rack1-spineswitch for second split,rack2-spineswitch for third split- and so on...
-
After walking through all leaf switch uplinks in each case, you will have used all spine switch ports between port 5 and 20 inclusive.
The remaining topics in this section provide detailed cabling information for cabling up to 8 racks together.
Two-Rack Cabling for X8M Racks
This section provides the cabling tables to connect two X8M racks together, both of which use RoCE Network Fabric.
Note:
The following conventions were used in the cabling notation for connecting multiple racks together.
-
The spine switch (also referred to as SS) is in U1 for all racks.
-
The leaf switches are referred to as Lower Leaf (LL) and Upper Leaf (UL).
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in Recovery Appliance X8M-2 or Storage Expansion Rack X8M-2
-
At rack unit 21 (U21) and rack unit 23 (U23) in Recovery Appliance X8M-8
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X8M-8 systems with three database servers and 11 storage servers only, you must adjust the following multi-rack cabling information. On such systems only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, in the following tables, any connection to port number 30 on any leaf switch must instead connect to port number 34 on the same leaf switch. For example, R1-UL-P30 must change to R1-UL-P34, R1-LL-P30 must change to R1-LL-P34, and so on. These changes only apply to X8M-8 systems with three database servers and 11 storage servers.
The following illustration shows the cable connections for the two spine switches (R1 SS and R2 SS) when cabling two racks together:
The following table describes the cable connections for the first spine switch (R1 SS) when cabling two racks together:
Table 21-1 Leaf Switch Connections for the First Rack in a Two-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R1 UL within Rack 1 |
R1-UL-P5 to R1-SS-P5 R1-UL-P7 to R1-SS-P7 R1-UL-P4 to R1-SS-P9 R1-UL-P6 to R1-SS-P11 |
3 meters |
|
R1 UL to Rack 2 |
R1-UL-P31 to R2-SS-P5 R1-UL-P33 to R2-SS-P7 R1-UL-P30 to R2-SS-P9 R1-UL-P32 to R2-SS-P11 |
5 meters |
|
R1 LL within Rack 1 |
R1-LL-P5 to R1-SS-P13 R1-LL-P7 to R1-SS-P15 R1-LL-P4 to R1-SS-P17 R1-LL-P6 to R1-SS-P19 |
3 meters |
|
R1 LL to Rack 2 |
R1-LL-P31 to R2-SS-P13 R1-LL-P33 to R2-SS-P15 R1-LL-P30 to R2-SS-P17 R1-LL-P32 to R2-SS-P19 |
5 meters |
The following table describes the cable connections for the second spine switch (R2 SS) when cabling two racks together:
Table 21-2 Leaf Switch Connections for the Second Rack in a Two-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R2 UL to Rack 1 |
R2-UL-P5 to R1-SS-P6 R2-UL-P7 to R1-SS-P8 R2-UL-P4 to R1-SS-P10 R2-UL-P6 to R1-SS-P12 |
5 meters |
|
R2 UL within Rack 2 |
R2-UL-P31 to R2-SS-P6 R2-UL-P33 to R2-SS-P8 R2-UL-P30 to R2-SS-P10 R2-UL-P32 to R2-SS-P12 |
3 meters |
|
R2 LL to Rack 1 |
R2-LL-P5 to R1-SS-P14 R2-LL-P7 to R1-SS-P16 R2-LL-P4 to R1-SS-P18 R2-LL-P6 to R1-SS-P20 |
5 meters |
|
R2 LL within Rack 2 |
R2-LL-P31 to R2-SS-P14 R2-LL-P33 to R2-SS-P16 R2-LL-P30 to R2-SS-P18 R2-LL-P32 to R2-SS-P20 |
3 meters |
Three-Rack Cabling for X8M Racks
This section provides the cabling tables to connect three X8M racks together using RoCE Network Fabric.
Note:
The following conventions were used in the cabling notation for connecting multiple racks together.
-
The spine switch (also referred to as SS) is in U1 for all racks.
-
The leaf switches are referred to as Lower Leaf (LL) and Upper Leaf (UL).
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in Recovery Appliance X8M-2 or Storage Expansion Rack X8M-2
-
At rack unit 21 (U21) and rack unit 23 (U23) in Recovery Appliance X8M-8
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X8M-8 systems with three database servers and 11 storage servers only, you must adjust the following multi-rack cabling information. On such systems only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, in the following tables, any connection to port number 30 on any leaf switch must instead connect to port number 34 on the same leaf switch. For example, R1-UL-P30 must change to R1-UL-P34, R1-LL-P30 must change to R1-LL-P34, and so on. These changes only apply to X8M-8 systems with three database servers and 11 storage servers.
The following illustration shows the cable connections for the three spine switches (Rack1-spine, Rack2-spine, and Rack3-spine) when cabling three racks together:
The following table describes the cable connections for the first spine switch (R1-SS) when cabling three racks together:
Table 21-3 Leaf Switch Connections for the First Rack in a Three-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R1 UL within Rack 1 |
R1-UL-P5 to R1-SS-P5 R1-UL-P7 to R1-SS-P7 R1-UL-P4 to R1-SS-P9 |
3 meters |
|
R1 UL to Rack 2 |
R1-UL-P31 to R2-SS-P5 R1-UL-P33 to R2-SS-P7 R1-UL-P30 to R2-SS-P9 |
5 meters |
|
R1 UL to Rack 3 |
R1-UL-P6 to R3-SS-P5 R1-UL-P32 to R3-SS-P7 |
5 meters |
|
R1 LL within Rack 1 |
R1-LL-P5 to R1-SS-P13 R1-LL-P7 to R1-SS-P15 |
3 meters |
|
R1 LL to Rack 2 |
R1-LL-P31 to R2-SS-P13 R1-LL-P33 to R2-SS-P15 R1-LL-P30 to R2-SS-P17 |
5 meters |
|
R1 LL to Rack 3 |
R1-LL-P4 to R3-SS-P13 R1-LL-P6 to R3-SS-P15 R1-LL-P32 to R3-SS-P17 |
5 meters |
The following table describes the cable connections for the second spine switch (R2-SS) when cabling three racks together:
Table 21-4 Leaf Switch Connections for the Second Rack in a Three-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R2 UL to Rack 1 |
R2-UL-P5 to R1-SS-P6 R2-UL-P7 to R1-SS-P8 R2-UL-P4 to R1-SS-P10 |
5 meters |
|
R2 UL within Rack 2 |
R2-UL-P31 to R2-SS-P6 R2-UL-P33 to R2-SS-P8 |
3 meters |
|
R2 UL to Rack 3 |
R2-UL-P6 to R3-SS-P6 R2-UL-P30 to R3-SS-P8 R2-UL-P32 to R3-SS-P10 |
5 meters |
|
R2 LL to Rack 1 |
R2-LL-P5 to R1-SS-P14 R2-LL-P7 to R1-SS-P16 R2-LL-P4 to R1-SS-P18 |
5 meters |
|
R2 LL within Rack 2 |
R2-LL-P31 to R2-SS-P14 R2-LL-P33 to R2-SS-P16 R2-LL-P30 to R2-SS-P18 |
3 meters |
|
R2 LL to Rack 3 |
R2-LL-P6 to R3-SS-P14 R2-LL-P32 to R3-SS-P16 |
5 meters |
The following table describes the cable connections for the third spine switch (R3-SS) when cabling three racks together:
Table 21-5 Leaf Switch Connections for the Third Rack in a Three-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R3 UL to Rack 1 |
R3-UL-P5 to R1-SS-P11 R3-UL-P7 to R1-SS-P12 |
5 meters |
|
R3 UL to Rack 2 |
R3-UL-P4 to R2-SS-P10 R3-UL-P6 to R2-SS-P11 R3-UL-P31 to R2-SS-P12 |
5 meters |
|
R3 UL within Rack 3 |
R3-UL-P33 to R3-SS-P9 R3-UL-P30 to R3-SS-P11 R3-UL-P32 to R3-SS-P12 |
3 meters |
|
R3 LL to Rack 1 |
R3-LL-P5 to R1-SS-P17 R3-LL-P7 to R1-SS-P19 R3-LL-P4 to R1-SS-P20 |
5 meters |
|
R3 LL to Rack 2 |
R3-LL-P6 to R2-SS-P19 R3-LL-P31 to R2-SS-P20 |
5 meters |
|
R3 LL within Rack 3 |
R3-LL-P33 to R3-SS-P18 R3-LL-P30 to R3-SS-P19 R3-LL-P32 to R3-SS-P20 |
3 meters |
Four-Rack Cabling for X8M Racks
This section provides the cabling tables to connect four X8M racks together, all of which use RoCE Network Fabric.
Note:
The following conventions were used in the cabling notation for connecting multiple racks together.
-
The spine switch (also referred to as SS) is in U1 for all racks.
-
The leaf switches are referred to as Lower Leaf (LL) and Upper Leaf (UL).
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in Recovery Appliance X8M-2 or Storage Expansion Rack X8M-2
-
At rack unit 21 (U21) and rack unit 23 (U23) in Recovery Appliance X8M-8
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X8M-8 systems with three database servers and 11 storage servers only, you must adjust the following multi-rack cabling information. On such systems only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, in the following tables, any connection to port number 30 on any leaf switch must instead connect to port number 34 on the same leaf switch. For example, R1-UL-P30 must change to R1-UL-P34, R1-LL-P30 must change to R1-LL-P34, and so on. These changes only apply to X8M-8 systems with three database servers and 11 storage servers.
The following illustration shows the cable connections for the four spine switches (Rack1-spine, Rack2-spine, Rack3-spine, and Rack4-spine) when cabling two racks together:
The following table describes the cable connections for the first spine switch (R1-SS) when cabling four racks together:
Table 21-6 Leaf Switch Connections for the First Rack in a Four-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R1 UL within Rack 1 |
R1-UL-P5 to R1-SS-P5 R1-UL-P7 to R1-SS-P7 |
3 meters |
|
R1 UL to Rack 2 |
R1-UL-P31 to R2-SS-P5 R1-UL-P33 to R2-SS-P7 |
5 meters |
|
R1 UL to Rack 3 |
R1-UL-P6 to R3-SS-P5 R1-UL-P32 to R3-SS-P7 |
5 meters |
|
R1 UL to Rack 4 |
R1-UL-P4 to R4-SS-P5 R1-UL-P30 to R4-SS-P7 |
10 meters |
|
R1 LL within Rack 1 |
R1-LL-P5 to R1-SS-P13 R1-LL-P7 to R1-SS-P15 |
3 meters |
|
R1 LL to Rack 2 |
R1-LL-P31 to R2-SS-P13 R1-LL-P33 to R2-SS-P15 |
5 meters |
|
R1 LL to Rack 3 |
R1-LL-P4 to R3-SS-P13 R1-LL-P6 to R3-SS-P15 |
5 meters |
|
R1 LL to Rack 4 |
R1-LL-P30 to R4-SS-P13 R1-LL-P32 to R4-SS-P15 |
10 meters |
The following table describes the cable connections for the second spine switch (R2-SS) when cabling four full racks together:
Table 21-7 Leaf Switch Connections for the Second Rack in a Four-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R2 UL to Rack 1 |
R2-UL-P5 to R1-SS-P6 R2-UL-P7 to R1-SS-P8 |
5 meters |
|
R2 UL within Rack 2 |
R2-UL-P31 to R2-SS-P6 R2-UL-P33 to R2-SS-P8 |
3 meters |
|
R2 UL to Rack 3 |
R2-UL-P6 to R3-SS-P6 R2-UL-P30 to R3-SS-P8 |
5 meters |
|
R2 UL to Rack 4 |
R2-UL-P4 to R4-SS-P6 R2-UL-P32 to R4-SS-P8 |
5 meters |
|
R2 LL to Rack 1 |
R2-LL-P5 to R1-SS-P14 R2-LL-P7 to R1-SS-P16 |
5 meters |
|
R2 LL within Rack 2 |
R2-LL-P31 to R2-SS-P14 R2-LL-P33 to R2-SS-P16 |
3 meters |
|
R2 LL to Rack 3 |
R2-LL-P6 to R3-SS-P14 R2-LL-P32 to R3-SS-P16 |
5 meters |
|
R2 LL to Rack 4 |
R2-LL-P4 to R4-SS-P14 R2-LL-P30 to R4-SS-P16 |
5 meters |
The following table describes the cable connections for the third spine switch (R3-SS) when cabling four full racks together:
Table 21-8 Leaf Switch Connections for the Third Rack in a Four-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R3 UL to Rack 1 |
R3-UL-P5 to R1-SS-P11 R3-UL-P7 to R1-SS-P12 |
5 meters |
|
R3 UL to Rack 2 |
R3-UL-P6 to R2-SS-P11 R3-UL-P31 to R2-SS-P12 |
5 meters |
|
R3 UL within Rack 3 |
R3-UL-P30 to R3-SS-P11 R3-UL-P32 to R3-SS-P12 |
3 meters |
|
R3 UL to Rack 4 |
R3-UL-P4 to R4-SS-P11 R3-UL-P33 to R4-SS-P12 |
5 meters |
|
R3 LL to Rack 1 |
R3-LL-P7 to R1-SS-P19 R3-LL-P4 to R1-SS-P20 |
5 meters |
|
R3 LL to Rack 2 |
R3-LL-P6 to R2-SS-P19 R3-LL-P31 to R2-SS-P20 |
5 meters |
|
R3 LL within Rack 3 |
R3-LL-P30 to R3-SS-P19 R3-LL-P32 to R3-SS-P20 |
3 meters |
|
R3 LL to Rack 4 |
R3-LL-P5 to R4-SS-P19 R3-LL-P33 to R4-SS-P20 |
5 meters |
The following table describes the cable connections for the fourth spine switch (R4-SS) when cabling four full racks together:
Table 21-9 Leaf Switch Connections for the Fourth Rack in a Four-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R4 UL to Rack 1 |
R4-UL-P5 to R1-SS-P9 R4-UL-P7 to R1-SS-P10 |
10 meters |
|
R4 UL to Rack 2 |
R4-UL-P4 to R2-SS-P9 R4-UL-P6 to R2-SS-P10 |
5 meters |
|
R4 UL to Rack 3 |
R4-UL-P31 to R3-SS-P9 R4-UL-P33 to R3-SS-P10 |
5 meters |
|
R4 UL within Rack 4 |
R4-UL-P30 to R4-SS-P9 R4-UL-P32 to R4-SS-P10 |
3 meters |
|
R4 LL to Rack 1 |
R4-LL-P5 to R1-SS-P17 R4-LL-P7 to R1-SS-P18 |
10 meters |
|
R4 LL to Rack 2 |
R4-LL-P4 to R2-SS-P17 R4-LL-P6 to R2-SS-P18 |
5 meters |
|
R4 LL to Rack 3 |
R4-LL-P31 to R3-SS-P17 R4-LL-P33 to R3-SS-P18 |
5 meters |
|
R4 LL within Rack 4 |
R4-LL-P30 to R4-SS-P17 R4-LL-P32 to R4-SS-P18 |
3 meters |
Five-Rack Cabling for X8M Racks
This section provides the cabling tables to connect five (5) X8M racks together, all of which use RoCE Network Fabric.
Note:
The following conventions were used in the cabling notation for connecting multiple racks together.
-
The spine switch (also referred to as SS) is in U1 for all racks.
-
The leaf switches are referred to as Lower Leaf (LL) and Upper Leaf (UL).
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in Recovery Appliance X8M-2 or Storage Expansion Rack X8M-2
-
At rack unit 21 (U21) and rack unit 23 (U23) in Recovery Appliance X8M-8
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X8M-8 systems with three database servers and 11 storage servers only, you must adjust the following multi-rack cabling information. On such systems only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, in the following tables, any connection to port number 30 on any leaf switch must instead connect to port number 34 on the same leaf switch. For example, R1-UL-P30 must change to R1-UL-P34, R1-LL-P30 must change to R1-LL-P34, and so on. These changes only apply to X8M-8 systems with three database servers and 11 storage servers.
The following illustration shows the cable connections for the five spine switches when cabling five racks together:
The following table describes the cable connections for the first spine switch (R1-SS) when cabling five racks together:
Table 21-10 Leaf Switch Connections for the First Rack in a Five-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R1 UL within Rack 1 |
R1-UL-P5 to R1-SS-P5 R1-UL-P7 to R1-SS-P7 |
3 meters |
|
R1 UL to Rack 2 |
R1-UL-P31 to R2-SS-P5 R1-UL-P33 to R2-SS-P7 |
5 meters |
|
R1 UL to Rack 3 |
R1-UL-P6 to R3-SS-P5 R1-UL-P32 to R3-SS-P7 |
5 meters |
|
R1 UL to Rack 4 |
R1-UL-P4 to R4-SS-P5 |
10 meters |
|
R1 UL to Rack 5 |
R1-UL-P30 to R5-SS-P5 |
10 meters |
|
R1 LL within Rack 1 |
R1-LL-P5 to R1-SS-P13 |
3 meters |
|
R1 LL to Rack 2 |
R1-LL-P31 to R2-SS-P13 R1-LL-P33 to R2-SS-P15 |
5 meters |
|
R1 LL to Rack 3 |
R1-LL-P4 to R3-SS-P13 R1-LL-P6 to R3-SS-P15 |
5 meters |
|
R1 LL to Rack 4 |
R1-LL-P30 to R4-SS-P13 R1-LL-P32 to R4-SS-P15 |
10 meters |
|
R1 LL to Rack 5 |
R1-LL-P7 to R5-SS-P13 |
10 meters |
The following table describes the cable connections for the second spine switch (R2-SS) when cabling five full racks together:
Table 21-11 Leaf Switch Connections for the Second Rack in a Five-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R2 UL to Rack 1 |
R2-UL-P5 to R1-SS-P6 |
5 meters |
|
R2 UL within Rack 2 |
R2-UL-P31 to R2-SS-P6 |
3 meters |
|
R2 UL to Rack 3 |
R2-UL-P6 to R3-SS-P6 R2-UL-P30 to R3-SS-P8 |
5 meters |
|
R2 UL to Rack 4 |
R2-UL-P4 to R4-SS-P6 R2-UL-P32 to R4-SS-P8 |
5 meters |
|
R2 UL to Rack 5 |
R2-UL-P7 to R5-SS-P6 R2-UL-P33 to R5-SS-P8 |
10 meters |
|
R2 LL to Rack 1 |
R2-LL-P5 to R1-SS-P14 R2-LL-P7 to R1-SS-P16 |
5 meters |
|
R2 LL within Rack 2 |
R2-LL-P31 to R2-SS-P14 |
3 meters |
|
R2 LL to Rack 3 |
R2-LL-P6 to R3-SS-P14 |
5 meters |
|
R2 LL to Rack 4 |
R2-LL-P4 to R4-SS-P14 R2-LL-P30 to R4-SS-P16 |
5 meters |
|
R2 LL to Rack 5 |
R2-LL-P33 to R5-SS-P14 R2-LL-P32 to R5-SS-P16 |
10 meters |
The following table describes the cable connections for the third spine switch (R3-SS) when cabling five full racks together:
Table 21-12 Leaf Switch Connections for the Third Rack in a Five-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R3 UL to Rack 1 |
R3-UL-P5 to R1-SS-P11 R3-UL-P7 to R1-SS-P12 |
5 meters |
|
R3 UL to Rack 2 |
R3-UL-P6 to R2-SS-P11 R3-UL-P31 to R2-SS-P12 |
5 meters |
|
R3 UL within Rack 3 |
R3-UL-P30 to R3-SS-P11 |
3 meters |
|
R3 UL to Rack 4 |
R3-UL-P4 to R4-SS-P11 |
5 meters |
|
R3 UL to Rack 5 |
R3-UL-P32 to R5-SS-P11 R3-UL-P33 to R5-SS-P12 |
5 meters |
|
R3 LL to Rack 1 |
R3-LL-P7 to R1-SS-P19 R3-LL-P4 to R1-SS-P20 |
5 meters |
|
R3 LL to Rack 2 |
R3-LL-P6 to R2-SS-P19 R3-LL-P31 to R2-SS-P20 |
5 meters |
|
R3 LL within Rack 3 |
R3-LL-P30 to R3-SS-P19 R3-LL-P32 to R3-SS-P20 |
3 meters |
|
R3 LL to Rack 4 |
R3-LL-P33 to R4-SS-P20 |
5 meters |
|
R3 LL to Rack 5 |
R3-LL-P5 to R5-SS-P20 |
5 meters |
The following table describes the cable connections for the fourth spine switch (R4-SS) when cabling five full racks together:
Table 21-13 Leaf Switch Connections for the Fourth Rack in a Five-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R4 UL to Rack 1 |
R4-UL-P7 to R1-SS-P10 |
10 meters |
|
R4 UL to Rack 2 |
R4-UL-P4 to R2-SS-P9 R4-UL-P6 to R2-SS-P10 |
5 meters |
|
R4 UL to Rack 3 |
R4-UL-P31 to R3-SS-P9 R4-UL-P33 to R3-SS-P10 |
5 meters |
|
R4 UL within Rack 4 |
R4-UL-P30 to R4-SS-P9 R4-UL-P32 to R4-SS-P10 |
3 meters |
|
R4 UL to Rack 5 |
R4-UL-P5 to R5-SS-P10 |
5 meters |
|
R4 LL to Rack 1 |
R4-LL-P5 to R1-SS-P17 |
10 meters |
|
R4 LL to Rack 2 |
R4-LL-P4 to R2-SS-P17 |
5 meters |
|
R4 LL to Rack 3 |
R4-LL-P31 to R3-SS-P17 R4-LL-P33 to R3-SS-P18 |
5 meters |
|
R4 LL within Rack 4 |
R4-LL-P30 to R4-SS-P17 R4-LL-P32 to R4-SS-P18 |
3 meters |
|
R4 LL to Rack 5 |
R4-LL-P7 to R5-SS-P17 R4-LL-P6 to R5-SS-P18 |
5 meters |
The following table describes the cable connections for the fifth spine switch (R5-SS) when cabling five full racks together:
Table 21-14 Leaf Switch Connections for the Fifth Rack in a Five-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R5 UL to Rack 1 |
R5-UL-P5 to R1-SS-P8 R5-UL-P7 to R1-SS-P9 |
10 meters |
|
R5 UL to Rack 2 |
R5-UL-P4 to R2-SS-P8 |
10 meters |
|
R5 UL to Rack 3 |
R5-UL-P6 to R3-SS-P12 |
5 meters |
|
R5 UL to Rack 4 |
R5-UL-P31 to R4-SS-P7 R5-UL-P33 to R4-SS-P12 |
5 meters |
|
R5 UL within Rack 5 |
R5-UL-P30 to R5-SS-P7 R5-UL-P32 to R5-SS-P9 |
3 meters |
|
R5 LL to Rack 1 |
R5-LL-P5 to R1-SS-P15 R5-LL-P7 to R1-SS-P18 |
10 meters |
|
R5 LL to Rack 2 |
R5-LL-P4 to R2-SS-P16 R5-LL-P6 to R2-SS-P18 |
10 meters |
|
R5 LL to Rack 3 |
R5-LL-P31 to R3-SS-P16 |
5 meters |
|
R5 LL to Rack 4 |
R5-LL-P33 to R4-SS-P19 |
5 meters |
|
R5 LL within Rack 5 |
R5-LL-P30 to R5-SS-P15 R5-LL-P32 to R5-SS-P19 |
3 meters |
Six-Rack Cabling for X8M Racks
This section provides the cabling tables to connect six (6) X8M racks together, all of which use RoCE Network Fabric.
Note:
The following conventions were used in the cabling notation for connecting multiple racks together.
-
The spine switch (also referred to as SS) is in U1 for all racks.
-
The leaf switches are referred to as Lower Leaf (LL) and Upper Leaf (UL).
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in Recovery Appliance X8M-2 or Storage Expansion Rack X8M-2
-
At rack unit 21 (U21) and rack unit 23 (U23) in Recovery Appliance X8M-8
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X8M-8 systems with three database servers and 11 storage servers only, you must adjust the following multi-rack cabling information. On such systems only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, in the following tables, any connection to port number 30 on any leaf switch must instead connect to port number 34 on the same leaf switch. For example, R1-UL-P30 must change to R1-UL-P34, R1-LL-P30 must change to R1-LL-P34, and so on. These changes only apply to X8M-8 systems with three database servers and 11 storage servers.
The following illustration shows the cable connections for the 6 spine switches when cabling six racks together:
The following table describes the cable connections for the first spine switch (R1-SS) when cabling six racks together:
Table 21-15 Leaf Switch Connections for the First Rack in a Six-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R1 UL within Rack 1 |
R1-UL-P5 to R1-SS-P5 R1-UL-P7 to R1-SS-P7 |
3 meters |
|
R1 UL to Rack 2 |
R1-UL-P31 to R2-SS-P5 R1-UL-P33 to R2-SS-P7 |
5 meters |
|
R1 UL to Rack 3 |
R1-UL-P6 to R3-SS-P5 |
5 meters |
|
R1 UL to Rack 4 |
R1-UL-P4 to R4-SS-P5 |
10 meters |
|
R1 UL to Rack 5 |
R1-UL-P30 to R5-SS-P5 |
10 meters |
|
R1 UL to Rack 6 |
R1-UL-P32 to R6-SS-P5 |
10 meters |
|
R1 LL within Rack 1 |
R1-LL-P5 to R1-SS-P13 |
3 meters |
|
R1 LL to Rack 2 |
R1-LL-P31 to R2-SS-P13 R1-LL-P33 to R2-SS-P15 |
5 meters |
|
R1 LL to Rack 3 |
R1-LL-P4 to R3-SS-P13 R1-LL-P6 to R3-SS-P15 |
5 meters |
|
R1 LL to Rack 4 |
R1-LL-P30 to R4-SS-P13 |
10 meters |
|
R1 LL to Rack 5 |
R1-LL-P7 to R5-SS-P13 |
10 meters |
|
R1 LL to Rack 6 |
R1-LL-P32 to R6-SS-P13 |
10 meters |
The following table describes the cable connections for the second spine switch (R2-SS) when cabling six full racks together:
Table 21-16 Leaf Switch Connections for the Second Rack in a Six-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R2 UL to Rack 1 |
R2-UL-P5 to R1-SS-P6 |
5 meters |
|
R2 UL within Rack 2 |
R2-UL-P31 to R2-SS-P6 |
3 meters |
|
R2 UL to Rack 3 |
R2-UL-P6 to R3-SS-P6 R2-UL-P30 to R3-SS-P8 |
5 meters |
|
R2 UL to Rack 4 |
R2-UL-P4 to R4-SS-P6 R2-UL-P32 to R4-SS-P8 |
5 meters |
|
R2 UL to Rack 5 |
R2-UL-P7 to R5-SS-P6 |
10 meters |
|
R2 UL to Rack 6 |
R2-UL-P33 to R6-SS-P6 |
10 meters |
|
R2 LL to Rack 1 |
R2-LL-P5 to R1-SS-P14 |
5 meters |
|
R2 LL within Rack 2 |
R2-LL-P31 to R2-SS-P14 |
3 meters |
|
R2 LL to Rack 3 |
R2-LL-P6 to R3-SS-P14 |
5 meters |
|
R2 LL to Rack 4 |
R2-LL-P4 to R4-SS-P14 R2-LL-P30 to R4-SS-P16 |
5 meters |
|
R2 LL to Rack 5 |
R2-LL-P33 to R5-SS-P14 R2-LL-P32 to R5-SS-P16 |
10 meters |
|
R2 LL to Rack 6 |
R2-LL-P7 to R6-SS-P14 |
10 meters |
The following table describes the cable connections for the third spine switch (R3-SS) when cabling six full racks together:
Table 21-17 Leaf Switch Connections for the Third Rack in a Six-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R3 UL to Rack 1 |
R3-UL-P5 to R1-SS-P11 |
5 meters |
|
R3 UL to Rack 2 |
R3-UL-P6 to R2-SS-P11 |
5 meters |
|
R3 UL within Rack 3 |
R3-UL-P30 to R3-SS-P11 |
3 meters |
|
R3 UL to Rack 4 |
R3-UL-P4 to R4-SS-P11 |
5 meters |
|
R3 UL to Rack 5 |
R3-UL-P32 to R5-SS-P11 R3-UL-P33 to R5-SS-P12 |
5 meters |
|
R3 UL to Rack 6 |
R3-UL-P7 to R6-SS-P11 R3-UL-P31 to R6-SS-P12 |
10 meters |
|
R3 LL to Rack 1 |
R3-LL-P7 to R1-SS-P19 R3-LL-P4 to R1-SS-P20 |
5 meters |
|
R3 LL to Rack 2 |
R3-LL-P31 to R2-SS-P20 |
5 meters |
|
R3 LL within Rack 3 |
R3-LL-P32 to R3-SS-P20 |
3 meters |
|
R3 LL to Rack 4 |
R3-LL-P33 to R4-SS-P20 |
5 meters |
|
R3 LL to Rack 5 |
R3-LL-P5 to R5-SS-P20 |
5 meters |
|
R3 LL to Rack 6 |
R3-LL-P6 to R6-SS-P19 R3-LL-P30 to R6-SS-P20 |
10 meters |
The following table describes the cable connections for the fourth spine switch (R4-SS) when cabling six full racks together:
Table 21-18 Leaf Switch Connections for the Fourth Rack in a Six-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R4 UL to Rack 1 |
R4-UL-P7 to R1-SS-P10 |
10 meters |
|
R4 UL to Rack 2 |
R4-UL-P4 to R2-SS-P9 R4-UL-P6 to R2-SS-P10 |
5 meters |
|
R4 UL to Rack 3 |
R4-UL-P31 to R3-SS-P9 R4-UL-P33 to R3-SS-P10 |
5 meters |
|
R4 UL within Rack 4 |
R4-UL-P32 to R4-SS-P10 |
3 meters |
|
R4 UL to Rack 5 |
R4-UL-P5 to R5-SS-P10 |
5 meters |
|
R4 UL to Rack 6 |
R4-UL-P30 to R6-SS-P10 |
5 meters |
|
R4 LL to Rack 1 |
R4-LL-P5 to R1-SS-P17 |
10 meters |
|
R4 LL to Rack 2 |
R4-LL-P4 to R2-SS-P17 |
5 meters |
|
R4 LL to Rack 3 |
R4-LL-P31 to R3-SS-P17 R4-LL-P33 to R3-SS-P18 |
5 meters |
|
R4 LL within Rack 4 |
R4-LL-P30 to R4-SS-P17 R4-LL-P32 to R4-SS-P18 |
3 meters |
|
R4 LL to Rack 5 |
R4-LL-P7 to R5-SS-P17 |
5 meters |
|
R4 LL to Rack 6 |
R4-LL-P6 to R6-SS-P17 |
5 meters |
The following table describes the cable connections for the fifth spine switch (R5-SS) when cabling six full racks together:
Table 21-19 Leaf Switch Connections for the Fifth Rack in a Six-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R5 UL to Rack 1 |
R5-UL-P5 to R1-SS-P8 |
10 meters |
|
R5 UL to Rack 2 |
R5-UL-P4 to R2-SS-P8 |
10 meters |
|
R5 UL to Rack 3 |
R5-UL-P6 to R3-SS-P12 |
5 meters |
|
R5 UL to Rack 4 |
R5-UL-P31 to R4-SS-P7 R5-UL-P33 to R4-SS-P12 |
5 meters |
|
R5 UL within Rack 5 |
R5-UL-P30 to R5-SS-P7 R5-UL-P32 to R5-SS-P9 |
3 meters |
|
R5 UL to Rack 6 |
R5-UL-P7 to R6-SS-P7 |
5 meters |
|
R5 LL to Rack 1 |
R5-LL-P7 to R1-SS-P18 |
10 meters |
|
R5 LL to Rack 2 |
R5-LL-P6 to R2-SS-P18 |
10 meters |
|
R5 LL to Rack 3 |
R5-LL-P31 to R3-SS-P16 |
5 meters |
|
R5 LL to Rack 4 |
R5-LL-P33 to R4-SS-P19 |
5 meters |
|
R5 LL within Rack 5 |
R5-LL-P30 to R5-SS-P15 R5-LL-P32 to R5-SS-P19 |
3 meters |
|
R5 LL to Rack 6 |
R5-LL-P5 to R6-SS-P9 R5-LL-P4 to R6-SS-P15 |
5 meters |
The following table describes the cable connections for the sixth spine switch (R6-SS) when cabling six full racks together:
Table 21-20 Leaf Switch Connections for the Sixth Rack in a Six-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R6 UL to Rack 1 |
R6-UL-P5 to R1-SS-P9 R6-UL-P7 to R1-SS-P16 |
10 meters |
|
R6 UL to Rack 2 |
R6-UL-P4 to R2-SS-P16 |
10 meters |
|
R6 UL to Rack 3 |
R6-UL-P6 to R3-SS-P19 |
10 meters |
|
R6 UL to Rack 4 |
R6-UL-P31 to R4-SS-P15 |
5 meters |
|
R6 UL to Rack 5 |
R6-UL-P33 to R5-SS-P18 |
5 meters |
|
R6 UL within Rack 6 |
R6-UL-P30 to R6-SS-P16 R6-UL-P32 to R6-SS-P18 |
3 meters |
|
R6 LL to Rack 1 |
R6-LL-P5 to R1-SS-P12 R6-LL-P7 to R1-SS-P15 |
10 meters |
|
R6 LL to Rack 2 |
R6-LL-P4 to R2-SS-P12 R6-LL-P6 to R2-SS-P19 |
10 meters |
|
R6 LL to Rack 3 |
R6-LL-P31 to R3-SS-P7 |
10 meters |
|
R6 LL to Rack 4 |
R6-LL-P33 to R4-SS-P9 |
5 meters |
|
R6 LL to Rack 5 |
R6-LL-P30 to R5-SS-P8 |
5 meters |
|
R6 LL within Rack 6 |
R6-LL-P32 to R6-SS-P8 |
3 meters |
Seven-Rack Cabling for X8M Racks
This section provides the cabling tables to connect seven (7) X8M racks together, all of which use RoCE Network Fabric.
Note:
The following conventions were used in the cabling notation for connecting multiple racks together.
-
The spine switch (also referred to as SS) is in U1 for all racks.
-
The leaf switches are referred to as Lower Leaf (LL) and Upper Leaf (UL).
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in Recovery Appliance X8M-2 or Storage Expansion Rack X8M-2
-
At rack unit 21 (U21) and rack unit 23 (U23) in Recovery Appliance X8M-8
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X8M-8 systems with three database servers and 11 storage servers only, you must adjust the following multi-rack cabling information. On such systems only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, in the following tables, any connection to port number 30 on any leaf switch must instead connect to port number 34 on the same leaf switch. For example, R1-UL-P30 must change to R1-UL-P34, R1-LL-P30 must change to R1-LL-P34, and so on. These changes only apply to X8M-8 systems with three database servers and 11 storage servers.
The following diagrams show the cable connections for the 7 spine switches when cabling seven racks together:
The following table describes the cable connections for the first spine switch (R1-SS) when cabling seven racks together:
Table 21-21 Leaf Switch Connections for the First Rack in a Seven-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R1 UL within Rack 1 |
R1-UL-P5 to R1-SS-P5 R1-UL-P7 to R1-SS-P7 |
3 meters |
|
R1 UL to Rack 2 |
R1-UL-P31 to R2-SS-P5 |
5 meters |
|
R1 UL to Rack 3 |
R1-UL-P6 to R3-SS-P5 |
5 meters |
|
R1 UL to Rack 4 |
R1-UL-P4 to R4-SS-P5 |
10 meters |
|
R1 UL to Rack 5 |
R1-UL-P30 to R5-SS-P5 |
10 meters |
|
R1 UL to Rack 6 |
R1-UL-P32 to R6-SS-P5 |
10 meters |
|
R1 UL to Rack 7 |
R1-UL-P33 to R7-SS-P5 |
10 meters |
|
R1 LL within Rack 1 |
R1-LL-P5 to R1-SS-P13 |
3 meters |
|
R1 LL to Rack 2 |
R1-LL-P31 to R2-SS-P13 R1-LL-P33 to R2-SS-P15 |
5 meters |
|
R1 LL to Rack 3 |
R1-LL-P4 to R3-SS-P13 |
5 meters |
|
R1 LL to Rack 4 |
R1-LL-P30 to R4-SS-P13 |
10 meters |
|
R1 LL to Rack 5 |
R1-LL-P7 to R5-SS-P13 |
10 meters |
|
R1 LL to Rack 6 |
R1-LL-P32 to R6-SS-P13 |
10 meters |
|
R1 LL to Rack 7 |
R1-LL-P6 to R7-SS-P13 |
10 meters |
The following table describes the cable connections for the second spine switch (R2-SS) when cabling seven full racks together:
Table 21-22 Leaf Switch Connections for the Second Rack in a Seven-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R2 UL to Rack 1 |
R2-UL-P5 to R1-SS-P6 |
5 meters |
|
R2 UL within Rack 2 |
R2-UL-P31 to R2-SS-P6 |
3 meters |
|
R2 UL to Rack 3 |
R2-UL-P6 to R3-SS-P6 R2-UL-P30 to R3-SS-P8 |
5 meters |
|
R2 UL to Rack 4 |
R2-UL-P4 to R4-SS-P6 |
5 meters |
|
R2 UL to Rack 5 |
R2-UL-P7 to R5-SS-P6 |
10 meters |
|
R2 UL to Rack 6 |
R2-UL-P33 to R6-SS-P6 |
10 meters |
|
R2 UL to Rack 7 |
R2-UL-P32 to R7-SS-P6 |
10 meters |
|
R2 LL to Rack 1 |
R2-LL-P5 to R1-SS-P14 |
5 meters |
|
R2 LL within Rack 2 |
R2-LL-P31 to R2-SS-P14 |
3 meters |
|
R2 LL to Rack 3 |
R2-LL-P6 to R3-SS-P14 |
5 meters |
|
R2 LL to Rack 4 |
R2-LL-P4 to R4-SS-P14 R2-LL-P30 to R4-SS-P16 |
5 meters |
|
R2 LL to Rack 5 |
R2-LL-P33 to R5-SS-P14 |
10 meters |
|
R2 LL to Rack 6 |
R2-LL-P7 to R6-SS-P14 |
10 meters |
|
R2 LL to Rack 7 |
R2-LL-P32 to R7-SS-P14 |
10 meters |
The following table describes the cable connections for the third spine switch (R3-SS) when cabling seven full racks together:
Table 21-23 Leaf Switch Connections for the Third Rack in a Seven-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R3 UL to Rack 1 |
R3-UL-P5 to R1-SS-P11 |
5 meters |
|
R3 UL to Rack 2 |
R3-UL-P6 to R2-SS-P11 |
5 meters |
|
R3 UL within Rack 3 |
R3-UL-P30 to R3-SS-P11 |
3 meters |
|
R3 UL to Rack 4 |
R3-UL-P4 to R4-SS-P11 |
5 meters |
|
R3 UL to Rack 5 |
R3-UL-P32 to R5-SS-P11 R3-UL-P33 to R5-SS-P12 |
5 meters |
|
R3 UL to Rack 6 |
R3-UL-P7 to R6-SS-P11 |
10 meters |
|
R3 UL to Rack 7 |
R3-UL-P31 to R7-SS-P11 |
10 meters |
|
R3 LL to Rack 1 |
R3-LL-P4 to R1-SS-P20 |
5 meters |
|
R3 LL to Rack 2 |
R3-LL-P31 to R2-SS-P20 |
5 meters |
|
R3 LL within Rack 3 |
R3-LL-P32 to R3-SS-P20 |
3 meters |
|
R3 LL to Rack 4 |
R3-LL-P33 to R4-SS-P20 |
5 meters |
|
R3 LL to Rack 5 |
R3-LL-P5 to R5-SS-P20 |
5 meters |
|
R3 LL to Rack 6 |
R3-LL-P6 to R6-SS-P19 R3-LL-P30 to R6-SS-P20 |
10 meters |
|
R3 LL to Rack 7 |
R3-LL-P7 to R7-SS-P20 |
10 meters |
The following table describes the cable connections for the fourth spine switch (R4-SS) when cabling seven full racks together:
Table 21-24 Leaf Switch Connections for the Fourth Rack in a Seven-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R4 UL to Rack 1 |
R4-UL-P7 to R1-SS-P10 |
10 meters |
|
R4 UL to Rack 2 |
R4-UL-P4 to R2-SS-P9 R4-UL-P6 to R2-SS-P10 |
5 meters |
|
R4 UL to Rack 3 |
R4-UL-P33 to R3-SS-P10 |
5 meters |
|
R4 UL within Rack 4 |
R4-UL-P32 to R4-SS-P10 |
3 meters |
|
R4 UL to Rack 5 |
R4-UL-P5 to R5-SS-P10 |
5 meters |
|
R4 UL to Rack 6 |
R4-UL-P30 to R6-SS-P10 |
5 meters |
|
R4 UL to Rack 7 |
R4-UL-P31 to R7-SS-P10 |
10 meters |
|
R4 LL to Rack 1 |
R4-LL-P5 to R1-SS-P17 |
10 meters |
|
R4 LL to Rack 2 |
R4-LL-P4 to R2-SS-P17 |
5 meters |
|
R4 LL to Rack 3 |
R4-LL-P31 to R3-SS-P17 R4-LL-P33 to R3-SS-P18 |
5 meters |
|
R4 LL within Rack 4 |
R4-LL-P30 to R4-SS-P17 |
3 meters |
|
R4 LL to Rack 5 |
R4-LL-P7 to R5-SS-P17 |
5 meters |
|
R4 LL to Rack 6 |
R4-LL-P6 to R6-SS-P17 |
5 meters |
|
R4 LL to Rack 7 |
R4-LL-P32 to R7-SS-P17 |
10 meters |
The following table describes the cable connections for the fifth spine switch (R5-SS) when cabling seven full racks together:
Table 21-25 Leaf Switch Connections for the Fifth Rack in a Seven-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R5 UL to Rack 1 |
R5-UL-P5 to R1-SS-P8 |
10 meters |
|
R5 UL to Rack 2 |
R5-UL-P4 to R2-SS-P8 |
10 meters |
|
R5 UL to Rack 3 |
R5-UL-P6 to R3-SS-P12 |
5 meters |
|
R5 UL to Rack 4 |
R5-UL-P31 to R4-SS-P7 R5-UL-P33 to R4-SS-P12 |
5 meters |
|
R5 UL within Rack 5 |
R5-UL-P30 to R5-SS-P7 |
3 meters |
|
R5 UL to Rack 6 |
R5-UL-P7 to R6-SS-P7 |
5 meters |
|
R5 UL to Rack 7 |
R5-UL-P32 to R7-SS-P7 |
5 meters |
|
R5 LL to Rack 1 |
R5-LL-P7 to R1-SS-P18 |
10 meters |
|
R5 LL to Rack 2 |
R5-LL-P6 to R2-SS-P18 |
10 meters |
|
R5 LL to Rack 3 |
R5-LL-P31 to R3-SS-P16 |
5 meters |
|
R5 LL to Rack 4 |
R5-LL-P33 to R4-SS-P19 |
5 meters |
|
R5 LL within Rack 5 |
R5-LL-P30 to R5-SS-P15 R5-LL-P32 to R5-SS-P19 |
3 meters |
|
R5 LL to Rack 6 |
R5-LL-P4 to R6-SS-P15 |
5 meters |
|
R5 LL to Rack 7 |
R5-LL-P5 to R7-SS-P15 |
5 meters |
The following table describes the cable connections for the sixth spine switch (R6-SS) when cabling seven full racks together:
Table 21-26 Leaf Switch Connections for the Sixth Rack in a Seven-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R6 UL to Rack 1 |
R6-UL-P7 to R1-SS-P16 |
10 meters |
|
R6 UL to Rack 2 |
R6-UL-P4 to R2-SS-P16 |
10 meters |
|
R6 UL to Rack 3 |
R6-UL-P6 to R3-SS-P19 |
10 meters |
|
R6 UL to Rack 4 |
R6-UL-P31 to R4-SS-P15 |
5 meters |
|
R6 UL to Rack 5 |
R6-UL-P33 to R5-SS-P18 |
5 meters |
|
R6 UL within Rack 6 |
R6-UL-P30 to R6-SS-P16 R6-UL-P32 to R6-SS-P18 |
3 meters |
|
R6 UL to Rack 7 |
R6-UL-P5 to R7-SS-P16 |
5 meters |
|
R6 LL to Rack 1 |
R6-LL-P5 to R1-SS-P12 R6-LL-P7 to R1-SS-P15 |
10 meters |
|
R6 LL to Rack 2 |
R6-LL-P4 to R2-SS-P12 |
10 meters |
|
R6 LL to Rack 3 |
R6-LL-P31 to R3-SS-P7 |
10 meters |
|
R6 LL to Rack 4 |
R6-LL-P33 to R4-SS-P9 |
5 meters |
|
R6 LL to Rack 5 |
R6-LL-P30 to R5-SS-P8 |
5 meters |
|
R6 LL within Rack 6 |
R6-LL-P32 to R6-SS-P8 |
3 meters |
|
R6 LL to Rack 7 |
R6-LL-P6 to R7-SS-P8 |
5 meters |
The following table describes the cable connections for the seventh spine switch (R7-SS) when cabling seven full racks together:
Table 21-27 Leaf Switch Connections for the Seventh Rack in a Seven-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R7 UL to Rack 1 |
R7-UL-P5 to R1-SS-P9 |
10 meters |
|
R7 UL to Rack 2 |
R7-UL-P7 to R2-SS-P7 |
10 meters |
|
R7 UL to Rack 3 |
R7-UL-P4 to R3-SS-P9 |
10 meters |
|
R7 UL to Rack 4 |
R7-UL-P6 to R4-SS-P8 |
10 meters |
|
R7 UL to Rack 5 |
R7-UL-P31 to R5-SS-P9 |
5 meters |
|
R7 UL to Rack 6 |
R7-UL-P33 to R6-SS-P9 |
5 meters |
|
R7 UL within Rack 7 |
R7-UL-P30 to R7-SS-P9 R7-UL-P32 to R7-SS-P12 |
3 meters |
|
R7 LL to Rack 1 |
R7-LL-P5 to R1-SS-P19 |
10 meters |
|
R7 LL to Rack 2 |
R7-LL-P7 to R2-SS-P19 |
10 meters |
|
R7 LL to Rack 3 |
R7-LL-P4 to R3-SS-P15 |
10 meters |
|
R7 LL to Rack 4 |
R7-LL-P6 to R4-SS-P18 |
10 meters |
|
R7 LL to Rack 5 |
R7-LL-P31 to R5-SS-P16 |
5 meters |
|
R7 LL to Rack 6 |
R7-LL-P33 to R6-SS-P12 |
5 meters |
|
R7 LL within Rack 7 |
R7-LL-P30 to R7-SS-P18 R7-LL-P32 to R7-SS-P19 |
3 meters |
Eight-Rack Cabling for X8M Racks
This section provides the cabling tables to connect eight (8) X8M racks together, all of which use RoCE Network Fabric.
Note:
The following conventions were used in the cabling notation for connecting multiple racks together.
-
The spine switch (also referred to as SS) is in U1 for all racks.
-
The leaf switches are referred to as Lower Leaf (LL) and Upper Leaf (UL).
-
The leaf switches are located as follows:
-
At rack unit 20 (U20) and 22 (U22) in Recovery Appliance X8M-2 or Storage Expansion Rack X8M-2
-
At rack unit 21 (U21) and rack unit 23 (U23) in Recovery Appliance X8M-8
-
-
The cable lengths shown in the following lists assume that the racks are adjacent to each other, the cables are routed through a raised floor, and there are no obstacles in the routing between the racks. If the racks are not adjacent, or use overhead cabling trays, then they may require longer cable lengths. Cable lengths up to 100 meters are supported.
-
Only optical cables (with additional transceivers) are supported for lengths greater than 5 meters.
-
For X8M-8 systems with three database servers and 11 storage servers only, you must adjust the following multi-rack cabling information. On such systems only, port 30 on the leaf switches is connected to a database server and is not used as an inter-switch link. Consequently, in the following tables, any connection to port number 30 on any leaf switch must instead connect to port number 34 on the same leaf switch. For example, R1-UL-P30 must change to R1-UL-P34, R1-LL-P30 must change to R1-LL-P34, and so on. These changes only apply to X8M-8 systems with three database servers and 11 storage servers.
The following diagrams show the cable connections for the 8 spine switches when cabling eight racks together:
The following table describes the cable connections for the first spine switch (R1-SS) when cabling eight racks together:
Table 21-28 Leaf Switch Connections for the First Rack in a Eight-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R1 UL within Rack 1 |
R1-UL-P5 to R1-SS-P5 |
3 meters |
|
R1 UL to Rack 2 |
R1-UL-P31 to R2-SS-P5 |
5 meters |
|
R1 UL to Rack 3 |
R1-UL-P6 to R3-SS-P5 |
5 meters |
|
R1 UL to Rack 4 |
R1-UL-P4 to R4-SS-P5 |
10 meters |
|
R1 UL to Rack 5 |
R1-UL-P30 to R5-SS-P5 |
10 meters |
|
R1 UL to Rack 6 |
R1-UL-P32 to R6-SS-P5 |
10 meters |
|
R1 UL to Rack 7 |
R1-UL-P33 to R7-SS-P5 |
10 meters |
|
R1 UL to Rack 8 |
R1-UL-P7 to R8-SS-P5 |
10 meters |
|
R1 LL within Rack 1 |
R1-LL-P5 to R1-SS-P13 |
3 meters |
|
R1 LL to Rack 2 |
R1-LL-P31 to R2-SS-P13 |
5 meters |
|
R1 LL to Rack 3 |
R1-LL-P4 to R3-SS-P13 |
5 meters |
|
R1 LL to Rack 4 |
R1-LL-P30 to R4-SS-P13 |
10 meters |
|
R1 LL to Rack 5 |
R1-LL-P7 to R5-SS-P13 |
10 meters |
|
R1 LL to Rack 6 |
R1-LL-P32 to R6-SS-P13 |
10 meters |
|
R1 LL to Rack 7 |
R1-LL-P6 to R7-SS-P13 |
10 meters |
|
R1 LL to Rack 8 |
R1-LL-P33 to R8-SS-P13 |
10 meters |
The following table describes the cable connections for the second spine switch (R2-SS) when cabling eight full racks together:
Table 21-29 Leaf Switch Connections for the Second Rack in a Eight-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R2 UL to Rack 1 |
R2-UL-P5 to R1-SS-P6 |
5 meters |
|
R2 UL within Rack 2 |
R2-UL-P31 to R2-SS-P6 |
3 meters |
|
R2 UL to Rack 3 |
R2-UL-P6 to R3-SS-P6 |
5 meters |
|
R2 UL to Rack 4 |
R2-UL-P4 to R4-SS-P6 |
5 meters |
|
R2 UL to Rack 5 |
R2-UL-P7 to R5-SS-P6 |
10 meters |
|
R2 UL to Rack 6 |
R2-UL-P33 to R6-SS-P6 |
10 meters |
|
R2 UL to Rack 7 |
R2-UL-P32 to R7-SS-P6 |
10 meters |
|
R2 UL to Rack 8 |
R2-UL-P30 to R8-SS-P6 |
10 meters |
|
R2 LL to Rack 1 |
R2-LL-P5 to R1-SS-P14 |
5 meters |
|
R2 LL within Rack 2 |
R2-LL-P31 to R2-SS-P14 |
3 meters |
|
R2 LL to Rack 3 |
R2-LL-P6 to R3-SS-P14 |
5 meters |
|
R2 LL to Rack 4 |
R2-LL-P4 to R4-SS-P14 |
5 meters |
|
R2 LL to Rack 5 |
R2-LL-P33 to R5-SS-P14 |
10 meters |
|
R2 LL to Rack 6 |
R2-LL-P7 to R6-SS-P14 |
10 meters |
|
R2 LL to Rack 7 |
R2-LL-P32 to R7-SS-P14 |
10 meters |
|
R2 LL to Rack 8 |
R2-LL-P30 to R8-SS-P14 |
10 meters |
The following table describes the cable connections for the third spine switch (R3-SS) when cabling eight full racks together:
Table 21-30 Leaf Switch Connections for the Third Rack in a Eight-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R3 UL to Rack 1 |
R3-UL-P5 to R1-SS-P11 |
5 meters |
|
R3 UL to Rack 2 |
R3-UL-P6 to R2-SS-P11 |
5 meters |
|
R3 UL within Rack 3 |
R3-UL-P30 to R3-SS-P11 |
3 meters |
|
R3 UL to Rack 4 |
R3-UL-P4 to R4-SS-P11 |
5 meters |
|
R3 UL to Rack 5 |
R3-UL-P32 to R5-SS-P11 |
5 meters |
|
R3 UL to Rack 6 |
R3-UL-P7 to R6-SS-P11 |
10 meters |
|
R3 UL to Rack 7 |
R3-UL-P31 to R7-SS-P11 |
10 meters |
|
R3 UL to Rack 8 |
R3-UL-P33 to R8-SS-P11 |
10 meters |
|
R3 LL to Rack 1 |
R3-LL-P4 to R1-SS-P20 |
5 meters |
|
R3 LL to Rack 2 |
R3-LL-P31 to R2-SS-P20 |
5 meters |
|
R3 LL within Rack 3 |
R3-LL-P32 to R3-SS-P20 |
3 meters |
|
R3 LL to Rack 4 |
R3-LL-P33 to R4-SS-P20 |
5 meters |
|
R3 LL to Rack 5 |
R3-LL-P5 to R5-SS-P20 |
5 meters |
|
R3 LL to Rack 6 |
R3-LL-P30 to R6-SS-P20 |
10 meters |
|
R3 LL to Rack 7 |
R3-LL-P7 to R7-SS-P20 |
10 meters |
|
R3 LL to Rack 8 |
R3-LL-P6 to R8-SS-P20 |
10 meters |
The following table describes the cable connections for the fourth spine switch (R4-SS) when cabling eight full racks together:
Table 21-31 Leaf Switch Connections for the Fourth Rack in a Eight-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R4 UL to Rack 1 |
R4-UL-P7 to R1-SS-P10 |
10 meters |
|
R4 UL to Rack 2 |
R4-UL-P6 to R2-SS-P10 |
5 meters |
|
R4 UL to Rack 3 |
R4-UL-P33 to R3-SS-P10 |
5 meters |
|
R4 UL within Rack 4 |
R4-UL-P32 to R4-SS-P10 |
3 meters |
|
R4 UL to Rack 5 |
R4-UL-P5 to R5-SS-P10 |
5 meters |
|
R4 UL to Rack 6 |
R4-UL-P30 to R6-SS-P10 |
5 meters |
|
R4 UL to Rack 7 |
R4-UL-P31 to R7-SS-P10 |
10 meters |
|
R4 UL to Rack 8 |
R4-UL-P4 to R8-SS-P10 |
10 meters |
|
R4 LL to Rack 1 |
R4-LL-P5 to R1-SS-P17 |
10 meters |
|
R4 LL to Rack 2 |
R4-LL-P4 to R2-SS-P17 |
5 meters |
|
R4 LL to Rack 3 |
R4-LL-P31 to R3-SS-P17 |
5 meters |
|
R4 LL within Rack 4 |
R4-LL-P30 to R4-SS-P17 |
3 meters |
|
R4 LL to Rack 5 |
R4-LL-P7 to R5-SS-P17 |
5 meters |
|
R4 LL to Rack 6 |
R4-LL-P6 to R6-SS-P17 |
5 meters |
|
R4 LL to Rack 7 |
R4-LL-P32 to R7-SS-P17 |
10 meters |
|
R4 LL to Rack 8 |
R4-LL-P33 to R8-SS-P17 |
10 meters |
The following table describes the cable connections for the fifth spine switch (R5-SS) when cabling eight full racks together:
Table 21-32 Leaf Switch Connections for the Fifth Rack in a Eight-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R5 UL to Rack 1 |
R5-UL-P5 to R1-SS-P8 |
10 meters |
|
R5 UL to Rack 2 |
R5-UL-P4 to R2-SS-P8 |
10 meters |
|
R5 UL to Rack 3 |
R5-UL-P6 to R3-SS-P8 |
5 meters |
|
R5 UL to Rack 4 |
R5-UL-P33 to R4-SS-P12 |
5 meters |
|
R5 UL within Rack 5 |
R5-UL-P30 to R5-SS-P7 |
3 meters |
|
R5 UL to Rack 6 |
R5-UL-P7 to R6-SS-P7 |
5 meters |
|
R5 UL to Rack 7 |
R5-UL-P32 to R7-SS-P7 |
5 meters |
|
R5 UL to Rack 8 |
R5-UL-P31 to R8-SS-P7 |
10 meters |
|
R5 LL to Rack 1 |
R5-LL-P7 to R1-SS-P18 |
10 meters |
|
R5 LL to Rack 2 |
R5-LL-P6 to R2-SS-P18 |
10 meters |
|
R5 LL to Rack 3 |
R5-LL-P31 to R3-SS-P16 |
5 meters |
|
R5 LL to Rack 4 |
R5-LL-P33 to R4-SS-P19 |
5 meters |
|
R5 LL within Rack 5 |
R5-LL-P30 to R5-SS-P15 |
3 meters |
|
R5 LL to Rack 6 |
R5-LL-P4 to R6-SS-P15 |
5 meters |
|
R5 LL to Rack 7 |
R5-LL-P5 to R7-SS-P15 |
5 meters |
|
R5 LL to Rack 8 |
R5-LL-P32 to R8-SS-P15 |
10 meters |
The following table describes the cable connections for the sixth spine switch (R6-SS) when cabling eight full racks together:
Table 21-33 Leaf Switch Connections for the Sixth Rack in a Eight-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R6 UL to Rack 1 |
R6-UL-P7 to R1-SS-P16 |
10 meters |
|
R6 UL to Rack 2 |
R6-UL-P4 to R2-SS-P16 |
10 meters |
|
R6 UL to Rack 3 |
R6-UL-P6 to R3-SS-P19 |
10 meters |
|
R6 UL to Rack 4 |
R6-UL-P31 to R4-SS-P15 |
5 meters |
|
R6 UL to Rack 5 |
R6-UL-P33 to R5-SS-P18 |
5 meters |
|
R6 UL within Rack 6 |
R6-UL-P30 to R6-SS-P16 |
3 meters |
|
R6 UL to Rack 7 |
R6-UL-P5 to R7-SS-P16 |
5 meters |
|
R6 UL to Rack 8 |
R6-UL-P32 to R8-SS-P16 |
5 meters |
|
R6 LL to Rack 1 |
R6-LL-P5 to R1-SS-P12 |
10 meters |
|
R6 LL to Rack 2 |
R6-UL-P4 to R2-SS-P12 |
10 meters |
|
R6 LL to Rack 3 |
R6-LL-P31 to R3-SS-P7 |
10 meters |
|
R6 LL to Rack 4 |
R6-LL-P33 to R4-SS-P9 |
5 meters |
|
R6 LL to Rack 5 |
R6-LL-P30 to R5-SS-P8 |
5 meters |
|
R6 LL within Rack 6 |
R6-LL-P32 to R6-SS-P8 |
3 meters |
|
R6 LL to Rack 7 |
R6-LL-P6 to R7-SS-P8 |
5 meters |
|
R6 LL to Rack 8 |
R6-LL-P7 to R8-SS-P8 |
5 meters |
The following table describes the cable connections for the seventh spine switch (R7-SS) when cabling eight full racks together:
Table 21-34 Leaf Switch Connections for the Seventh Rack in a Eight-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R7 UL to Rack 1 |
R7-UL-P5 to R1-SS-P9 |
10 meters |
|
R7 UL to Rack 2 |
R7-UL-P7 to R2-SS-P7 |
10 meters |
|
R7 UL to Rack 3 |
R7-UL-P4 to R3-SS-P9 |
10 meters |
|
R7 UL to Rack 4 |
R7-UL-P6 to R4-SS-P8 |
10 meters |
|
R7 UL to Rack 5 |
R7-UL-P31 to R5-SS-P9 |
5 meters |
|
R7 UL to Rack 6 |
R7-UL-P33 to R6-SS-P9 |
5 meters |
|
R7 UL within Rack 7 |
R7-UL-P30 to R7-SS-P9 |
3 meters |
|
R7 UL to Rack 8 |
R7-UL-P32 to R8-SS-P9 |
5 meters |
|
R7 LL to Rack 1 |
R7-LL-P5 to R1-SS-P19 |
10 meters |
|
R7 LL to Rack 2 |
R7-LL-P7 to R2-SS-P19 |
10 meters |
|
R7 LL to Rack 3 |
R7-LL-P4 to R3-SS-P15 |
10 meters |
|
R7 LL to Rack 4 |
R7-LL-P6 to R4-SS-P18 |
10 meters |
|
R7 LL to Rack 5 |
R7-LL-P31 to R5-SS-P16 |
5 meters |
|
R7 LL to Rack 6 |
R7-LL-P33 to R6-SS-P18 |
5 meters |
|
R7 LL within Rack 7 |
R7-LL-P30 to R7-SS-P18 |
3 meters |
|
R7 LL to Rack 8 |
R7-LL-P32 to R8-SS-P12 |
5 meters |
The following table describes the cable connections for the eighth spine switch (R8-SS) when cabling eight full racks together:
Table 21-35 Leaf Switch Connections for the Eighth Rack in a Eight-Rack System
| Leaf Switch | Connection | Cable Length |
|---|---|---|
|
R8 UL to Rack 1 |
R8-UL-P5 to R1-SS-P15 |
10 meters |
|
R8 UL to Rack 2 |
R8-UL-P7 to R2-SS-P15 |
10 meters |
|
R8 UL to Rack 3 |
R8-UL-P4 to R3-SS-P18 |
10 meters |
|
R8 UL to Rack 4 |
R8-UL-P6 to R4-SS-P16 |
10 meters |
|
R8 UL to Rack 5 |
R8-UL-P31 to R5-SS-P19 |
10 meters |
|
R8 UL to Rack 6 |
R8-UL-P33 to R6-SS-P19 |
5 meters |
|
R8 UL to Rack 7 |
R8-UL-P30 to R7-SS-P19 |
5 meters |
|
R8 UL within Rack 8 |
R8-UL-P32 to R8-SS-P19 |
3 meters |
|
R8 LL to Rack 1 |
R8-LL-P5 to R1-SS-P7 |
10 meters |
|
R8 LL to Rack 2 |
R8-LL-P7 to R2-SS-P9 |
10 meters |
|
R8 LL to Rack 3 |
R8-LL-P4 to R3-SS-P12 |
10 meters |
|
R8 LL to Rack 4 |
R8-LL-P6 to R4-SS-P7 |
10 meters |
|
R8 LL to Rack 5 |
R8-LL-P31 to R5-SS-P12 |
10 meters |
|
R8 LL to Rack 6 |
R8-LL-P33 to R6-SS-P12 |
5 meters |
|
R8 LL to Rack 7 |
R8-LL-P30 to R7-SS-P12 |
5 meters |
|
R8 LL within Rack 8 |
R8-LL-P32 to R8-SS-P18 |
3 meters |