18.6 InfiniBand Network Cabling Tables

This topic contains the tables for the InfiniBand network cabling for Oracle Exadata Database Machine X4 racks.

In Oracle Exadata Database Machine X4-2, the Sun Datacenter InfiniBand Switch 36 switches are located in rack slots 20 and 22. In Oracle Exadata Database Machine X4-8, the Sun Datacenter InfiniBand Switch 36 switches are located in rack units 21 and 23. If present, the optional spine switch is located in rack unit 1.

The following tables are in this section:

  • Table 18-17 InfiniBand Network Cabling for Oracle Exadata Database Machine X4-2 Full Rack

  • Table 18-18 InfiniBand Network Cabling for Oracle Exadata Database Machine X4-2 Half Rack

  • Table 18-19 InfiniBand Network Cabling for Oracle Exadata Database Machine X4-2 Quarter Rack and Oracle Exadata Database Machine X4-2 Eighth Rack

  • Table 18-20 InfiniBand Network Cabling for Oracle Exadata Database Machine X4-8 Full Rack

The following table lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X4-2 Full Rack.

Table 18-17 InfiniBand Network Cabling for Oracle Exadata Database Machine X4-2 Full Rack

From InfiniBand Switch Rack Unit Port To Rack Unit Type of Equipment Port Cable Description

U22

0A

U39

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U22

0B

U37

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U22

1A

U35

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U22

1B

U33

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U22

2A

U31

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U22

2B

U29

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U22

3B

U27

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U22

3A

U26

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U22

4A

U25

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U22

4B

U24

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U22

5A

U23

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U22

12B

U19

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U22

13A

U18

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U22

13B

U17

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U22

14B

U16

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U22

14A

U14

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

15A

U12

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

15B

U10

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

16A

U8

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

16B

U6

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

17A

U4

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

17B

U2

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U20

0A

U39

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U20

0B

U37

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U20

1A

U35

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U20

1B

U33

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U20

2A

U31

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U20

2B

U29

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U20

3B

U27

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U20

3A

U26

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U20

4A

U25

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U20

4B

U24

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U20

5A

U23

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U20

12B

U19

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

13A

U18

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

13B

U17

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

14B

U16

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

14A

U14

Oracle Exadata Storage Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

15A

U12

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

15B

U10

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

16A

U8

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

16B

U6

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

17A

U4

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

17B

U2

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

9B

U22

Sun Datacenter InfiniBand Switch 36 switch

9A

1 meter QDR InfiniBand cable

U20

10B

U22

Sun Datacenter InfiniBand Switch 36 switch

10A

1 meter QDR InfiniBand cable

U20

11B

U22

Sun Datacenter InfiniBand Switch 36 switch

11A

1 meter QDR InfiniBand cable

U20

8A

U22

Sun Datacenter InfiniBand Switch 36 switch

8A

1 meter QDR InfiniBand cable

U20

9A

U22

Sun Datacenter InfiniBand Switch 36 switch

9B

1 meter QDR InfiniBand cable

U20

10A

U22

Sun Datacenter InfiniBand Switch 36 switch

10B

1 meter QDR InfiniBand cable

U20

11A

U22

Sun Datacenter InfiniBand Switch 36 switch

11B

1 meter QDR InfiniBand cable

U1 — when added as an optional configuration

1B

U20

Sun Datacenter InfiniBand Switch 36 switch

8B

3 meter QDR InfiniBand cable

U1 — when added as an optional configuration

0B

U22

Sun Datacenter InfiniBand Switch 36 switch

8B

3 meter QDR InfiniBand cable

The following table lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X4-2 Half Rack.

Table 18-18 InfiniBand Network Cabling for Oracle Exadata Database Machine X4-2 Half Rack

From InfiniBand Switch Rack Unit Port To Rack Unit Type of Equipment Port Cable Description

U22

12B

U19

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U22

13A

U18

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U22

13B

U17

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U22

14B

U16

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U22

14A

U14

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

15A

U12

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

15B

U10

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

16A

U8

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

16B

U6

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

17A

U4

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

17B

U2

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U20

12B

U19

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

13A

U18

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

13B

U17

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

14B

U16

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

14A

U14

Oracle Exadata Storage Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

15A

U12

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

15B

U10

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

16A

U8

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

16B

U6

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

17A

U4

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

17B

U2

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

9B

U22

Sun Datacenter InfiniBand Switch 36 switch

9A

1 meter QDR InfiniBand cable

U20

10B

U22

Sun Datacenter InfiniBand Switch 36 switch

10A

1 meter QDR InfiniBand cable

U20

11B

U22

Sun Datacenter InfiniBand Switch 36 switch

11A

1 meter QDR InfiniBand cable

U20

8A

U22

Sun Datacenter InfiniBand Switch 36 switch

8A

1 meter QDR InfiniBand cable

U20

9A

U22

Sun Datacenter InfiniBand Switch 36 switch

9B

1 meter QDR InfiniBand cable

U20

10A

U22

Sun Datacenter InfiniBand Switch 36 switch

10B

1 meter QDR InfiniBand cable

U20

11A

U22

Sun Datacenter InfiniBand Switch 36 switch

11B

1 meter QDR InfiniBand cable

U1 — when added as an optional configuration

1B

U20

Sun Datacenter InfiniBand Switch 36 switch

8B

3 meter QDR InfiniBand cable

U1 — when added as an optional configuration

0B

U22

Sun Datacenter InfiniBand Switch 36 switch

8B

3 meter QDR InfiniBand cable

The following table lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X4-2 Quarter Rack and Oracle Exadata Database Machine X4-2 Eighth Rack.

Note:

The same rules and restrictions apply to Oracle Exadata Database Machine X4-2 Eighth Rack as for Oracle Exadata Database Machine X4-2 Quarter Rack.

Table 18-19 InfiniBand Network Cabling for Oracle Exadata Database Machine X4-2 Quarter Rack and Oracle Exadata Database Machine X4-2 Eighth Rack

From InfiniBand Switch Rack Unit Port To Rack Unit Type of Equipment Port Cable Description

U22

13B

U17

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U22

14B

U16

Oracle Exadata Database Server

PCIe 3, P2

2 meter QDR InfiniBand cable

U22

16B

U6

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

17A

U4

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U22

17B

U2

Oracle Exadata Storage Server

PCIe 3, P2

3 meter QDR InfiniBand cable

U20

13B

U17

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

14B

U16

Oracle Exadata Database Server

PCIe 3, P1

2 meter QDR InfiniBand cable

U20

16B

U6

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

17A

U4

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

17B

U2

Oracle Exadata Storage Server

PCIe 3, P1

3 meter QDR InfiniBand cable

U20

9B

U22

Sun Datacenter InfiniBand Switch 36 switch

9A

1 meter QDR InfiniBand cable

U20

10B

U22

Sun Datacenter InfiniBand Switch 36 switch

10A

1 meter QDR InfiniBand cable

U20

11B

U22

Sun Datacenter InfiniBand Switch 36 switch

11A

1 meter QDR InfiniBand cable

U20

8A

U22

Sun Datacenter InfiniBand Switch 36 switch

8A

1 meter QDR InfiniBand cable

U20

9A

U22

Sun Datacenter InfiniBand Switch 36 switch

9B

1 meter QDR InfiniBand cable

U20

10A

U22

Sun Datacenter InfiniBand Switch 36 switch

10B

1 meter QDR InfiniBand cable

U20

11A

U22

Sun Datacenter InfiniBand Switch 36 switch

11B

1 meter QDR InfiniBand cable

U1 — when added as an optional configuration

1B

U20

Sun Datacenter InfiniBand Switch 36 switch

8B

3 meter QDR InfiniBand cable

U1 — when added as an optional configuration

0B

U22

Sun Datacenter InfiniBand Switch 36 switch

8B

3 meter QDR InfiniBand cable

The following table lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X4-8 Full Rack.

Table 18-20 InfiniBand Network Cabling for Oracle Exadata Database Machine X4-8 Full Rack

From InfiniBand Switch Rack Unit Port To Rack Unit Type of Equipment Port Cable Description

U23

0A

U41

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U23

0B

U39

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U23

1A

U37

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U23

1B

U35

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U23

2A

U33

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U23

2B

U31

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U23

3B

U29

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U23

3A

U24

Oracle Exadata Database Server

12 PCIe3 P1

2 meter QDR InfiniBand cable

U23

4A

U24

Oracle Exadata Database Server

10 PCIe3 P1

2 meter QDR InfiniBand cable

U23

4B

U24

Oracle Exadata Database Server

8 PCIe3 P1

2 meter QDR InfiniBand cable

U23

5A

U24

Oracle Exadata Database Server

6 PCIe3 P1

2 meter QDR InfiniBand cable

U23

13A

U16

Oracle Exadata Database Server

10 PCIe3 P2

2 meter QDR InfiniBand cable

U23

13B

U16

Oracle Exadata Database Server

8 PCIe3 P2

2 meter QDR InfiniBand cable

U23

14B

U16

Oracle Exadata Database Server

6 PCIe3 P2

2 meter QDR InfiniBand cable

U23

12B

U16

Oracle Exadata Database Server

12 PCIe3 P2

2 meter QDR InfiniBand cable

U23

14A

U14

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U23

15A

U12

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U23

15B

U10

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U23

16A

U8

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U23

16B

U6

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U23

17A

U4

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U23

17B

U2

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U21

0A

U41

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U21

0B

U39

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U21

1A

U37

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U21

1B

U35

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U21

2A

U33

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U21

2B

U31

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U21

3B

U29

Oracle Exadata Storage Server

3 PCIe3 P2

3 meter QDR InfiniBand cable

U21

3A

U24

Oracle Exadata Database Server

12 PCIe3 P2

2 meter QDR InfiniBand cable

U21

4A

U24

Oracle Exadata Database Server

10 PCIe3 P2

2 meter QDR InfiniBand cable

U21

4B

U24

Oracle Exadata Database Server

8 PCIe3 P2

2 meter QDR InfiniBand cable

U21

5A

U24

Oracle Exadata Database Server

6 PCIe3 P2

2 meter QDR InfiniBand cable

U21

12B

U16

Oracle Exadata Database Server

12 PCIe3 P1

2 meter QDR InfiniBand cable

U21

13A

U16

Oracle Exadata Database Server

10 PCIe3 P1

2 meter QDR InfiniBand cable

U21

13B

U16

Oracle Exadata Database Server

8 PCIe3 P1

2 meter QDR InfiniBand cable

U21

14B

U16

Oracle Exadata Database Server

6 PCIe3 P1

2 meter QDR InfiniBand cable

U21

14A

U14

Oracle Exadata Storage Server

3 PCIe3 P1

2 meter QDR InfiniBand cable

U21

15A

U12

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U21

15B

U10

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U21

16A

U8

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U21

16B

U6

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U21

17A

U4

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U21

17B

U2

Oracle Exadata Storage Server

3 PCIe3 P1

3 meter QDR InfiniBand cable

U21

9B

U23

Sun Datacenter InfiniBand Switch 36 switch

9A

1 meter QDR InfiniBand cable

U21

10B

U23

Sun Datacenter InfiniBand Switch 36 switch

10A

1 meter QDR InfiniBand cable

U21

11B

U23

Sun Datacenter InfiniBand Switch 36 switch

11A

1 meter QDR InfiniBand cable

U21

8A

U23

Sun Datacenter InfiniBand Switch 36 switch

8A

1 meter QDR InfiniBand cable

U21

9A

U23

Sun Datacenter InfiniBand Switch 36 switch

9B

1 meter QDR InfiniBand cable

U21

10A

U23

Sun Datacenter InfiniBand Switch 36 switch

10B

1 meter QDR InfiniBand cable

U21

11A

U23

Sun Datacenter InfiniBand Switch 36 switch

11B

1 meter QDR InfiniBand cable

U1 — when added as an optional configuration

1B

U21

Sun Datacenter InfiniBand Switch 36 switch

8B

3 meter QDR InfiniBand cable

U1 — when added as an optional configuration

0B

U23

Sun Datacenter InfiniBand Switch 36 switch

8B

3 meter QDR InfiniBand cable