10 Elastic Configurations

Elastic configurations allow Oracle Exadata Racks to have customer-defined combinations of database servers and Exadata Storage Servers. For example, Oracle Exadata Database Machine X5-2 Elastic Configuration elastic configuration can have 0 to 22 database servers, 0 to 19 Exadata Storage Servers, or a combination of database servers and Exadata Storage Servers.

Note:

For ease of reading, the name "Oracle Exadata Rack" is used when information refers to both Oracle Exadata Database Machine and Oracle Exadata Storage Expansion Rack.

Oracle Exadata Configuration Assistant (OECA) for Exadata simplifies the elastic configuration process. OECA helps you to investigate and plan a variety of elastic configuration scenarios. To download the latest version of OECA, see http://www.oracle.com/technetwork/database/exadata/oeca-download-2817713.html.

10.1 Elastic Configurations Restrictions

The following sections provide additional details for elastic configurations:

10.1.1 Oracle Exadata Database Machine X7-2 and X7-8 Elastic Configuration Notes

To build an Oracle Exadata X7-2 or X7-8 system with a custom number of database and storage servers, use Oracle Exadata Configuration Assistant. OECA is available on Oracle Technology Network:

http://www.oracle.com/technetwork/database/exadata/oeca-download-2817713.html

Oracle Exadata Configuration Assistant (OECA) facilitates scoping and analyzing elastic configurations and reporting environmental specifications.

10.1.2 Oracle Exadata Database Machine X6-2 Elastic Configuration Notes

To build an Oracle Exadata X6-2 system with a custom number of database and storage servers, you start from an Oracle Exadata X6-2 quarter rack, and add database and storage servers as needed. The following table shows configuration data for an Oracle Exadata X6-2 quarter rack, and the additional capacity and processing power that you get by adding one database server or one storage server.

Table 10-1 Oracle Exadata Elastic Configuration for Oracle Exadata X6-2

Component X6-2 Quarter Rack Add 1 Database Server Add 1 Storage Server

Database Servers

2

1

n/a

Database Grid Cores

88

44

n/a

Database Grid Memory

512 GB (maximum 1536 GB)

256 GB (maximum 768 GB)

n/a

InfiniBand Switches

2

n/a

n/a

Management Ethernet Switch

1

n/a

n/a

Exadata Storage Server

3

n/a

1

Storage Grid Cores

60

n/a

20

Raw PCI Flash Capacity - Extreme Flash

76.8 TB

n/a

25.6 TB

Raw PCI Flash Capacity - High Capacity

38.4 TB

n/a

12.8 TB

Raw Hard Disk Capacity - Extreme Flash

n/a

n/a

n/a

Raw Hard Disk Capacity - High Capacity

288 TB

n/a

96 TB

Usable Mirrored Capacity - Extreme Flash

27.9 TB

n/a

9.3 TB

Usable Mirrored Capacity - High Capacity

108.9 TB

n/a

36.3 TB

Usable Triple Mirrored (High Redundancy) Capacity - Extreme Flash

21.9 TB

n/a

7.3 TB

Usable Triple Mirrored (High Redundancy) Capacity - High Capacity

85.4 TB

n/a

28.5 TB

Note the following for Oracle Exadata Database Machine X6-2 Elastic Configurations:

  • You can add up to 17 more database servers, for a maximum of 19 database servers per rack. Each database server takes up 1 rack unit.

  • You can add up to 15 more storage servers, for a maximum of 18 storage servers per rack. Each storage server takes up 2 rack units.

  • The minimum allowed starting configuration for Oracle Exadata Database Machine is 2 database servers and 3 storage servers.

  • The maximum number of storage servers allowed in the rack is 19. In this configuration, there are no database servers installed in the rack.

  • Additional storage servers can be a mix of X6-2 extreme flash or high capacity storage servers.

  • The maximum number is 22 servers or 38 rack units of servers per rack.

  • Use the Oracle Exadata Configuration Assistant to demonstrate multi-server configuration possibilities. OECA is available on Oracle Technology Network:

    http://www.oracle.com/technetwork/database/exadata/oeca-download-2817713.html

  • Rack units U01, U20, U21, and U22 are reserved for the Cisco and Sun Datacenter InfiniBand Switch 36 switches.

  • Database servers are installed in the rack in the following order when storage servers will be installed:

    1. Up to 4 servers in U16 to U19, starting with U16.

    2. Up to 4 servers in U23 to U26, starting with U23.

    3. Up to 7 servers in U39 to U27, starting with U39. The servers in these rack units are separated by one rack unit, with solid fillers between the servers.

    4. Up to 7 servers in U14 to U02, starting with U14. The servers in these rack units are separated by one rack unit, with solid fillers between the servers.

  • Database servers are installed in the rack in the following order when no storage servers will be installed:

    1. Up to 4 servers in U16 to U19, starting with U16.

    2. Up to 4 servers in U23 to U26, starting with U23.

    3. Up to 4 servers in U14 to U08, starting with U14. The servers in these rack units are separated by one rack unit, with solid fillers between the servers.

    4. Up to 7 servers in U39 to U27, starting with U39. The servers in these rack units are separated by one rack unit, with solid fillers between the servers.

  • Exadata Storage Servers are installed in the rack in the following order:

    1. Up to 3 servers in U02 to U07, starting with U02.

    2. Up to 4 servers in U08 to U15, starting with U08.

    3. Up to 7 servers in U27 to U40, starting with U27.

    4. Up to 2 servers in U26 to U23, starting with U26.

    5. Up to 2 servers in U19 to U16, starting with U19.

    6. 1 server in U41 to U42.

    Note:

    If both high capacity and extreme flash storage servers are installed in the rack, then the high capacity storage servers are installed first.

  • An upper cable harness kit is installed when servers are added to slot U23 or higher.

10.1.3 Oracle Exadata Database Machine X6-8 Elastic Configuration Notes

Note the following for Oracle Exadata Database Machine X6-8 elastic configurations:

  • The minimum allowed starting configuration for Oracle Exadata Database Machine is 2 database servers and 3 storage servers. The storage servers must all be the same type.

  • When adding servers, the additional storage servers can be a mix of X6-2L (or newer) Extreme Flash or High Capacity storage servers, and X5-8 database servers.

    Oracle Exadata Database Machine X6-8 uses X6-2L storage servers and X5-8 database servers.

  • Database servers are installed before Exadata Storage Servers.

  • The following table shows the maximum number of database and storage servers.

    Number of Database Servers Maximum Number of Storage Servers

    4

    8

    3

    11

    2

    14

  • Rack units U01, U20, U21, and U22 are reserved for the Cisco and Sun Datacenter InfiniBand Switch 36 switches.

  • Database servers are installed in the rack in the following order:

    1. 1 server in U16 to U20.

    2. 1 server in U24 to U28.

    3. 1 server in U10 to U14.

    4. 1 server in U29 to U33.

  • Exadata Storage Servers are installed in the rack in the following order:

    1. Up to 4 servers in U02 to U09, starting with U02.

    2. Up to 3 servers in U35 to U40, starting with U35.

    3. Up to 3 servers in U29 to U34, starting with U29. If a database server is installed in this section of the rack, then go to step 4.

    4. Up to 3 servers in U10 to U15, starting with U10. If a database server is installed in this section of the rack, then go to step 5.

    5. Up to 2 servers in U24 to U27, starting with U24. If a database server is installed in this section of the rack, then go to step 6.

    6. 1 server in U41 to U42.

  • An upper cable harness kit is installed when servers are added to slot U24 or higher.

10.1.4 Oracle Exadata Database Machine X5-2 Elastic Configuration Notes

To build an Oracle Exadata X5-2 system with a custom number of database and storage servers, you start from an Oracle Exadata X5-2 quarter rack, and add database and storage servers as needed. The following table shows configuration data for an Oracle Exadata X5-2 quarter rack, and the additional capacity and processing power that you get by adding one database server or one storage server.

Table 10-2 Oracle Exadata Elastic Configuration for Oracle Exadata X5-2

Component X5-2 Quarter Rack Add 1 Database Server Add 1 Storage Server

Database Servers

2

1

n/a

Database Grid Cores

72

36

n/a

Exadata Storage Server

3

n/a

1

Storage Grid Cores

48

n/a

16

Maximum number of cores per rack: 288

Raw PCI Flash Capacity - Extreme Flash

38.4 TB

n/a

12.8 TB

Maximum flash capacity per rack: 230.4 TB

Raw PCI Flash Capacity - High Capacity

19.2 TB

n/a

6.4 TB

Maximum flash capacity per rack: 115.2 TB

Raw Hard Disk Capacity - Extreme Flash

n/a

n/a

n/a

Raw Hard Disk Capacity - High Capacity

288 TB

n/a

96 TB

Maximum disk capacity per rack: 1728 TB

Note the following for Oracle Exadata Database Machine X5-2 Elastic Configurations:

  • You can add up to 17 more database servers, for a maximum of 19 database servers per rack. Each database server takes up 1 rack unit.

  • You can add up to 15 more storage servers, for a maximum of 18 storage servers per rack. Each storage server takes up 2 rack units.

  • The minimum allowed starting configuration for Oracle Exadata Database Machine is 2 database servers and 3 storage servers. The storage servers must all be the same type.

  • The maximum number of storage servers allowed in the rack is 19. In this configuration, there are no database servers installed in the rack.

  • Up to 22 servers can be installed in the rack, taking up a total of 38 rack units. Each database server takes up 1 rack unit. Each storage server takes up 2 rack units.

  • Use the Oracle Exadata Configuration Assistant to demonstrate multi-server configuration possibilities. OECA is available on Oracle Technology Network:

    http://www.oracle.com/technetwork/database/exadata/oeca-download-2817713.html

  • Rack units U01, U20, U21, and U22 are reserved for the Cisco and Sun Datacenter InfiniBand Switch 36 switches.

  • Database servers are installed in the rack in the following order when storage servers will be installed:

    1. Up to 4 servers in U16 to U19, starting with U16.

    2. Up to 4 servers in U23 to U26, starting with U23.

    3. Up to 7 servers in U39 to U27, starting with U39. The servers in these rack units are separated by one rack unit, with solid fillers between the servers.

    4. Up to 7 servers in U14 to U02, starting with U14. The servers in these rack units are separated by one rack unit, with solid fillers between the servers.

  • Database servers are installed in the rack in the following order when no storage servers will be installed:

    1. Up to 4 servers in U16 to U19, starting with U16.

    2. Up to 4 servers in U23 to U26, starting with U23.

      COMMENT: Nov 18, 2015: in the next step, changed U02 to U08, and changed "7 servers" to "4 servers". Bug 22178138

    3. Up to 4 servers in U14 to U08, starting with U14. The servers in these rack units are separated by one rack unit, with solid fillers between the servers.

    4. Up to 7 servers in U39 to U27, starting with U39. The servers in these rack units are separated by one rack unit, with solid fillers between the servers.

  • Exadata Storage Servers are installed in the rack in the following order:

    1. Up to 3 servers in U02 to U07, starting with U02.

    2. Up to 4 servers in U08 to U15, starting with U08.

    3. Up to 7 servers in U27 to U40, starting with U27.

    4. Up to 2 servers in U26 to U23, starting with U26.

    5. Up to 2 servers in U19 to U16, starting with U19.

    6. 1 server in U41 to U42.

    Note:

    If both high capacity and extreme flash storage servers are installed in the rack, then the high capacity storage servers are installed first.

  • An upper cable harness kit is installed when servers are added to slot U23 or higher.

10.1.5 Oracle Exadata Database Machine X5-8 Elastic Configuration Notes

Note the following for Oracle Exadata Database Machine X5-8 elastic configurations:

  • The minimum allowed starting configuration for Oracle Exadata Database Machine is 2 database servers and 3 storage servers. The storage servers must all be the same type.

  • When adding servers, the additional storage servers can be a mix of X5-2 (or newer) Extreme Flash or High Capacity storage servers, and X5-8 database servers.

  • Database servers are installed before Exadata Storage Servers.

  • The following table shows the maximum number of database and storage servers.

    Number of Database Servers Maximum Number of Storage Servers

    4

    8

    3

    11

    2

    14

  • Rack units U01, U20, U21, and U22 are reserved for the Cisco and Sun Datacenter InfiniBand Switch 36 switches.

  • Database servers are installed in the rack in the following order:

    1. 1 server in U16 to U20.

    2. 1 server in U24 to U28.

    3. 1 server in U10 to U14.

    4. 1 server in U29 to U33.

  • Exadata Storage Servers are installed in the rack in the following order:

    1. Up to 4 servers in U02 to U09, starting with U02.

    2. Up to 3 servers in U35 to U40, starting with U35.

    3. Up to 3 servers in U29 to U34, starting with U29. If a database server is installed in this section of the rack, then go to step 4.

    4. Up to 3 servers in U10 to U15, starting with U10. If a database server is installed in this section of the rack, then go to step 5.

    5. Up to 2 servers in U24 to U27, starting with U24. If a database server is installed in this section of the rack, then go to step 6.

    6. 1 server in U41 to U42.

  • An upper cable harness kit is installed when servers are added to slot U24 or higher.

10.1.6 Oracle Exadata Database Machine X4-8 Elastic Configuration Notes

Note the following for Oracle Exadata Database Machine X4-8 Elastic Configurations:

  • At least 2 database servers and 3 storage servers must be installed in the rack. The storage servers must all be the same type.

  • When adding servers, the additional storage servers can be a mix of X5-2 (or newer) extreme flash or high capacity storage servers, and X4-8 database servers.

  • Database servers are installed before Exadata Storage Servers.

  • The following table shows the maximum number of database and storage servers.

    Number of Database Servers Maximum Number of Storage Servers

    4

    8

    3

    11

    2

    14

  • Rack units U01, U20, U21, and U22 are reserved for the Cisco and Sun Datacenter InfiniBand Switch 36 switches.

  • Database servers are installed in the rack in the following order:

    1. 1 server in U16 to U20.

    2. 1 server in U24 to U28.

    3. 1 server in U10 to U14.

    4. 1 server in U29 to U33.

  • Exadata Storage Servers are installed in the rack in the following order:

    1. Up to 4 servers in U02 to U09, starting with U02.

    2. Up to 3 servers in U35 to U40, starting with U35.

    3. Up to 3 servers in U29 to U34, starting with U29. If a database server is installed in this section of the rack, then go to step 4.

    4. Up to 3 servers in U10 to U15, starting with U10. If a database server is installed in this section of the rack, then go to step 5.

    5. Up to 2 servers in U24 to U27, starting with U24. If a database server is installed in this section of the rack, then go to step 6.

    6. 1 server in U41 to U42.

  • An upper cable harness kit is installed when servers are added to slot U24 or higher.

10.1.7 Oracle Exadata Storage Expansion Rack Notes

Note the following for Oracle Exadata Storage Expansion Rack elastic configurations:

  • Up to 19 Exadata Storage Servers.

  • At least 4 storage servers must be installed in the rack. The storage servers must all be the same type.

  • When adding storage servers, the additional servers can be X6-2 or X5-2 extreme flash or high capacity servers.

  • Oracle Exadata Storage Expansion Rack cannot be converted to Oracle Exadata Database Machine X5-2 Elastic Configuration rack.

  • Rack units U01, U20, U21, and U22 are reserved for the Cisco and Sun Datacenter InfiniBand Switch 36 switches.

  • Exadata Storage Servers are installed in the rack in the following order:

    1. Up to 3 servers in U02 to U07, starting with U02.

    2. Up to 4 servers in U08 to U15, starting with U08.

    3. Up to 7 servers in U27 to U40, starting with U27.

    4. Up to 2 servers in U26 to U23, starting with U26.

    5. Up to 2 servers in U19 to U16, starting with U19.

    6. 1 server in U41 to U42.

  • An upper cable harness kit is installed when servers are added to slot U23 or higher.

10.2 Ethernet Cabling for Sun Integrated Lights Out Manager and Administrative Network

This section contains the tables for the Sun Integrated Lights Out Manager (ILOM) and administrative network cabling. The ILOM port on the servers is labeled NET MGT, and connects to the Gigabit Ethernet port located in rack unit 21 on Oracle Exadata Database Machine elastic configuration racks.

The following tables are in this section:

  • Table 10-3 Ethernet Cabling for Oracle Exadata Database Machine X7-2, X6-2, and X5-2 Elastic Configuration

  • Table 10-4 Ethernet Cabling for Oracle Exadata Database Machine X5-8, X6-8, and X7-8 Elastic Configuration with One Database Server

  • Table 10-5 Ethernet Cabling for Oracle Exadata Database Machine X6-8 and X7-8 Elastic Configuration with Three Database Servers

  • Table 10-6 Ethernet Cabling for Oracle Exadata Database Machine X5-8 and X6-8 Elastic Configuration with Four Database Servers

  • Table 10-7 Ethernet Cabling for Oracle Exadata Database Machine X4-8 Elastic Configuration with One Database Server

  • Table 10-8 Ethernet Cabling for Oracle Exadata Database Machine X4-8 Elastic Configuration with Four Database Servers

The following table shows the cable connections from the servers to the ILOM switch in Oracle Exadata Database Machine X7-2, X6-2, and X5-2 Elastic Configuration.

Table 10-3 Ethernet Cabling for Oracle Exadata Database MachineX7-2, X6-2, and X5-2 Elastic Configuration

From Rack Unit ILOM Port Administrative (NET0) Port

U41

16

15

U39

2

1

U37

4

3

U35

6

5

U33

8

7

U31

10

9

U29

12

11

U27

14

13

U26

16

15

U25

18

17

U24

20

19

U23

22

21

U19

24

23

U18

26

25

U17

28

27

U16

30

29

U14

32

31

U12

34

33

U10

36

35

U8

38

37

U6

40

39

U4

42

41

U2

44

43

The following table shows the cable connections from the servers to the ILOM switch in Oracle Exadata Database Machine X5-8, X6-8, and X7-8 elastic configuration with one database server:

Table 10-4 Ethernet Cabling for Oracle Exadata Database Machine X5-8, X6-8, and X7-8 Elastic Configuration with One Database Server

From Rack Unit ILOM Port Administrative Port

U41

2

1

U39

4

3

U37

6

5

U35

8

7

U33

10

9

U31

12

11

U29

14

13

U26

36

37

U24

16

15

U16

18

17

U14

20

19

U12

22

21

U10

24

23

U8

26

25

U6

28

27

U4

30

29

U2

32

31

U1

35

35

The following table shows the cable connections from the servers to the ILOM switch in Oracle Exadata Database Machine X6-8 and X7-8 with three database servers:

Table 10-5 Ethernet Cabling for Oracle Exadata Database Machine X6-8 and X7-8 with Three Database Servers

From Rack Unit ILOM Port Administrative Port

U41

2

1

U39

4

3

U37

6

5

U35

8

7

U33

10

9

U31

12

11

U29

14

13

U24

16

15

U16

18

17

U10

24

23

U8

26

25

U6

28

27

U4

30

29

U2

32

31

U1

35

35

The following table shows the cable connections from the servers to the ILOM switch in Oracle Exadata Database Machine X5-8 and X6-8 elastic configuration with four database servers:

Table 10-6 Ethernet Cabling for Oracle Exadata Database Machine X5-8 and X6-8 Elastic Configuration with Four Database Servers

From Rack Unit ILOM Port Administrative Port

U41

2

1

U39

4

3

U37

6

5

U35

8

7

U29

14

13

U24

16

15

U16

18

17

U10

24

23

U8

26

25

U6

28

27

U4

30

29

U2

32

31

U1

35

35

The following table shows the cable connections from the servers to the ILOM switch in Oracle Exadata Database Machine X4-8 Elastic Configuration with one database server:

Table 10-7 Ethernet Cabling for Oracle Exadata Database Machine X4-8 Elastic Configuration with One Database Server

From Rack Unit ILOM Port Administrative Port

U41

2

1

U39

4

3

U37

6

5

U35

8

7

U33

10

9

U31

12

11

U29

14

13

U26

36

37

U24

16

15

U16

18

17

U14

20

19

U12

22

21

U10

24

23

U8

26

25

U6

28

27

U4

30

29

U2

32

31

U1

35

35

The following table shows the cable connections from the servers to the ILOM switch in Oracle Exadata Database Machine X4-8 Elastic Configuration with four database servers:

Table 10-8 Ethernet Cabling for Oracle Exadata Database Machine X4-8 Elastic Configuration with Four Database Servers

From Rack Unit ILOM Port Administrative Port

U41

2

1

U39

4

3

U37

6

5

U35

8

7

U29

14

13

U24

16

15

U16

18

17

U10

24

23

U8

26

25

U6

28

27

U4

30

29

U2

32

31

U1

35

35

10.3 InfiniBand Cabling for Servers

This topic contains the tables for InfiniBand network cabling for Oracle Exadata Database Machine elastic configuration racks.

In Oracle Exadata Database Machine X3 or later two-socket systems, the Sun Datacenter InfiniBand Switch 36 switches are located in rack units 20 and 22. In Oracle Exadata Database Machine X4 or later eight-socket systems, the Sun Datacenter InfiniBand Switch 36 switches are located in rack units 21 and 23. If present, the optional spine switch is located in rack unit 1.

The following table lists the location, and ports for the InfiniBand connections for an Oracle Exadata Database Machine X6-2 elastic configuration:

Table 10-9 InfiniBand Network Cabling for Oracle Exadata Database Machine X6-2 Elastic Configurations

From Rack Unit Port To Rack Unit Server Port

U22

6B

U41

Port 2

U22

0A

U39

Port 2

U22

0B

U37

Port 2

U22

1A

U35

Port 2

U22

1B

U33

Port 2

U22

2A

U31

Port 2

U22

2B

U29

Port 2

U22

3B

U27

Port 2

U22

3A

U26

Port 2

U22

4A

U25

Port 2

U22

4B

U24

Port 2

U22

5A

U23

Port 2

U22

12B

U19

Port 2

U22

13A

U18

Port 2

U22

13B

U17

Port 2

U22

14B

U16

Port 2

U22

14A

U14

Port 2

U22

15A

U12

Port 2

U22

15B

U10

Port 2

U22

16A

U8

Port 2

U22

16B

U6

Port 2

U22

17A

U4

Port 2

U22

17B

U2

Port 2

U20

6B

U41

Port 1

U20

0A

U39

Port 1

U20

0B

U37

Port 1

U20

1A

U35

Port 1

U20

1B

U33

Port 1

U20

2A

U31

Port 1

U20

2B

U29

Port 1

U20

3B

U27

Port 1

U20

3A

U26

Port 1

U20

4A

U25

Port 1

U20

4B

U24

Port 1

U20

5A

U23

Port 1

U20

12B

U19

Port 1

U20

13A

U18

Port 1

U20

13B

U17

Port 1

U20

14B

U16

Port 1

U20

14A

U14

Port 1

U20

15A

U12

Port 1

U20

15B

U10

Port 1

U20

16A

U8

Port 1

U20

16B

U6

Port 1

U20

17A

U4

Port 1

U20

17B

U2

Port 1

U20

9B

U22

9A

U20

10B

U22

10A

U20

11B

U22

11A

U20

8A

U22

8A

U20

9A

U22

9B

U20

10A

U22

10B

U20

11A

U22

11B

U1 — if present

1B

U20

8B

U1 — if present

0B

U22

8B

The following table lists the location, and ports for the InfiniBand connections for Oracle Exadata Database Machine X5-2 elastic configuration:

Table 10-10 InfiniBand Network Cabling for Oracle Exadata Database Machine X5-2 Elastic Configurations

From Rack Unit Port To Rack Unit Server Port

U22

6B

U41

Port 2

U22

0A

U39

Port 2

U22

0B

U37

Port 2

U22

1A

U35

Port 2

U22

1B

U33

Port 2

U22

2A

U31

Port 2

U22

2B

U29

Port 2

U22

3B

U27

Port 2

U22

3A

U26

Port 2

U22

4A

U25

Port 2

U22

4B

U24

Port 2

U22

5A

U23

Port 2

U22

12B

U19

Port 2

U22

13A

U18

Port 2

U22

13B

U17

Port 2

U22

14B

U16

Port 2

U22

14A

U14

Port 2

U22

15A

U12

Port 2

U22

15B

U10

Port 2

U22

16A

U8

Port 2

U22

16B

U6

Port 2

U22

17A

U4

Port 2

U22

17B

U2

Port 2

U20

6B

U41

Port 1

U20

0A

U39

Port 1

U20

0B

U37

Port 1

U20

1A

U35

Port 1

U20

1B

U33

Port 1

U20

2A

U31

Port 1

U20

2B

U29

Port 1

U20

3B

U27

Port 1

U20

3A

U26

Port 1

U20

4A

U25

Port 1

U20

4B

U24

Port 1

U20

5A

U23

Port 1

U20

12B

U19

Port 1

U20

13A

U18

Port 1

U20

13B

U17

Port 1

U20

14B

U16

Port 1

U20

14A

U14

Port 1

U20

15A

U12

Port 1

U20

15B

U10

Port 1

U20

16A

U8

Port 1

U20

16B

U6

Port 1

U20

17A

U4

Port 1

U20

17B

U2

Port 1

U20

9B

U22

9A

U20

10B

U22

10A

U20

11B

U22

11A

U20

8A

U22

8A

U20

9A

U22

9B

U20

10A

U22

10B

U20

11A

U22

11B

U1 — if present

1B

U20

8B

U1 — if present

0B

U22

8B

The following table lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X4-8 elastic configurations.

Table 10-11 InfiniBand Network Cabling for Oracle Exadata Database Machine X4-8 Elastic Configurations

From Rack Unit Port To Rack Unit Server Port

U23

0A

U41

3 PCIe3 P1

U23

0B

U39

3 PCIe3 P1

U23

1A

U37

3 PCIe3 P1

U23

1B

U35

3 PCIe3 P1

U23

2A

U33

3 PCIe3 P1

U23

2B

U31

3 PCIe3 P1

U23

3B

U29

3 PCIe3 P1

U23

3A

U24

12 PCIe3 P1

U23

4A

U24

10 PCIe3 P1

U23

4B

U24

8 PCIe3 P1

U23

5A

U24

6 PCIe3 P1

U23

13A

U16

10 PCIe3 P2

U23

13B

U16

8 PCIe3 P2

U23

14B

U16

6 PCIe3 P2

U23

12B

U16

12 PCIe3 P2

U23

14A

U14

3 PCIe3 P2

U23

15A

U12

3 PCIe3 P2

U23

15B

U10

3 PCIe3 P2

U23

16A

U8

3 PCIe3 P2

U23

16B

U6

3 PCIe3 P2

U23

17A

U4

3 PCIe3 P2

U23

17B

U2

3 PCIe3 P2

U21

0A

U41

3 PCIe3 P2

U21

0B

U39

3 PCIe3 P2

U21

1A

U37

3 PCIe3 P2

U21

1B

U35

3 PCIe3 P2

U21

2A

U33

3 PCIe3 P2

U21

2B

U31

3 PCIe3 P2

U21

3B

U29

3 PCIe3 P2

U21

3A

U24

12 PCIe3 P2

U21

4A

U24

10 PCIe3 P2

U21

4B

U24

8 PCIe3 P2

U21

5A

U24

6 PCIe3 P2

U21

12B

U16

12 PCIe3 P1

U21

13A

U16

10 PCIe3 P1

U21

13B

U16

8 PCIe3 P1

U21

14B

U16

6 PCIe3 P1

U21

14A

U14

3 PCIe3 P1

U21

15A

U12

3 PCIe3 P1

U21

15B

U10

3 PCIe3 P1

U21

16A

U8

3 PCIe3 P1

U21

16B

U6

3 PCIe3 P1

U21

17A

U4

3 PCIe3 P1

U21

17B

U2

3 PCIe3 P1

U21

9B

U23

9A

U21

10B

U23

10A

U21

11B

U23

11A

U21

8A

U23

8A

U21

9A

U23

9B

U21

10A

U23

10B

U21

11A

U23

11B

U1 — if present

1B

U20

8B

U1 — if present

0B

U22

8B

The following table lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X5-8 and X6-8 elastic configurations.

Table 10-12 InfiniBand Network Cabling for Oracle Exadata Database Machine X5-8 and X6-8 Elastic Configurations

From Rack Unit Port To Rack Unit Server Port

U23

0A

U41

3 PCIe3 P1

U23

0B

U39

3 PCIe3 P1

U23

1A

U37

3 PCIe3 P1

U23

1B

U35

3 PCIe3 P1

U23

2A

U33

3 PCIe3 P1

U23

2B

U31

3 PCIe3 P1

U23

3B

U29

3 PCIe3 P1

U23

3A

U24

12 PCIe3 P1

U23

4A

U24

10 PCIe3 P1

U23

4B

U24

8 PCIe3 P1

U23

5A

U24

6 PCIe3 P1

U23

13A

U16

10 PCIe3 P2

U23

13B

U16

8 PCIe3 P2

U23

14B

U16

6 PCIe3 P2

U23

12B

U16

12 PCIe3 P2

U23

14A

U14

3 PCIe3 P2

U23

15A

U12

3 PCIe3 P2

U23

15B

U10

3 PCIe3 P2

U23

16A

U8

3 PCIe3 P2

U23

16B

U6

3 PCIe3 P2

U23

17A

U4

3 PCIe3 P2

U23

17B

U2

3 PCIe3 P2

U21

0A

U41

3 PCIe3 P2

U21

0B

U39

3 PCIe3 P2

U21

1A

U37

3 PCIe3 P2

U21

1B

U35

3 PCIe3 P2

U21

2A

U33

3 PCIe3 P2

U21

2B

U31

3 PCIe3 P2

U21

3B

U29

3 PCIe3 P2

U21

3A

U24

12 PCIe3 P2

U21

4A

U24

10 PCIe3 P2

U21

4B

U24

8 PCIe3 P2

U21

5A

U24

6 PCIe3 P2

U21

12B

U16

12 PCIe3 P1

U21

13A

U16

10 PCIe3 P1

U21

13B

U16

8 PCIe3 P1

U21

14B

U16

6 PCIe3 P1

U21

14A

U14

3 PCIe3 P1

U21

15A

U12

3 PCIe3 P1

U21

15B

U10

3 PCIe3 P1

U21

16A

U8

3 PCIe3 P1

U21

16B

U6

3 PCIe3 P1

U21

17A

U4

3 PCIe3 P1

U21

17B

U2

3 PCIe3 P1

U21

9B

U23

9A

U21

10B

U23

10A

U21

11B

U23

11A

U21

8A

U23

8A

U21

9A

U23

9B

U21

10A

U23

10B

U21

11A

U23

11B

U1 — if present

1B

U20

8B

U1 — if present

0B

U22

8B

10.4 Single Phase Power Distribution Unit Cabling Table for Elastic Configurations

The following table shows the cable connections from the PDUs to the rack units for Oracle Exadata Database Machine X7-2 elastic configurations.

Table 10-13 Single Phase PDU Cabling for Oracle Exadata Database Machine X7-2 Full Rack

Rack Unit PDU-A/PSU 0 PDU-B/PSU 1 Cable Length

U42

G5-5

G0-1

2 meters

U41

G3-6

G2-0

2 meters

U40

G5-2

G0-4

2 meters

U39

G5-6

G0-0

2 meters

U37

G5-3

G0-3

2 meters

U35

G5-1

G0-5

2 meters

U33

G5-0

G0-6

2 meters

U31

G4-4

G1-2

2 meters

U29

G4-3

G1-3

2 meters

U27

G3-5

G2-1

2 meters

U26

G4-5

G1-1

2 meters

U25

G4-2

G1-4

2 meters

U24

G4-1

G1-5

2 meters

U23

G2-5

G3-1

2 meters

U22

G1-4

G4-2

2 meters

U21

G1-3

G4-3

2 meters

U20

G1-5

G4-1

2 meters

U19

G2-3

G3-3

2 meters

U18

G2-2

G3-4

2 meters

U17

G1-6

G4-0

2 meters

U16

G1-2

G4-4

2 meters

U14

G2-4

G3-2

2 meters

U12

G2-1

G3-5

2 meters

U10

G2-0

G3-6

2 meters

U8

G1-0

G4-6

2 meters

U6

G0-6

G5-0

2 meters

U4

G0-4

G5-2

2 meters

U2

G0-2

G5-4

2 meters

U1

G4-0

G1-6

2 meters

The following table shows the cable connections from the PDUs to the rack units for Oracle Exadata Database Machine X6-2 elastic configurations.

Table 10-14 Single Phase PDU Cabling for Oracle Exadata Database Machine X6-2 Elastic Configurations

Rack Unit PDU-A/PS-00 PDU-B/PS-01 Cable Length

U41

G4-5

G1-1

2 meters

U39

G5-6

G0-0

2 meters

U37

G5-3

G0-3

2 meters

U35

G5-0

G0-6

2 meters

U33

G4-6

G1-0

2 meters

U31

G4-4

G1-2

2 meters

U29

G4-2

G1-4

2 meters

U27

G3-6

G2-0

2 meters

U26

G4-0

G1-6

2 meters

U25

G3-5

G2-1

2 meters

U24

G5-1

G0-5

2 meters

U23

G3-3

G2-3

2 meters

U22

G3-1

G2-5

2 meters

U21

G3-0

G2-6

2 meters

U20

G2-4

G3-2

2 meters

U19

G2-3

G3-3

2 meters

U18

G2-2

G3-4

2 meters

U17

G2-1

G3-5

2 meters

U16

G1-6

G4-0

2 meters

U14

G2-0

G3-6

2 meters

U12

G1-4

G4-2

2 meters

U10

G1-2

G4-4

2 meters

U8

G1-0

G4-6

2 meters

U6

G0-6

G5-0

2 meters

U4

G0-4

G5-2

2 meters

U2

G0-2

G5-4

2 meters

U0

G0-0

G5-6

2 meters

The following table shows the cable connections from the PDUs to the rack units for Oracle Exadata Database Machine X5-2 elastic configurations.

Table 10-15 Single Phase PDU Cabling for Oracle Exadata Database Machine X5-2 Elastic Configurations

Rack Unit PDU-A/PS-00 PDU-B/PS-01 Cable Length

U41

G4-5

G1-1

2 meters

U39

G5-6

G0-0

2 meters

U37

G5-3

G0-3

2 meters

U35

G5-0

G0-6

2 meters

U33

G4-6

G1-0

2 meters

U31

G4-4

G1-2

2 meters

U29

G4-2

G1-4

2 meters

U27

G3-6

G2-0

2 meters

U26

G4-0

G1-6

2 meters

U25

G3-5

G2-1

2 meters

U24

G5-1

G0-5

2 meters

U23

G3-3

G2-3

2 meters

U22

G3-1

G2-5

2 meters

U21

G3-0

G2-6

2 meters

U20

G2-4

G3-2

2 meters

U19

G2-3

G3-3

2 meters

U18

G2-2

G3-4

2 meters

U17

G2-1

G3-5

2 meters

U16

G1-6

G4-0

2 meters

U14

G2-0

G3-6

2 meters

U12

G1-4

G4-2

2 meters

U10

G1-2

G4-4

2 meters

U8

G1-0

G4-6

2 meters

U6

G0-6

G5-0

2 meters

U4

G0-4

G5-2

2 meters

U2

G0-2

G5-4

2 meters

U0

G0-0

G5-6

2 meters

The following table shows the cable connections from the PDUs to the rack units in Oracle Exadata Database Machine X4-8 Full Rack with Exadata Storage Server X5-2L (or newer) Servers elastic configurations.

Table 10-16 Single Phase PDU Cabling for Oracle Exadata Database Machine X4-8 Full Rack with Exadata Storage Server X5-2L (or Newer) Servers Elastic Configurations

Rack Unit PDU-A/PS-00 PDU-B/PS-01 Cable Length

U41

G5-6

G0-0

2 meters

U39

G5-4

G0-2

2 meters

U37

G5-2

G0-4

2 meters

U35

G5-0

G0-6

2 meters

U33

G4-6

G1-0

2 meters

U31

G4-3

G1-3

2 meters

U29

G3-6

G2-0

2 meters

U26 (when no storage server is installed in this rack unit)

G2-2

G3-4

2 meters

U24 (when no storage server is installed in this rack unit)

G3-3

G2-3

2 meters

U24

G4-7 C19 (AC0)

G1-7 C19 (AC1)

1 meter

U24

G2-7 C19 (AC2)

G3-7 C19 (AC3)

1 meter

U23

G3-1

G2-5

2 meters

U22

G2-6

G3-0

2 meters

U21

G3-0

G2-6

2 meters

U16

G3-7 C19 (AC0)

G2-7 C19 (AC1)

1 meter

U16

G1-7 C19 (AC2)

G4-7 C19 (AC3)

1 meter

U14 (when no storage server is installed in this rack unit)

G2-0

G3-6

2 meters

U12 (when no storage server is installed in this rack unit)

G1-3

G4-3

2 meters

U10 (when no storage server is installed in this rack unit)

G1-0

G4-6

2 meters

U10

G5-7 C19 (AC0)

G0-7 C19 (AC1)

2 meters

U10

G0-7 C19 (AC2)

G5-7 C19 (ACO3)

2 meters

U8

G0-6

G5-0

2 meters

U6

G0-4

G5-2

2 meters

U4

G0-3

G5-3

2 meters

U2

G0-1

G5-5

2 meters

U1

G0-0

G5-6

2 meters

The following table shows the cable connections from the PDUs to the rack units in Oracle Exadata Database Machine X5-8 Full Rack with Exadata Storage Server X5-2L (or newer) Servers elastic configurations.

Table 10-17 Single Phase PDU Cabling for Oracle Exadata Database Machine X5-8 Full Rack with Exadata Storage Server X5-2L (or Newer) Servers Elastic Configurations

Rack Unit PDU-A/PS-00 PDU-B/PS-01 Cable Length

U41

G5-6

G0-0

2 meters

U39

G5-4

G0-2

2 meters

U37

G5-2

G0-4

2 meters

U35

G5-0

G0-6

2 meters

U33

G4-6

G1-0

2 meters

U31

G4-3

G1-3

2 meters

U29

G3-6

G2-0

2 meters

U26 (when no storage server is installed in this rack unit)

G2-2

G3-4

2 meters

U24 (when no storage server is installed in this rack unit)

G3-3

G2-3

2 meters

U24

G4-7 C19 (AC0)

G1-7 C19 (AC1)

1 meter

U24

G2-7 C19 (AC2)

G3-7 C19 (AC3)

1 meter

U23

G3-1

G2-5

2 meters

U22

G2-6

G3-0

2 meters

U21

G3-0

G2-6

2 meters

U16

G3-7 C19 (AC0)

G2-7 C19 (AC1)

1 meter

U16

G1-7 C19 (AC2)

G4-7 C19 (AC3)

1 meter

U14 (when no storage server is installed in this rack unit)

G2-0

G3-6

2 meters

U12 (when no storage server is installed in this rack unit)

G1-3

G4-3

2 meters

U10 (when no storage server is installed in this rack unit)

G1-0

G4-6

2 meters

U10

G5-7 C19 (AC0)

G0-7 C19 (AC1)

2 meters

U10

G0-7 C19 (AC2)

G5-7 C19 (ACO3)

2 meters

U8

G0-6

G5-0

2 meters

U6

G0-4

G5-2

2 meters

U4

G0-3

G5-3

2 meters

U2

G0-1

G5-5

2 meters

U1

G0-0

G5-6

2 meters

10.5 Three-Phase Power Distribution Unit Cabling Table for Elastic Configurations

The following table shows the cable connections from the PDUs to the rack for Oracle Exadata Database Machine X7-2 elastic configurations.

Table 10-18 Three Phase PDU Cabling for Oracle Exadata Database Machine X7-2 Full Rack

Rack Unit PDU-A/PSU 0 PDU-B/PSU 1 Cable Length

U42

G5-4

G2-2

2 meters

U41

G5-6

G2-0

2 meters

U40

G4-6

G1-0

2 meters

U39

G4-5

G1-1

2 meters

U37

G3-5

G0-1

2 meters

U35

G5-5

G2-1

2 meters

U33

G4-3

G1-3

2 meters

U31

G3-1

G0-5

2 meters

U29

G4-0

G1-6

2 meters

U27

G5-3

G2-3

2 meters

U26

G5-1

G2-5

2 meters

U25

G3-3

G0-3

2 meters

U24

G4-4

G1-2

2 meters

U23

G3-2

G0-4

2 meters

U22

G2-6

G5-0

2 meters

U21

G1-0

G4-6

2 meters

U20

G0-0

G3-6

2 meters

U19

G2-5

G5-1

2 meters

U18

G0-6

G3-0

2 meters

U17

G1-6

G4-0

2 meters

U16

G2-1

G5-5

2 meters

U14

G1-4

G4-2

2 meters

U12

G2-3

G5-3

2 meters

U10

G2-0

G5-6

2 meters

U8

G1-2

G4-4

2 meters

U6

G1-1

G4-5

2 meters

U4

G0-2

G3-4

2 meters

U2

G0-1

G3-5

2 meters

U1

G2-2

G5-4

2 meters

The following table shows the cable connections from the PDUs to the rack for Oracle Exadata Database Machine X6-2 elastic configurations.

Table 10-19 Three Phase PDU Cabling for Oracle Exadata Database Machine X6-2 Elastic Configurations

Rack Unit PDU-A/PS-00 PDU-B/PS-01 Cable Length

U41

G4-5

G1-1

2 meters

U39

G5-6

G2-0

2 meters

U37

G5-3

G2-3

2 meters

U35

G5-0

G2-6

2 meters

U33

G4-6

G1-0

2 meters

U31

G4-4

G1-2

2 meters

U29

G4-2

G1-4

2 meters

U27

G3-6

G0-0

2 meters

U26

G4-0

G1-6

2 meters

U25

G3-5

G0-1

2 meters

U24

G3-4

G0-2

2 meters

U23

G3-3

G0-3

2 meters

U22

G5-1

G2-5

2 meter

U21

G3-0

G0-6

2 meters

U20

G2-4

G5-2

2 meters

U19

G2-3

G5-3

2 meters

U18

G2-2

G5-4

2 meters

U17

G2-1

G5-5

2 meters

U16

G1-6

G4-0

2 meters

U14

G2-0

G5-6

2 meters

U12

G1-4

G4-2

2 meters

U10

G1-2

G4-4

2 meters

U8

G1-0

G4-6

2 meters

U6

G0-6

G3-0

2 meters

U4

G0-4

G3-2

2 meters

U2

G0-2

G3-4

2 meters

U0

G0-0

G3-6

2 meters

The following table shows the cable connections from the PDUs to the rack for Oracle Exadata Database Machine X5-2 elastic configurations.

Table 10-20 Three Phase PDU Cabling for Oracle Exadata Database Machine X5-2 Elastic Configurations

Rack Unit PDU-A/PS-00 PDU-B/PS-01 Cable Length

U41

G4-5

G1-1

2 meters

U39

G5-6

G2-0

2 meters

U37

G5-3

G2-3

2 meters

U35

G5-0

G2-6

2 meters

U33

G4-6

G1-0

2 meters

U31

G4-4

G1-2

2 meters

U29

G4-2

G1-4

2 meters

U27

G3-6

G0-0

2 meters

U26

G4-0

G1-6

2 meters

U25

G3-5

G0-1

2 meters

U24

G3-4

G0-2

2 meters

U23

G3-3

G0-3

2 meters

U22

G5-1

G2-5

2 meter

U21

G3-0

G0-6

2 meters

U20

G2-4

G5-2

2 meters

U19

G2-3

G5-3

2 meters

U18

G2-2

G5-4

2 meters

U17

G2-1

G5-5

2 meters

U16

G1-6

G4-0

2 meters

U14

G2-0

G5-6

2 meters

U12

G1-4

G4-2

2 meters

U10

G1-2

G4-4

2 meters

U8

G1-0

G4-6

2 meters

U6

G0-6

G3-0

2 meters

U4

G0-4

G3-2

2 meters

U2

G0-2

G3-4

2 meters

U0

G0-0

G3-6

2 meters

The following table shows the cable connections from the PDUs to the rack units in Oracle Exadata Database Machine X4-8 Full Rack with Exadata Storage Server X5-2L (or newer) Servers elastic configurations.

Table 10-21 Three Phase PDU Cabling for Oracle Exadata Database Machine X4-8 Full Rack with Exadata Storage Server X5-2L (or Newer) Servers Elastic Configurations

Rack Unit PDU-A/PS-00 PDU-B/PS-01 Cable Length

U41

G8-3

G2-1

2 meters

U39

G8-1

G2-3

2 meters

U37

G7-3

G1-1

2 meters

U35

G7-1

G1-3

2 meters

U33 (when no storage server is installed in this rack unit)

G1-2

G7-2

2 meters

U31 (when no storage server is installed in this rack unit)

G6-3

G0-1

2 meters

U29 (when no storage server is installed in this rack unit)

G6-2

G0-2

2 meters

U29

G7-7 C19 (AC0)

G1-7 C19 (AC1)

2 meters

U29

G1-7 C19 (AC2)

G7-7 C19 (AC3)

2 meters

U26 (when no storage server is installed in this rack unit)

G5-3

G5-1

2meters

U24 (when no storage server is installed in this rack unit)

G5-2

G5-2

2 meters

U24

G5-7 C19 (AC0)

G5-7 C19)(AC1)

1 meter

U24

G6-7 C19 (AC2)

G0-7 C19)(AC3)

1 meter

U23

G4-4

G4-0

2 meters

U22

G4-2

G4-4

2 meters

U21

G4-3

G4-1

2 meters

U16

G2-7 C19 (AC0)

G8-7 C19 (AC1)

1 meter

U16

G3-7 C19 (AC2)

G3-7 C19 (AC3)

1 meter

U14 (when no storage server is installed in this rack unit)

G8-4

G2-0

2 meters

U12 (when no storage server is installed in this rack unit)

G2-2

G8-2

2 meters

U10 (when no storage server is installed in this rack unit)

G1-4

G7-0

2 meters

U10

G0-7 C19 (AC0)

G6-7 C19 (AC1)

2 meters

U10

G8-7 C19 (AC2)

G2-7 C19 (AC3)

2 meters

U8

G1-3

G7-1

2 meters

U6

G1-1

G7-3

2 meters

U4

G0-3

G6-1

2 meters

U2

G0-1

G6-3

2 meters

U1

G4-0

G4-4

2 meters

The following table shows the cable connections from the PDUs to the rack units in Oracle Exadata Database Machine X5-8 and X6-8 full rack with Exadata Storage Server X5-2L (or newer) Servers elastic configurations.

Table 10-22 Three Phase PDU Cabling for Oracle Exadata Database Machine X5-8 and X6-8 Full Rack with Exadata Storage Server X5-2L (or Newer) Servers Elastic Configurations

Rack Unit PDU-A/PS-00 PDU-B/PS-01 Cable Length

U41

G8-3

G2-1

2 meters

U39

G8-1

G2-3

2 meters

U37

G7-3

G1-1

2 meters

U35

G7-1

G1-3

2 meters

U33 (when no storage server is installed in this rack unit)

G1-2

G7-2

2 meters

U31 (when no storage server is installed in this rack unit)

G6-3

G0-1

2 meters

U29 (when no storage server is installed in this rack unit)

G6-2

G0-2

2 meters

U29

G7-7 C19 (AC0)

G1-7 C19 (AC1)

2 meters

U29

G1-7 C19 (AC2)

G7-7 C19 (AC3)

2 meters

U26 (when no storage server is installed in this rack unit)

G5-3

G5-1

2meters

U24 (when no storage server is installed in this rack unit)

G5-2

G5-2

2 meters

U24

G5-7 C19 (AC0)

G5-7 C19)(AC1)

1 meter

U24

G6-7 C19 (AC2)

G0-7 C19)(AC3)

1 meter

U23

G4-4

G4-0

2 meters

U22

G4-2

G4-4

2 meters

U21

G4-3

G4-1

2 meters

U16

G2-7 C19 (AC0)

G8-7 C19 (AC1)

1 meter

U16

G3-7 C19 (AC2)

G3-7 C19 (AC3)

1 meter

U14 (when no storage server is installed in this rack unit)

G8-4

G2-0

2 meters

U12 (when no storage server is installed in this rack unit)

G2-2

G8-2

2 meters

U10 (when no storage server is installed in this rack unit)

G1-4

G7-0

2 meters

U10

G0-7 C19 (AC0)

G6-7 C19 (AC1)

2 meters

U10

G8-7 C19 (AC2)

G2-7 C19 (AC3)

2 meters

U8

G1-3

G7-1

2 meters

U6

G1-1

G7-3

2 meters

U4

G0-3

G6-1

2 meters

U2

G0-1

G6-3

2 meters

U1

G4-0

G4-4

2 meters