Go to primary content
Oracle® Communications OC-CNE Installation Guide
Release 1.0
F16979-01
Go To Table Of Contents
Contents

Previous
Previous
Next
Next

Topology Connection Tables

Enclosure Connections

Blade Server Connections

OA Connections

Topology Connections

Enclosure Switch Connections

ToR Switch Connections

Rackmount Server Connections

The HP BL460 Gen10 Blade Server will have a base set of NICs that connect internally to the enclosure's IO bays 1 and 2. These connections are "hard-wired" and won't be documented here. Since no additional NICs are planned beyond the base pair of NICs, no further declarations of network connectivity on the blades needs mentioning. Blade specifications are linked here:

https://www.hpe.com/us/en/product-catalog/servers/proliant-servers/pip.specifications.hpe-proliant-bl460c-gen10-server-blade.1010025832.html.

The Enclosure's Onboard Administrator (OA) will be deployed as a redundant pair, with each connecting with 1GE copper connection to the respective ToR switches' SFP+ ports.

The HP 6127XLG switch (https://www.hpe.com/us/en/product-catalog/servers/server-interconnects/pip.hpe-6127xlg-blade-switch.8699023.html) will have 4x10GE fiber (or DAC) connections between it and ToR respective switches' SFP+ ports.

Table B-11 Enclosure Switch Connections

Switch Port Name/ID (From) Destination (To) Cable Type Module Required
Internal 1 Blade 1, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 2 Blade 2, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 3 Blade 3, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 4 Blade 4, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 5 Blade 5, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 6 Blade 6, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 7 Blade 7, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 8 Blade 8, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 9 Blade 9, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 10 Blade 10, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 11 Blade 11, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 12 Blade 12, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 13 Blade 13, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 14 Blade 14, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 15 Blade 15, NIC (1 for IObay1, 2 for IObay2) Internal None
Internal 16 Blade 16, NIC (1 for IObay1, 2 for IObay2) Internal None
External 1 Uplink 1 to ToR Switch (A for IObay1, B for IObay2) Fiber (multi-mode) 10GE Fiber
External 2 Uplink 2 to ToR Switch (A for IObay1, B for IObay2) Fiber (multi-mode) 10GE Fiber
External 3 Uplink 3 to ToR Switch (A for IObay1, B for IObay2) Fiber (multi-mode) 10GE Fiber
External 4 Uplink 4 to ToR Switch (A for IObay1, B for IObay2) Fiber (multi-mode) 10GE Fiber
External 5 Not Used None None
External 6 Not Used None None
External 7 Not Used None None
External 8 Not Used None None
Internal 17 Crosslink to IObay (2 for IObay1, 1 for IObay2) Internal None
Internal 18 Crosslink to IObay (2 for IObay1, 1 for IObay2) Internal None
Management OA Internal None

This section contains the point to point connections for the switches. The switches in the solution will follow the naming scheme of "Switch<series number>", i.e. Switch1, Switch2, etc; where Switch1 is the first switch in the solution, and switch2 is the second. These two form a redundant pair. The switch datasheet is linked here: https://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/datasheet-c78-736651.html.

The first switch in the solution will serve to connect each server's first NIC in their respective NIC pairs to the network. The next switch in the solution will serve to connect each server's redundant (2nd) NIC in their respective NIC pairs to the network.

Table B-12 ToR Switch Connections

Switch Port Name/ID (From) From Switch 1 to Destination From Switch 2 to Destination Cable Type Module Required
1 RMS 1, FLOM NIC 1 RMS 1, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
2 RMS 1, iLO RMS 2, iLO CAT 5e or 6A 1GE Cu SFP
3 RMS 2, FLOM NIC 1 RMS 2, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
4 RMS 3, FLOM NIC 1 RMS 3, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
5 RMS 3, iLO RMS 4, iLO CAT 5e or 6A 1GE Cu SFP
6 RMS 4, FLOM NIC 1 RMS 4, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
7 RMS 5, FLOM NIC 1 RMS 5, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
8 RMS 5, iLO RMS 6, iLO CAT 5e or 6A 1GE Cu SFP
9 RMS 6, FLOM NIC 1 RMS 6, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
10 RMS 7, FLOM NIC 1 RMS 7, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
11 RMS 7, iLO RMS 8, iLO CAT 5e or 6A 1GE Cu SFP
12 RMS 8, FLOM NIC 1 RMS 8, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
13 RMS 9, FLOM NIC 1 RMS 9, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
14 RMS 9, iLO RMS 10, iLO CAT 5e or 6A 1GE Cu SFP
15 RMS 10, FLOM NIC 1 RMS 10, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
16 RMS 11, FLOM NIC 1 RMS 11, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
17 RMS 11, iLO RMS 12, iLO CAT 5e or 6A 1GE Cu SFP
18 RMS 12, FLOM NIC 1 RMS 12, FLOM NIC 2 Cisco 10GE DAC Integrated in DAC
19 Enclosure 6, OA 1, Mngt Enclosure 6, OA 2, Mngt CAT 5e or 6A 1GE Cu SFP
20 Enclosure 6, IOBay 1, Port 17 Enclosure 6, IOBay 2, Port 17 Cisco 10GE DAC Integrated in DAC
21 Enclosure 6, IOBay 1, Port 18 Enclosure 6, IOBay 2, Port 18 Cisco 10GE DAC Integrated in DAC
22 Enclosure 6, IOBay 1, Port 19 Enclosure 6, IOBay 2, Port 19 Cisco 10GE DAC Integrated in DAC
23 Enclosure 6, IOBay 1, Port 20 Enclosure 6, IOBay 2, Port 20 Cisco 10GE DAC Integrated in DAC
24 Enclosure 5, OA 1, Mngt Enclosure 5, OA 2, Mngt CAT 5e or 6A 1GE Cu SFP
25 Enclosure 5, IOBay 1, Port 17 Enclosure 5, IOBay 2, Port 17 Cisco 10GE DAC Integrated in DAC
26 Enclosure 5, IOBay 1, Port 18 Enclosure 5, IOBay 2, Port 18 Cisco 10GE DAC Integrated in DAC
27 Enclosure 5, IOBay 1, Port 19 Enclosure 5, IOBay 2, Port 19 Cisco 10GE DAC Integrated in DAC
28 Enclosure 5, IOBay 1, Port 20 Enclosure 5, IOBay 2, Port 20 Cisco 10GE DAC Integrated in DAC
29 Enclosure 4, OA 1, Mngt Enclosure 4, OA 2, Mngt CAT 5e or 6A 1GE Cu SFP
30 Enclosure 4, IOBay 1, Port 17 Enclosure 4, IOBay 2, Port 17 Cisco 10GE DAC Integrated in DAC
31 Enclosure 4, IOBay 1, Port 18 Enclosure 4, IOBay 2, Port 18 Cisco 10GE DAC Integrated in DAC
32 Enclosure 4, IOBay 1, Port 19 Enclosure 4, IOBay 2, Port 19 Cisco 10GE DAC Integrated in DAC
33 Enclosure 4, IOBay 1, Port 20 Enclosure 4, IOBay 2, Port 20 Cisco 10GE DAC Integrated in DAC
34 Enclosure 3, OA 1, Mngt Enclosure 3, OA 2, Mngt CAT 5e or 6A 1GE Cu SFP
35 Enclosure 3, IOBay 1, Port 17 Enclosure 3, IOBay 2, Port 17 Cisco 10GE DAC Integrated in DAC
36 Enclosure 3, IOBay 1, Port 18 Enclosure 3, IOBay 2, Port 18 Cisco 10GE DAC Integrated in DAC
37 Enclosure 3, IOBay 1, Port 19 Enclosure 3, IOBay 2, Port 19 Cisco 10GE DAC Integrated in DAC
38 Enclosure 3, IOBay 1, Port 20 Enclosure 3, IOBay 2, Port 20 Cisco 10GE DAC Integrated in DAC
39 Enclosure 2, OA 1, Mngt Enclosure 2, OA 2, Mngt CAT 5e or 6A 1GE Cu SFP
40 Enclosure 2, IOBay 1, Port 17 Enclosure 2, IOBay 2, Port 17 Cisco 10GE DAC Integrated in DAC
41 Enclosure 2, IOBay 1, Port 18 Enclosure 2, IOBay 2, Port 18 Cisco 10GE DAC Integrated in DAC
42 Enclosure 2, IOBay 1, Port 19 Enclosure 2, IOBay 2, Port 19 Cisco 10GE DAC Integrated in DAC
43 Enclosure 2, IOBay 1, Port 20 Enclosure 2, IOBay 2, Port 20 Cisco 10GE DAC Integrated in DAC
44 Enclosure 1, OA 1, Mngt Enclosure 1, OA 2, Mngt CAT 5e or 6A 1GE Cu SFP
45 Enclosure 1, IOBay 1, Port 17 Enclosure 1, IOBay 2, Port 17 Cisco 10GE DAC Integrated in DAC
46 Enclosure 1, IOBay 1, Port 18 Enclosure 1, IOBay 2, Port 18 Cisco 10GE DAC Integrated in DAC
47 Enclosure 1, IOBay 1, Port 19 Enclosure 1, IOBay 2, Port 19 Cisco 10GE DAC Integrated in DAC
48 Enclosure 1, IOBay 1, Port 20 Enclosure 1, IOBay 2, Port 20 Cisco 10GE DAC Integrated in DAC
49 Mate Switch, Port 49 Mate Switch, Port 49 Cisco 40GE DAC Integrated in DAC
50 Mate Switch, Port 50 Mate Switch, Port 50 Cisco 40GE DAC Integrated in DAC
51 OAM Uplink to Customer OAM Uplink to Customer 40GE (MM or SM) Fiber 40GE QSFP
52 Signaling Uplink to Customer Signaling Uplink to Customer 40GE (MM or SM) Fiber 40GE QSFP
53 Unused Unused
54 Unused Unused
Management (Ethernet) RMS 1, NIC 2 (1GE) RMS 1, NIC 3 (1GE) CAT5e or CAT 6A None (RJ45 port)
Management (Serial) Unused Unused None None

Server quickspecs can be found here: https://h20195.www2.hpe.com/v2/getdocument.aspx?docname=a00008180enw

The HP DL380 Gen10 RMS will be configured with an iLO, a 4x1GE LOM, and a 2x10GE SFP+ FLOM.

  • iLO: The integrated Lights Out management interface (iLO) contains an ethernet out of band management interface for the server. This connection is 1GE RJ45.
  • 4x1GE LOM: For most servers in the solution, their 4x1GE LOM ports will be unused. The exception is the first server in the first frame. This server will serve as the management server for the ToR switches. In this case, the server will use 2 of the LOM ports to connect to ToR switches' respective out of band ethernet management ports. These connections will be 1GE RJ45 (CAT 5e or CAT 6).
  • 2x10GE FLOM: Every server will be equipped with a 2x10GE Flex LOM card (or FLOM). These will be for in-band, or application and solution management traffic. These connections are 10GE fiber (or DAC) and will terminate to the ToR switches' respective SFP+ ports.

All RMS in the frame will only use the 10GE FLOM connections, except for the "management server", the first server in the frame, which will have some special connections as listed below:

Table B-13 Management Server Connections

Server Interface Destination Cable Type Module Required Notes
Base NIC1 (1GE) Unused None None
Base NIC2 (1GE) Switch1A Ethernet Mngt CAT5e or 6a None Switch Initialization
Base NIC3 (1GE) Switch1B Ethernet Mngt CAT5e or 6a None Switch Initialization
Base NIC4 (1GE) Unused None None
FLOM NIC1 Switch1A Port 1 Cisco 10GE DAC Integrated in DAC OAM, Signaling, Cluster
FLOM NIC2 Switch1B Port 1 Cisco 10GE DAC Integrated in DAC OAM, Signaling, Cluster
USB Port1 USB Flash Drive None None Bootstrap Host Initialization Only (temporary)
USB Port2 Keyboard USB None Bootstrap Host Initialization Only (temporary)
USB Port3 Mouse USB None Bootstrap Host Initialization Only (temporary)
Monitor Port Video Monitor DB15 None Bootstrap Host Initialization Only (temporary)