Enclosure Connections
Blade Server Connections
OA Connections
Topology Connections
Enclosure Switch Connections
ToR Switch Connections
Rackmount Server Connections
The HP BL460 Gen10 Blade Server will have a base set of NICs that connect internally to the enclosure's IO bays 1 and 2. These connections are "hard-wired" and won't be documented here. Since no additional NICs are planned beyond the base pair of NICs, no further declarations of network connectivity on the blades needs mentioning. Blade specifications are linked here:
https://www.hpe.com/us/en/product-catalog/servers/proliant-servers/pip.specifications.hpe-proliant-bl460c-gen10-server-blade.1010025832.html.
The Enclosure's Onboard Administrator (OA) will be deployed as a redundant pair, with each connecting with 1GE copper connection to the respective ToR switches' SFP+ ports.
The HP 6127XLG switch (https://www.hpe.com/us/en/product-catalog/servers/server-interconnects/pip.hpe-6127xlg-blade-switch.8699023.html) will have 4x10GE fiber (or DAC) connections between it and ToR respective switches' SFP+ ports.
Table B-11 Enclosure Switch Connections
Switch Port Name/ID (From) | Destination (To) | Cable Type | Module Required |
---|---|---|---|
Internal 1 | Blade 1, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 2 | Blade 2, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 3 | Blade 3, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 4 | Blade 4, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 5 | Blade 5, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 6 | Blade 6, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 7 | Blade 7, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 8 | Blade 8, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 9 | Blade 9, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 10 | Blade 10, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 11 | Blade 11, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 12 | Blade 12, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 13 | Blade 13, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 14 | Blade 14, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 15 | Blade 15, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
Internal 16 | Blade 16, NIC (1 for IObay1, 2 for IObay2) | Internal | None |
External 1 | Uplink 1 to ToR Switch (A for IObay1, B for IObay2) | Fiber (multi-mode) | 10GE Fiber |
External 2 | Uplink 2 to ToR Switch (A for IObay1, B for IObay2) | Fiber (multi-mode) | 10GE Fiber |
External 3 | Uplink 3 to ToR Switch (A for IObay1, B for IObay2) | Fiber (multi-mode) | 10GE Fiber |
External 4 | Uplink 4 to ToR Switch (A for IObay1, B for IObay2) | Fiber (multi-mode) | 10GE Fiber |
External 5 | Not Used | None | None |
External 6 | Not Used | None | None |
External 7 | Not Used | None | None |
External 8 | Not Used | None | None |
Internal 17 | Crosslink to IObay (2 for IObay1, 1 for IObay2) | Internal | None |
Internal 18 | Crosslink to IObay (2 for IObay1, 1 for IObay2) | Internal | None |
Management | OA | Internal | None |
This section contains the point to point connections for the switches. The switches in the solution will follow the naming scheme of "Switch<series number>", i.e. Switch1, Switch2, etc; where Switch1 is the first switch in the solution, and switch2 is the second. These two form a redundant pair. The switch datasheet is linked here: https://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/datasheet-c78-736651.html.
The first switch in the solution will serve to connect each server's first NIC in their respective NIC pairs to the network. The next switch in the solution will serve to connect each server's redundant (2nd) NIC in their respective NIC pairs to the network.
Table B-12 ToR Switch Connections
Switch Port Name/ID (From) | From Switch 1 to Destination | From Switch 2 to Destination | Cable Type | Module Required |
---|---|---|---|---|
1 | RMS 1, FLOM NIC 1 | RMS 1, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
2 | RMS 1, iLO | RMS 2, iLO | CAT 5e or 6A | 1GE Cu SFP |
3 | RMS 2, FLOM NIC 1 | RMS 2, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
4 | RMS 3, FLOM NIC 1 | RMS 3, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
5 | RMS 3, iLO | RMS 4, iLO | CAT 5e or 6A | 1GE Cu SFP |
6 | RMS 4, FLOM NIC 1 | RMS 4, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
7 | RMS 5, FLOM NIC 1 | RMS 5, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
8 | RMS 5, iLO | RMS 6, iLO | CAT 5e or 6A | 1GE Cu SFP |
9 | RMS 6, FLOM NIC 1 | RMS 6, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
10 | RMS 7, FLOM NIC 1 | RMS 7, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
11 | RMS 7, iLO | RMS 8, iLO | CAT 5e or 6A | 1GE Cu SFP |
12 | RMS 8, FLOM NIC 1 | RMS 8, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
13 | RMS 9, FLOM NIC 1 | RMS 9, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
14 | RMS 9, iLO | RMS 10, iLO | CAT 5e or 6A | 1GE Cu SFP |
15 | RMS 10, FLOM NIC 1 | RMS 10, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
16 | RMS 11, FLOM NIC 1 | RMS 11, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
17 | RMS 11, iLO | RMS 12, iLO | CAT 5e or 6A | 1GE Cu SFP |
18 | RMS 12, FLOM NIC 1 | RMS 12, FLOM NIC 2 | Cisco 10GE DAC | Integrated in DAC |
19 | Enclosure 6, OA 1, Mngt | Enclosure 6, OA 2, Mngt | CAT 5e or 6A | 1GE Cu SFP |
20 | Enclosure 6, IOBay 1, Port 17 | Enclosure 6, IOBay 2, Port 17 | Cisco 10GE DAC | Integrated in DAC |
21 | Enclosure 6, IOBay 1, Port 18 | Enclosure 6, IOBay 2, Port 18 | Cisco 10GE DAC | Integrated in DAC |
22 | Enclosure 6, IOBay 1, Port 19 | Enclosure 6, IOBay 2, Port 19 | Cisco 10GE DAC | Integrated in DAC |
23 | Enclosure 6, IOBay 1, Port 20 | Enclosure 6, IOBay 2, Port 20 | Cisco 10GE DAC | Integrated in DAC |
24 | Enclosure 5, OA 1, Mngt | Enclosure 5, OA 2, Mngt | CAT 5e or 6A | 1GE Cu SFP |
25 | Enclosure 5, IOBay 1, Port 17 | Enclosure 5, IOBay 2, Port 17 | Cisco 10GE DAC | Integrated in DAC |
26 | Enclosure 5, IOBay 1, Port 18 | Enclosure 5, IOBay 2, Port 18 | Cisco 10GE DAC | Integrated in DAC |
27 | Enclosure 5, IOBay 1, Port 19 | Enclosure 5, IOBay 2, Port 19 | Cisco 10GE DAC | Integrated in DAC |
28 | Enclosure 5, IOBay 1, Port 20 | Enclosure 5, IOBay 2, Port 20 | Cisco 10GE DAC | Integrated in DAC |
29 | Enclosure 4, OA 1, Mngt | Enclosure 4, OA 2, Mngt | CAT 5e or 6A | 1GE Cu SFP |
30 | Enclosure 4, IOBay 1, Port 17 | Enclosure 4, IOBay 2, Port 17 | Cisco 10GE DAC | Integrated in DAC |
31 | Enclosure 4, IOBay 1, Port 18 | Enclosure 4, IOBay 2, Port 18 | Cisco 10GE DAC | Integrated in DAC |
32 | Enclosure 4, IOBay 1, Port 19 | Enclosure 4, IOBay 2, Port 19 | Cisco 10GE DAC | Integrated in DAC |
33 | Enclosure 4, IOBay 1, Port 20 | Enclosure 4, IOBay 2, Port 20 | Cisco 10GE DAC | Integrated in DAC |
34 | Enclosure 3, OA 1, Mngt | Enclosure 3, OA 2, Mngt | CAT 5e or 6A | 1GE Cu SFP |
35 | Enclosure 3, IOBay 1, Port 17 | Enclosure 3, IOBay 2, Port 17 | Cisco 10GE DAC | Integrated in DAC |
36 | Enclosure 3, IOBay 1, Port 18 | Enclosure 3, IOBay 2, Port 18 | Cisco 10GE DAC | Integrated in DAC |
37 | Enclosure 3, IOBay 1, Port 19 | Enclosure 3, IOBay 2, Port 19 | Cisco 10GE DAC | Integrated in DAC |
38 | Enclosure 3, IOBay 1, Port 20 | Enclosure 3, IOBay 2, Port 20 | Cisco 10GE DAC | Integrated in DAC |
39 | Enclosure 2, OA 1, Mngt | Enclosure 2, OA 2, Mngt | CAT 5e or 6A | 1GE Cu SFP |
40 | Enclosure 2, IOBay 1, Port 17 | Enclosure 2, IOBay 2, Port 17 | Cisco 10GE DAC | Integrated in DAC |
41 | Enclosure 2, IOBay 1, Port 18 | Enclosure 2, IOBay 2, Port 18 | Cisco 10GE DAC | Integrated in DAC |
42 | Enclosure 2, IOBay 1, Port 19 | Enclosure 2, IOBay 2, Port 19 | Cisco 10GE DAC | Integrated in DAC |
43 | Enclosure 2, IOBay 1, Port 20 | Enclosure 2, IOBay 2, Port 20 | Cisco 10GE DAC | Integrated in DAC |
44 | Enclosure 1, OA 1, Mngt | Enclosure 1, OA 2, Mngt | CAT 5e or 6A | 1GE Cu SFP |
45 | Enclosure 1, IOBay 1, Port 17 | Enclosure 1, IOBay 2, Port 17 | Cisco 10GE DAC | Integrated in DAC |
46 | Enclosure 1, IOBay 1, Port 18 | Enclosure 1, IOBay 2, Port 18 | Cisco 10GE DAC | Integrated in DAC |
47 | Enclosure 1, IOBay 1, Port 19 | Enclosure 1, IOBay 2, Port 19 | Cisco 10GE DAC | Integrated in DAC |
48 | Enclosure 1, IOBay 1, Port 20 | Enclosure 1, IOBay 2, Port 20 | Cisco 10GE DAC | Integrated in DAC |
49 | Mate Switch, Port 49 | Mate Switch, Port 49 | Cisco 40GE DAC | Integrated in DAC |
50 | Mate Switch, Port 50 | Mate Switch, Port 50 | Cisco 40GE DAC | Integrated in DAC |
51 | OAM Uplink to Customer | OAM Uplink to Customer | 40GE (MM or SM) Fiber | 40GE QSFP |
52 | Signaling Uplink to Customer | Signaling Uplink to Customer | 40GE (MM or SM) Fiber | 40GE QSFP |
53 | Unused | Unused | ||
54 | Unused | Unused | ||
Management (Ethernet) | RMS 1, NIC 2 (1GE) | RMS 1, NIC 3 (1GE) | CAT5e or CAT 6A | None (RJ45 port) |
Management (Serial) | Unused | Unused | None | None |
Server quickspecs can be found here: https://h20195.www2.hpe.com/v2/getdocument.aspx?docname=a00008180enw
The HP DL380 Gen10 RMS will be configured with an iLO, a 4x1GE LOM, and a 2x10GE SFP+ FLOM.
All RMS in the frame will only use the 10GE FLOM connections, except for the "management server", the first server in the frame, which will have some special connections as listed below:
Table B-13 Management Server Connections
Server Interface | Destination | Cable Type | Module Required | Notes |
---|---|---|---|---|
Base NIC1 (1GE) | Unused | None | None | |
Base NIC2 (1GE) | Switch1A Ethernet Mngt | CAT5e or 6a | None | Switch Initialization |
Base NIC3 (1GE) | Switch1B Ethernet Mngt | CAT5e or 6a | None | Switch Initialization |
Base NIC4 (1GE) | Unused | None | None | |
FLOM NIC1 | Switch1A Port 1 | Cisco 10GE DAC | Integrated in DAC | OAM, Signaling, Cluster |
FLOM NIC2 | Switch1B Port 1 | Cisco 10GE DAC | Integrated in DAC | OAM, Signaling, Cluster |
USB Port1 | USB Flash Drive | None | None | Bootstrap Host Initialization Only (temporary) |
USB Port2 | Keyboard | USB | None | Bootstrap Host Initialization Only (temporary) |
USB Port3 | Mouse | USB | None | Bootstrap Host Initialization Only (temporary) |
Monitor Port | Video Monitor | DB15 | None | Bootstrap Host Initialization Only (temporary) |