1. Extending and Multi-Rack Cabling Guide
  2. Extending the Hardware
  3. Extending Elastic Configurations
  4. Adding New RDMA Network Fabric Switches
  5. Adding a RoCE Network Fabric Switch (Cisco Nexus 9336C-FX2)

2.2.2.1 Adding a RoCE Network Fabric Switch (Cisco Nexus 9336C-FX2)

This procedure only applies to systems with Cisco Nexus 9336C-FX2 RoCE Network Fabric switches.

Note:

The steps in this procedure are specific to Oracle Exadata. They are not the same as the steps in the Cisco Nexus manual.

  1. Unpack the Cisco Nexus switch components from the packing cartons. The following items should be in the packing cartons:

    • Cisco Nexus 9336C-FX2 Switch

    • Cable bracket and rack-mount kit

    • Cable management bracket and cover

    • Two rack rail assemblies

    • Assortment of screws and captive nuts

    • Cisco Nexus 9336C-FX2 Switch documentation

    The service label procedure on top of the switch includes descriptions of the preceding items.

  2. Remove the trough from the rack in RU1. Put the cables aside while installing the RoCE Network Fabric switch. The trough can be discarded.

  3. Install cage nuts in each rack rail in the appropriate holes.

  4. Attach the brackets with cutouts to the power supply side of the switch.

  5. Attach the C-brackets to the switch on the side of the ports.

  6. Slide the switch halfway into the rack from the front. Keep the switch to the left side of the rack as far as possible while pulling the two power cords through the C-bracket on the right side.

  7. Slide the server in rack location U2 out to the locked service position. This improves access to the rear of the switch during further assembly.

  8. Install the slide rails from the rear of the rack into the C-brackets on the switch, pushing them up to the rack rail.

  9. Attach an assembled cable arm bracket to the slide rail and using a No. 3 Phillips screwdriver, screw these together into the rack rail:

    1. Install the lower screw loosely with the cable arm bracket rotated 90 degrees downward. This allows better finger access to the screw.

    2. Rotate the cable arm bracket to the correct position.

    3. Install the upper screw.

    4. Tighten both screws.

    If available, a screwdriver with a long-shaft (16-inch / 400mm) will allow easier installation such that the handle is outside the rack and beyond the cabling.

  10. Push the switch completely into the rack from the front, routing the power cords through the cutout on the rail bracket.

  11. Secure the switch to the front rack rail with M6 16mm screws. Tighten the screws using the No. 3 Phillips screwdriver.

  12. Install the lower part of the cable management arm across the back of the switch.

  13. Connect the cables to the appropriate ports.

  14. Install the upper part of the cable management arm.

  15. Slide the server in rack location U2 back into the rack.

  16. Install power cords to the switch power supply slots on the front.

  17. Loosen the front screws to install the vented filler panel brackets. Tighten the screws, and snap on the vented filler panel in front of the switch.

See Also:

Parent topic: Adding New RDMA Network Fabric Switches