Go to main content

Sun Datacenter InfiniBand Switch 36 Product Notes for Firmware Version 2.2

Exit Print View

Updated: October 2019
 
 

Replace a Switch

This procedure briefly outlines the steps to replace a switch within an InfiniBand fabric. Refer to the Sun Datacenter InfiniBand Switch 36 Service Manual for Firmware Version 2.1, the Sun Datacenter InfiniBand Switch 36 Administration Guide for Firmware Version 2.1, and the Sun Datacenter InfiniBand Switch 36 Installation Guide for Firmware Version 2.1 for more information. This procedure assumes that a secret M_Key policy is in use and the fabric is partitioned.

  1. Set the priority of the switch to be removed to the lowest.

    Wait for any handover to complete.

  2. Create a backup of the switch configuration for the switch to be removed.
  3. Completely power off the switch.
  4. Remove the switch from the fabric and management network.
  5. Install and power on the replacement switch, but do not connect it to the fabric or the fabric's management network.
  6. Configure the replacement switch with the same host name, IP address, as the switch removed.
  7. Restore the switch configuration previously backed up.
  8. Readout and store the SM priority from the restored switch configuration using setsmpriority list and then set the SM priority to the lowest in the Infiniband Subnet.
  9. Completely power off the replacement switch.
  10. Connect the replacement switch to the fabric's management network and the fabric.
  11. Power on the replacement switch.

    Wait for any negotiation and propagation to complete.

  12. Setup the smnodes list and fabric configuration file for the replacement switch, and ensure that the list and file are consistent with other switch and gateway lists and files.
  13. Perform a smpartition start and smpartition commit from the master Subnet Manager.

    Wait for the partition configuration to propagate to the replacement switch.

  14. Perform a smsubnetprotection start and smsubnetprotection commit from the master Subnet Manager.

    Wait for the secret M_Key policy to propagate to the replacement switch.

  15. Set the priority of the replacement switch to that originally of the removed switch.

    Wait for any handover to complete.