Configuring an InfiniBand Switch

The default identifier for leaf switch 1 in U20 is iba, and for leaf switch 2 in U22 is ibb.

To configure a Sun Datacenter InfiniBand Switch 36 switch:

1. For a one-rack installation, unplug the InfiniBand cable from Port 8B on the InfiniBand leaf switches. Use hook-and-loop tape to hang it out of the way.

   This cable is preinstalled for a connection to the spine switch in a multirack installation. However, in a one-rack installation, the monitoring software might show it as a down link.

2. Connect a serial cable between your laptop and the InfiniBand switch USB serial adapter. Use these terminal settings, as needed:

   TERM=vt100; export TERM
   

3. Log in to Oracle ILOM:

   localhost: ilom-admin
   password: welcome1
   

4. Ensure that the firmware version is 2.1.5-1 or later:

   -> version
   

   If the switch has a lower version than 2.1.5-1, then contact Oracle Support Services.

5. Set the switch host name, without the domain name. The following example assigns the name ra1sw to the first gateway switch (iba):

   -> set /SP hostname=ra1sw-iba
   -> show /SP hostname
   /SP
   Properties:
   hostname = ra1sw-iba
   

   See the Installation Template for the name of the switch.

6. Set the DNS server and domain names. In the following syntax, IP_addresses can have up to three IP addresses, separated by commas, in the preferred search order.

   -> set /SP/clients/dns auto_dns=enabled
   -> set /SP/clients/dns nameserver=IP_addresses
   -> set /SP/clients/dns searchpath=domain_name
   

7. Verify the settings:

   -> show /SP/clients/dns
   /SP/clients/dns
   Targets:
   Properties:
   auto_dns = enabled
   nameserver = 10.196.23.245, 138.2.202.15
   retries = 1
   searchpath = example.com
   timeout = 5
        .
        .
        .
   

8. Configure the switch management network settings. In the following commands, pending_ip, pending_gw, and pending_nm are IP addresses defined by the network administrator:

   -> cd /SP/network
   -> set pendingipaddress=pending_ip
   -> set pendingipgateway=pending_gw
   -> set pendingipnetmask=pending_nm
   -> set pendingipdiscovery=static
   -> set commitpending=true
   

9. Verify the settings:

   -> show
   /SP/network
   Targets:
   test
   Properties:
   commitpending = (Cannot show property)
   dhcp_server_ip = none
   ipaddress = 10.196.16.152
   ipdiscovery = static
   ipgateway = 10.196.23.254
   ipnetmask = 255.255.248.0
   macaddress = 00:E0:4B:38:77:7E
   pendingipaddress = 10.196.16.152
   pendingipdiscovery = static
   pendingipgateway = 10.196.23.254
   pendingipnetmask = 255.255.248.0
   state = enabled
        .
        .
        .
   

10. If any of the values are wrong, repeat the set pendingipparameter command, and then the commitpending=true command.