Skip Navigation Links | |
Exit Print View | |
Sun Datacenter InfiniBand Switch 36 Product Notes for Firmware Version 2.0 |
1. Sun Datacenter InfiniBand Switch 36 Product Notes
Hardware Information and Issues
Service an Undervoltage Condition
Software Information and Issues
Main Board, Management Controller, and Chassis Serial Numbers
Firmware Update Considerations
When partitioning the InfiniBand fabric with the smpartition command, consider these guidelines during the configuration session:
Valid P_Keys for partitioning are 0x1 through 0x7fff. However, both 0x1 and 0x7fff are predefined P_Keys and cannot be created or deleted with the smpartition command.
Default entries (ports) in the predefined partitions cannot be removed. However, when you add ports into the predefined partitions using the smpartition add command, the added ports take precedence over the default ALL_SWITCHES and ALL_CAS port groupings.
The SELF and ALL port groupings are not supported by the smpartition command. To specify all ports for a partition use the ALL_SWITCHES port grouping in conjuction with the ALL_CAS port grouping in the smpartition add command.
To remove the ipoib flag from a partition, use the smpartition modify -flag command without any additional arguments. The command removes the ipoib flag successfully, but erroneously issues this warning:
Missing port parameter
Could not modify partition.
If there is a Sun Network QDR InfiniBand Gateway Switch in your subnet, consider this – If you use EoIB and VNIC functionality in a nondefault partition, you must specify the appropriate BridgeX chips' InfiniBand port GUIDs of the gateway to the partition.
When you know the VNIC's Ethernet connector, this table provides the respective BridgeX chip's portname.
|
When you know the Portname, you can look in the output of the showgwports command for the respective PortGUID. Using the table and the showgwports command together, when you know the Ethernet connectors used for your VNICs, you can find the respective BridgeX chip's InfiniBand port GUIDs to add to the nondefault partition.
To receive a copy of the latest Declaration of Conformity for the switch, either contact your local Oracle sales representative or create an online request at the following URL:
https://www2.sun.de/dct/forms/reg_us_1607_755_0.jsp
In sections of Switch Remote Management, authentication and privacy passwords are described for SNMP service user accounts and SNMP V3 protocol commands. For the user accounts and commands, the MD5 and SHA authentication passwords are 8 to 12 characters in length, and the DES privacy password must be exactly 8 characters long.
In Switch Remote Management, firmware version numbers are provided as x.y, x.y.z, and x.y.z-w. Currently, these numbers are 2.0, 2.0.8, and 2.0.8-1 respectively. The following two procedures describe how to acquire and upgrade the firmware through the Oracle ILOM CLI.
Note - The switch must have atleast version 1.1.3 firmware installed before the two following procedures can be used. Refer to Switch Remote Management, installing the firmware, for more information.
Oracle's My Oracle Support page is displayed.
The dashboard page is displayed.
Note - If you do not have an account, you must register.
The Patches and Updates page is displayed.
The Patch Search window updates.
The Patch Search window updates.
Where x.y.z is the version number of the firmware package to be acquired. For example, 2.0.8.
The Patch Search window expands with the search results.
For example, 16294964. The Patch Search window reformats.
The File Download window opens.
For example, p16294964_208_Generic.zip.
The file is downloaded and saved.
The firmware is in the SUN_DCS_36p_x.y.z.tar.gz file.
The README file contains the latest information about the firmware release.
$ gtar -zxvf SUN_DCS_36p_x.y.z.tar.gz
The extracted files are displayed.
Note - If you are going to downgrade the firmware to a version earlier than 2.0, you must remove user partitions and depopulate the Subnet Manager nodes list. Refer to Switch Administration, removing partitions for firmware downgrade.
For example:
% ssh -l root switch_name root@switch_name's password: password #
where switch_name is the host name of the management controller. Initially, the password is changeme.
# disablesm Stopping partitiond daemon. [ OK ] Stopping IB Subnet Manager.. [ OK ] #
# df -h / Filesystem Size Used Avail Use% Mounted on /dev/hda2 471M 276M 172M 62% / #
In this example, there are 172 MB available. If not enough space is available, you must delete or move files from the / filesystem.
# df -h /tmp Filesystem Size Used Avail Use% Mounted on tmpfs 250M 240K 249M 1% /tmp #
In this example, there are 249 MB available. If not enough space is available, you must delete files from the /tmp directory.
# free -m total used free shared buffers cached Mem: 498 104 393 0 12 47 -/+ buffers/cache: 45 453 Swap: 0 0 0 #
In the -/+ buffers/cache: row of the free column, there should be at least 120 MB free memory. In this example, there are 453 MB available. If not enough memory is available, you must exit nonessential applications that are running.
# spsh Oracle(R) Integrated Lights Out Manager Version ILOM 3.0 r47111 Copyright (c) 2010, Oracle and/or its affiliates. All rights reserved. ->
You are now in the Oracle ILOM shell.
You can use the exit command to return to the Linux shell.
-> load -source URI/pkgname
where:
URI is the uniform resource indicator for the host where the switch firmware package is located. The FTP and HTTP protocols are supported.
pkgname is the name of the firmware package in the transfer directory.
For example, using the FTP protocol:
-> load -source ftp://root:changeme@123.45.67.99//tmp/sundcs_36p_repository_2.0.8_1.pkg Downloading firmware image. This will take a few minutes.
Note - If you are upgrading from firmware version 2.0.X, you can use the -force option to disable version number checking, and force the upgrade.
The firmware is downloaded. The upgrade begins. A caution is displayed, and you are asked to commit to the upgrade.
NOTE: Firmware upgrade will upgrade firmware on SUN DCS 36p firmware. ILOM will enter a special mode to load new firmware. No other tasks should be performed in ILOM until the firmware upgrade is complete. Are you sure you want to load the specified file (y/n)?
The upgrade begins.
Setting up environment for firmware upgrade. This will take few minutes. Starting SUN DCS 36p FW update ========================== Performing operation: I4 A ========================== I4 fw upgrade from 7.3.0(INI:4) to 7.4.1010(INI:4): Upgrade started... Upgrade completed. INFO: I4 fw upgrade from 7.3.0(INI:4) to 7.4.1010(INI:4) succeeded =========================== Summary of Firmware update =========================== I4 status : FW UPDATE - SUCCESS I4 update succeeded on : A I4 already up-to-date on : none I4 update failed on : none ========================================== Performing operation: SUN DCS 36p firmware update ========================================== SUN DCS 36p upgrade from 1.3.3-2 to 2.0.8-1: Upgrade started... Upgrade completed. INFO: SUN DCS 36p upgrade from 1.3.3-2 to 2.0.8-1 succeeded Firmware update is complete. ILOM will be restarted and will take 2 minutes to come up. You will need to reconnect to Integrated Lights Out Manager. Stopping any already executing ILOM daemons Starting event manager Starting log manager Starting ILOM IPMI stack Started ILOM IPMI stack Starting lumain Starting luproxy Starting ealertd Starting web server Starting SNMP #
Refer to Switch Administration, restarting the entire switch.
Note - The restart process takes between 4 to 5 minutes to complete. The Oracle ILOM stack requires at least 2 minutes to become operational after a reboot.
% ssh -l ilom-admin switch_name ilom-admin@switch_name's password: password -> show /SP/Fabric_Mgmt NOTE: show on Fabric_Mgmt will launch a restricted Linux shell. User can execute switch diagnosis, SM Configuration and IB monitoring commands in the shell. To view the list of commands, use "help" at rsh prompt. Use exit command at rsh prompt to revert back to ILOM shell. FabMan@switch_name->enablesm Starting IB Subnet Manager. [ OK ] Starting partitiond daemon. [ OK ] FabMan@switch_name->
FabMan@switch_name->version SUN DCS 36p version: 2.0.8-1 Build time: Feb 6 2013 09:09:09 SP board info: Manufacturing Date: 2009.12.08 Serial Number: "NCD4I0133" Hardware Revision: 0x0006 Firmware Revision: 0x0102 BIOS version: NOW1R112 BIOS date: 04/24/2009 FabMan@switch_name->
In the first line of the output is SUN DCS 36p version x.y.z-w, where x.y.z-w is the version of the firmware upgraded (or downgraded). For example, 2.0.8-1.
FabMan@switch_name->fwverify Checking all present packages: ........................................................................... OK Checking if any packages are missing: ........................................................................... OK Verifying installed files: ........................................................................... OK FabMan@switch_name->