| Sun Blade X6275 Server Module Product Notes |    
|
| Sun Blade X6275 Server Module Product Notes |
|
| C H A P T E R 2 |
Hardware, Firmware, and BIOS Notes and Issues |
This chapter contains the following sections describing hardware, firmware and BIOS issues that apply to the Sun Blade X6275 server module:
Extra attention must be paid to flash modules when they are inserted or removed with the blades or when powering the chassis on/off. The following rules must be followed.
|
Caution - Damage to the flash module can occur if the FMOD is installed (while the green LED is lit) and the flash modules might not be recognized by the host nodes. |
The recommended setup and power-on method for the Sun Blade 6000/6048 System Module chassis with X6275 server modules is different depending on whether you are starting with an empty system chassis, or a pre-configured system chassis. Follow the recommended procedure for your installation as described below.
|
|
1. Before installing server blades, make sure that all of the chassis components are installed (power supplies, fans, NEMs, EMs, etc.).
2. Connect required I/O cables for the chassis (Ethernet, InfiniBand, etc.).
3. Install and fully seat Blade 0.
4. Attach all six AC power cables from the system chassis power interface module to a power source.
The chassis automatically applies main power to all blades in the chassis after power is provided to the power supplies. Ensure that all power LEDs are lit.
5. Set up your CMM IP address with a DHCP/Static address.
6. Verify the CMM network and check/setup the blade SP network.
7. Install other blades with a 30 second interval between each blade insertion.
For example, after Blade 0 has been powered, wait 30 seconds. Then install and fully seat Blade 1 and wait 30 seconds for them to power on.
Then install and fully install Blade 2 and wait 30 seconds for them to power-on. Repeat the process until all blades are installed.
8. Verify that no fault (amber) LEDs are lit on blade or chassis components (CMM, PSU, blades, etc.).
If fault LEDs are lit, follow the troubleshooting procedures described in the system Diagnostics Guide and refer to the Product Notes for any known issues.
|
|
1. Connect required I/O cables for the chassis (Ethernet, InfiniBand, etc.).
2. Attach all six AC power cables from the system chassis power interface module to a power source.
The chassis automatically applies main power to all modules in the chassis after power is provided to the power supplies. Ensure that all power LEDs are lit.
3. Wait five minutes for the CMM to boot and then verify/setup the CMM network.
4. Login to the CMM CLI, check/setup the blade SP network and verify the MAC address and collect the SP IP address for each node by entering the show command from the CMM CLI prompt. For example:
For any node that does not display network information, reseat the blade, wait 5 minutes, and recheck the SP network information.
5. Verify that no fault (amber) LEDs are lit on blade or chassis components (CMM, PSU, blades, etc.), and that the blades are showing normal operation:
For any host that does not boot, reseat the blade.
In the Sun Blade 6048 System Module chassis, there are two PCI EM slots assigned to each blade slot. The slots are numbered PCI EM 0.0 to 11.1 right to left as viewed from the rear of the chassis and assigned to blade slots as shown below:
When the Sun Blade X6275 server module is installed in a blade slot, its two PCI EM slots are assigned as follows:
Where x represents the slot number in which the blade is installed.
Due to an issue with the Memory Reference Code (MRC), if a DIMM fails, the system might flag the wrong DIMM as the failing DIMM. This misidentification can happen to DIMMs that reside on the same channel as the faulty DIMM.
Workaround: If the system error log or FMA utilities show multiple DIMM failures in the same channel, do the following:
1. Remove both of the DIMMs flagged as failing from the system.
Refer to the Service Manual for more information on removing DIMMs.
2. Install one of the DIMMs in an alternate channel (that has shown no errors).
Each processor has three memory channels with two slots per channel (for example, D0/D1 is a channel, D2/D3 is a channel, and D4/D5 is a channel).
3. Reboot the system and look for DIMM errors.
4. If DIMM failures now occur on the alternate channel, the DIMM you installed is faulty and must be relpaced.
5. If there are no errors on the alternate channel, the DIMM you installed is good and the other DIMM is faulty and must be replaced.
If you have a Sun Blade X6275 server module with onboard InfiniBand that has, for example, a network issue, it might be difficult to identify a faulty device if you have other similar devices on the node’s pci bus.
When using a unix-based tool such as lspci at the host to find connected PCI devices, output can be interpreted as follows:
The following firmware and BIOS features and issues apply to the Sun Blade X6275 server module.
There are extra options available in the BIOS Set Up Menu to Enable/Disable any available USB Ports.
| Note - This feature is available in BIOS version 10.0.39.0 or later. |
Security vulnerabilities in the BIOS might allow a local privileged user who has the ability to run fully privileged code to gain access to the CPU’s System Management Mode.
| Note - This issue is fixed in BIOS version 10.0.39.0 or later. |
On rebooting the system, the Sun StorageTek card occasionally disappears from BIOS and can no longer be used.
Workaround: Power cycle the blade. When the blade powers back on, the card should be visible again.
In rare instances, after power cycling a Sun Blade X6275 server module node, the system might not be able to find the Flash Modules (FMODs). If the flash module is the boot device with an installed operating system, the system will fail to boot.
Workaround: If you encounter this problem, remove and reinsert the blade into the blade chassis. After removing the blade from the chassis, you must wait for at least 20 seconds before reinserting the blade. If you do not, the flash modules might not be recognized by the host nodes.
The Sun Blade X6275 system BIOS does not have enough memory space to load the option ROM code for Fibre Channel Express Module cards and the dual-function Fibre Channel Express Module cards. This means you cannot boot the system from these devices. If this happens, you will receive the following BIOS error:
Not enough Space to copy PCI Option ROM
| Note - This issue is fixed in BIOS version 10.0.28.0 or later. |
The Sun Blade X6275 system service processor ILOM did not support the Set SEL time command. Therefore, BIOS could not send the RTC time to service processor. BIOS has been changed in parallel with the new fix in service processor ILOM.
| Note - This issue is fixed in BIOS version 10.0.39.0 or later. |
After upgrading ILOM/SP firmware for the server, you might not be able to view CPU and/or DIMM FRU data through ILOM. This issue can occur after any ILOM upgrade if the set reset_to_defaults=factory command is issued to reset the SP while the host still powered on.
Workaround: To clear this condition, power off the host (from ILOM, issue the stop /SYS command) and then reset SP.
If the firmware you are upgrading to includes a new CPLD (Complex Programmable Logic Device) version, you must power off the server module nodes and reseat the blade in the chassis for the server to use the new CPLD code.
See Firmware Versions for firmware release information.
If your Sun Blade X6275/X6275 M2 server module is running BIOS version 10.2.6.0, the PCIe EM bus speed is reduced to PCIe Gen1 speeds. This issue only affects the Dual Port Quad Data Rate (QDR) InfiniBand HCA PCIe EM card. Other supported PCIe EM cards run at lower speeds and are therefore not affected.
There is currently no workaournd for this issue. If you have a Sun Blade X6275 or X6275 M2 server module with a BIOS version lower than 10.2.6.0 and are using the Dual Port Quad Data Rate (QDR) InfiniBand HCA PCIe EM card, do not upgrade the server BIOS to a later version until a fix is available.
| Sun Blade X6275 Server Module Product Notes | E20849-04 |
|
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Setup and Power-on Recommendations With an Empty System Chassis