C H A P T E R  2

Hardware Installation and Removal

The Sun StorageTek ExpressModule SAS HBA is packaged in a single-wide PCI ExpressModule. This chapter explains how to install the HBA in a PCI Express slot of an ExpressModule-compliant enclosure. You do not need to turn off system power or disconnect power cords during the installation, since these enclosures fully support hot-plugging.

This chapter contains the following topics:


Observing ESD and Handling Precautions



caution icon Caution - Damage to the HBA can occur as the result of careless handling or electrostatic discharge (ESD). Always handle the HBA with care to avoid damage to electrostatic sensitive components.


To minimize the possibility of ESD-related damage, use both a workstation antistatic mat and an ESD wrist strap. You can get an ESD wrist strap from any reputable electronics store or from Sun as part number #250-1007.

Observe the following precautions to avoid ESD-related problems:


Installing the HBA

Before you start, read the instructions in this section as well as the installation instructions for the storage devices to be connected to the HBA. This section contains the following topics:


procedure icon  To Prepare for Hardware Installation

1. Read and observe the safety information for this product.

See Safety Agency Compliance Statements.

2. Unpack the box containing the HBA in a static-free environment and inspect it for damage.



Note - Leave the HBA in the protective bag until you are ready to install it. If there is damage, contact Sun customer support.



procedure icon  To Install the HBA

1. Remove the cover from the system’s chassis.

2. Attach an antistatic wrist strap.

See Observing ESD and Handling Precautions.

3. Grasp the button at the top of the ejection lever on the front of the HBA and pivot the lever downwards.

4. Insert the HBA into an available PCI Express slot in the ExpressModule-compliant enclosure, as shown in FIGURE 2-1.

FIGURE 2-1 Installing the HBA into a PCI-E Slot


Figure shows installing the host adapter board into a PCI Express slot .



Note - The configuration of the enclosure may not be the same as shown in this illustration.


5. When the HBA is fully inserted in the slot, pivot the ejection lever up to the locked position.

6. Connect SAS cables to the two external x4 mini-SAS connectors and attach them to disk drives or other SAS/SATA devices, per your requirements.

Use only Sun-provided SAS cables (530-3887-01), available for purchase at http://www.sun.com..

The HBA hardware installation is complete.


LEDs

The HBA has six LEDs that are visible on the end of the HBA. FIGURE 2-2 shows the external connectors and LEDs.

FIGURE 2-2 External Connectors and LEDs


Figure showing the LEDs on the HBA

The LEDs next to each mini-SAS connector adapter are green for Activity and yellow for Fault for the 4 PHYs associated with each SAS connector. The yellow Attention LED and green Power LED are next to the Attention button.

The states of the Attention and Power LEDs are listed in TABLE 2-1

 


TABLE 2-1 Attention and Power LEDs

State

Meaning

Attention LED

Off

Operations are normal.

On

There are operational problems at the slot.

Blinking

The slot is being identified at the user’s request.

Power LED

Off

Insertion or removal of the HBA is permitted.

On

Insertion or removal of the HBA is not permitted.

Blinking

Removal of the HBA is not permitted because a hot-plug operation is in progress.



Testing the HBA Installation

This section describes the various ways to test the installation in a Solaris enviroment. This section contains the following topics:


procedure icon  To Test the Installation Using the SPARC OBP probe-scsi-all Command



Note - This procedure is not valid in a Solaris 10 for x64/x86 environment. Instead, use the format command to verify the installation of the HBA before attempting to use it in a Solaris 10 for x64/x86 environment. See To Test the Installation Using the Solaris format Command.


1. Bring the system down to the ok prompt at run level 0.



Note - If the host starts to reboot, interrupt the reboot process by pressing the Stop and A keys simultaneously.


2. At the ok prompt, use the probe-scsi-all command to verify that the system recognizes the HBA.

The probe-scsi-all command displays the SCSI devices that are connected to the host, as shown in the following screen example.


ok probe-scsi-all
/pci@7c0/pci@0/pci@1/pci@0,2/LSILogic,sas@2
MPT Version 1.05, Firmware Version 1.06.00.00
Target 0
  Unit 0   Disk     FUJITSU MAY2073RCSUN72G 0401    143374738 Blocks, 73 GB
  SASAddress 500000e0118dd3e2  PhyNum 0
Target 1
  Unit 0   Disk     FUJITSU MAY2073RCSUN72G 0401    143374738 Blocks, 73 GB
  SASAddress 500000e0115c3ec2  PhyNum 1
 
/pci@780/pci@0/pci@8/LSILogic,sas@0
MPT Version 1.05, Firmware Version 1.18.00.00
Target 1
  Unit 0   Disk     SUN     LCSM100_S       9617    2048000 Blocks, 1048 MB
  Unit 1   Disk     SUN     LCSM100_S       9617    2457600 Blocks, 1258 MB
  SASAddress 500a0b82804a8008  PhyNum 0

This example shows two SAS controllers. The first (sas@2) is the SAS controller resident on the motherboard. The second SAS controller (sas@0) has one disk drive connected (Target 1). The disk consists of two logical unit numbers (LUNs), Unit 0 and Unit 1.


procedure icon  To Test the Installation Using the Solaris format Command

Use the following procedure to test the HBA installation using the format command on the Solaris 10 for x64/x86 platform.

1. Become a root user and use the format command.


# format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
	0. c1t0d0 <DEFAULT cyl 24611 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@a/pci17c2,10@4/sd@0,0
	1. c1t1d0 <DEFAULT cyl 24810 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@a/pci17c2,10@4/sd@1,0
	2. c3t8d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@8,0
	3. c3t9d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@9,0
	4. c3t10d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@a,0
	5. c3t11d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@b,0
	6. c3t12d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@c,0
	7. c3t13d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@d,0
Specify disk (enter its number): 

2. When prompted, type the number of the disk drive that is attached to the HBA card you just installed and press Enter.


# format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
	0. c1t0d0 <DEFAULT cyl 24611 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@a/pci17c2,10@4/sd@0,0
	1. c1t1d0 <DEFAULT cyl 24810 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@a/pci17c2,10@4/sd@1,0
	2. c3t8d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@8,0
	3. c3t9d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@9,0
	4. c3t10d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@a,0
	5. c3t11d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@b,0
	6. c3t12d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@c,0
	7. c3t13d0 <DEFAULT cyl 24619 alt 2 hd 27 sec 107>
		/pci@0,0/pci1022,7450@b/pci1000,10c0@1,1/sd@d,0
Specify disk (enter its number): 2
selecting c3t8d0
[disk formatted]

The Format menu is displayed.

3. Type analyze to select the type of test.


FORMAT MENU:
	disk	- select a disk
	type	- select (define) a disk type
	partition	- select (define) a partition table
	current	- describe the current disk
	format	- format and analyze the disk
	fdisk	- run the fdisk program
	repair	- repair a defective sector
	label	- write label to the disk
	analyze	- surface analysis
	defect	- defect list management
	backup	- search for backup labels
	verify	- read and display labels
	save	- save new disk/partition definitions
	inquiry	- show vendor, product and revision
	scsi	- independent SCSI mode selects
	cache	- enable, disable or query SCSI disk cache
	volname	- set 8-character volume name
	!<cmd>	- execute <cmd>, then return
	quit
format> analyze

4. Type read to further define the type of test, and then type y to continue.


ANALYZE MENU:
	read	- read only test (doesn’t harm SunOS)
	refresh	- read then write (doesn’t harm data)
	test	- pattern testing (doesn’t harm data)
	write	- write then read (corrupts data)
	compare	- write, read, compare (corrupts data)
	purge	- write, read, write (corrupts data)
	verify	- write entire disk, then verify (corrupts data)
	print	- display data buffer
	setup	- set analysis parameters
	config	- show analysis parameters
	!<cmd>	- execute <cmd> , then return
	quit
analyze> read
Ready to analyze (won’t harm SunOS). This takes a long time, 
but is interruptable with CTRL-C. Continue? y
pass 1
   
Total of 0 defective blocks repaired.
analyze>

5. Verify that no error occurred, as indicated by the output line Total of 0 defective blocks repaired.

6. Contact your service provider if an error occurs.

7. Type q twice to quit the test and the Format menu.


analyze> q
FORMAT MENU:
	 disk	 - select a disk
	 type	 - select (define) a disk type
	 partition	 - select (define) a partition table
	 current	 - describe the current disk
	 format	 - format and analyze the disk
	 fdisk	 - run the fdisk program
	 repair	 - repair a defective sector
	 label	 - write label to the disk
	 analyze	 - surface analysis
	 defect	 - defect list management
	 backup	 - search for backup labels
	 verify	 - read and display labels
	 save	 - save new disk/partition definitions
	 inquiry	 - show vendor, product and revision
	 scsi	 - independent SCSI mode selects
	 cache	 - enable, disable or query SCSI disk cache
	 volname	 - set 8-character volume name
	 !<cmd>	 - execute <cmd>, then return
	 quit
format> q
# 

The Sun StorageTek ExpressModule SAS HBA is ready for use.


procedure icon  To Test the Installation Using the SunVTS Software

Use the SunVTS software to test a disk on a newly attached disk array to verify that the HBA is properly installed.

For details about running the SunVTS software, refer to the SunVTS 6.X User’s Guide and the SunVTS 6.X Test Reference Manual.



Note - Refer to the SunVTS documentation to determine whether the host platform is supported.


1. As superuser, open the SunVTS window.


# /opt/SUNWvts/bin/sunvts

2. From the System Map, select a disk drive that is in an array connected to the HBA.

3. Start the disk test.

4. Verify that no errors have occurred by checking the SunVTS status window.



Note - If problems occur, contact your service provider for assistance.


5. If no problems occur, stop the SunVTS software.

The HBA is now ready to run applications.


Booting Through the HBA

The Sun StorageTek ExpressModule SAS HBA uses the Solaris mpt device driver, which is included with Solaris patches 125082-16 (x64) and 125081-16 (SPARC). The patches are available for download at http://sunsolve.sun.com..


procedure icon  To Boot an x86 Server From an External Disk Drive

1. Initiate a system boot.

The BIOS initialization screen is displayed.

2. Immediately press Control-C.

The LSI Logic MPT SCSI Setup Utility menu is displayed.


In this example, the first line (SAS1064) is the SAS controller that is resident on the motherboard. The HBA (SAS1068) is installed in PCI Express slot 01.

3. To change the boot options, use the arrow keys to move the grey highlighted field to the Boot Order field and use the following keys.


Key

Function

Insert

Enable booting

Del

Disable booting

Plus (+)

Increase the numeric value to change the boot order

Minus (-)

Decrease the numeric value to change the boot order


4. To change other options, move the grey highlighted field to the appropriate HBA, and press Enter.

Details for the selected adapter are displayed, as shown in the following example.


5. To view the devices attached to this adapter, highlight SAS Topology and press Return.


The following screen is displayed.

6. In this example, a single SAS RAID array is attached to the adapter. The array has four bonded PHYs.

7. To exit this screen, press the Escape key.

8. Use the arrow key to highlight Exit the Configuration Utility and press Enter.


Saving global properties...
Global properties saved. Hit any key to reboot.

9. Press any key to reboot the system.


Removing the HBA

Follow these steps to remove the HBA from an enclosure:

1. Prepare your operating system for HBA removal.

2. Disconnect all SAS cables from the external mini-SAS connectors.

3. Press the Attention button on the exposed end of the HBA (see FIGURE 2-2).

4. When the green Power LED next to the Attention button goes out, pull the ejection lever downwards.



Note - If you decide after pressing the Attention button that you do not want to remove the HBA, you can cancel the operation by pressing the button again within 5 seconds of when the power LED starts blinking.


5. Pull the HBA out of its slot in the enclosure.