Sun Cluster 3.0 Hardware Guide

How to Add a StorEdge D1000 Disk Array

Use this procedure to install a disk array in an existing cluster. Perform the steps in this procedure in conjunction with the procedures in Sun Cluster 3.0 System Administration Guide and your server hardware manual.

For conceptual information on multi-initiator SCSI and device IDs, see Sun Cluster 3.0 Concepts.

  1. Ensure that each device in the SCSI chain has a unique SCSI address.

    The default SCSI address for host adapters is 7. Reserve SCSI address 7 for one host adapter in the SCSI chain. This procedure refers to the host adapter you choose for SCSI address 7 as the host adapter on the second node. To avoid conflicts, in Step 7 you will change the scsi-initiator-id of the remaining host adapter in the SCSI chain to an available SCSI address. This procedure refers to the host adapter with an available SCSI address as the host adapter on the first node. SCSI address 6 is usually available.

    For more information, see the OpenBoot 3.x Command Reference Manual and the labels inside the storage device.


    Caution - Caution -

    Even though a slot in the disk array might not be in use, you should avoid setting the scsi-initiator-id for the first node to the SCSI address for that disk slot. This precaution minimizes future complications if you install additional disk drives.


  2. Shut down and power off the first node.


    # scswitch -S -h nodename
    # shutdown -y -g 0
    

    For more information on shutdown, see Sun Cluster 3.0 System Administration Guide.

  3. Install the host adapters in the node.

    For the procedure on installing host adapters, see the documentation that shipped with your host adapters and nodes.

  4. Connect the differential SCSI cable between the node and the disk array as shown in Figure 5-2.

    Make sure that the entire SCSI bus length to each enclosure is less than 25 m. This measurement includes the cables to both nodes, as well as the bus length internal to each enclosure, node, and host adapter. Refer to the documentation that shipped with the enclosure for other restrictions regarding SCSI operation.

    Figure 5-2 Example of a StorEdge D1000 disk array mirrored pair

    Graphic

  5. Power on the first node and the disk arrays.

  6. Find the paths to the SCSI host adapters.


    {0} ok show-disks
    

    Identify and record the two controllers that will be connected to the disk arrays, and record these paths. Use this information to change the SCSI addresses of these controllers in the nvramrc script. Do not include the /sd directories in the device paths.

  7. Edit the nvramrc script to change the scsi-initiator-id for the host adapters of the first node.

    For a list of Editor nvramrc editor and keystroke commands, see Appendix B, NVRAMRC Editor and NVEDIT Keystroke Commands.

    The following example sets the scsi-initiator-id to 6. The OpenBoot PROM Monitor prints the line numbers (0:, 1:, and so on).


    Caution - Caution -

    Insert exactly one space after the double quote and before scsi-initiator-id.



    {0} ok nvedit 
    0: probe-all
    1: cd /sbus@1f,0/QLGC,isp@3,10000 
    2: 6 encode-int " scsi-initiator-id" property 
    3: device-end 
    4: cd /sbus@1f,0/ 
    5: 6 encode-int " scsi-initiator-id" property 
    6: device-end 
    7: install-console 
    8: banner [Control C] 
    {0} ok
  8. Store the changes.

    The changes you make through the nvedit command are done on a temporary copy of the nvramrc script. You can continue to edit this copy without risk. After you have completed your edits, save the changes. If you are not sure about the changes, discard them.

    • To store the changes, type:


      {0} ok nvstore
      {0} ok 

    • To discard the changes, type:


      {0} ok nvquit
      {0} ok 
  9. Verify the contents of the nvramrc script you created in Step 7.

    If the contents of the nvramrc script are incorrect, use the nvedit command to make corrections.


    {0} ok printenv nvramrc
    nvramrc =             probe-all
                          cd /sbus@1f,0/QLGC,isp@3,10000
                          6 encode-int " scsi-initiator-id" property
                          device-end 
                          cd /sbus@1f,0/
                          6 encode-int " scsi-initiator-id" property
                          device-end  
                          install-console
                          banner
    {0} ok
  10. Instruct the OpenBoot PROM Monitor to use the nvramrc script:


    {0} ok setenv use-nvramrc? true
    use-nvramrc? = true
    {0} ok 

  11. Boot the first node, and wait for it to join the cluster.


    {0} ok boot -r
    

    For more information, see Sun Cluster 3.0 System Administration Guide.

  12. On all nodes, verify that the DIDs have been assigned to the disk drives in the disk array.


    # scdidadm -l
    

  13. Shut down the second node.


    # scswitch -S -h nodename
    # shutdown -y -g 0
    

  14. Power off the second node.

  15. Install the host adapters in the second node.

    For the procedure on installing host adapters, see the documentation that shipped with your nodes.

  16. Connect the disk array to the host adapters using differential SCSI cables.

    Figure 5-3 Example of a StorEdge D1000 disk array mirrored pair

    Graphic

  17. Without allowing the node to boot, power on the second node. If necessary, abort the system to continue with OpenBoot PROM Monitor tasks.

  18. Verify that the second node sees the new host adapters and disk drives.


    {0} ok show-disks
    

  19. Verify that the scsi-initiator-id for the host adapters on the second node is set to 7.

    Use the show-disks command to find the paths to the host adapters connected to these enclosures. Select each host adapter's device tree node, and display the node's properties to confirm that the scsi-initiator-id for each host adapter is set to 7.


    {0} ok cd /sbus@1f,0/QLGC,isp@3,10000
    {0} ok .properties
    scsi-initiator-id        00000007 
    ...
  20. Boot the second node, and wait for it to join the cluster.


    {0} ok boot -r
    

  21. On all nodes, verify that the DIDs have been assigned to the disk drives in the disk array.


    # scdidadm -l
    

  22. Perform volume management administration to add the disk drives in the array to the volume management configuration.

    For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation.