C H A P T E R  8

Feedback SAS Domain Access Configuration

This chapter describes how to use Access Configuration features for JBOD arrays. You can assign each host its own storage resources, optimizing efficiency through segregation and topology control. Access configuration is accomplished on a per host SAS port, per hard-disk level.

This chapter includes the following topics:


About SAS Domains

Serial attached SCSI (SAS) domain access configuration enables you to configure data hosts to access a specified group of storage devices. Sun Storage Common Array Manager SAS access configuration provides the traffic segregation, resource flexibility, controlled resource sharing, protection, and topology control functionality required to manage SAS-based systems.

By default, SAS access configuration is disabled, which means all hosts can access all disks.

Supported SAS Arrays

Sun Storage Common Array Manager provides SAS access configuration management for:

Configuring SAS Access (or Zoning)

You can design each connected SAS port to have exclusive ownership over a specific set of targets in a single array or across cascaded arrays.

The dual SAS fabric design of the J4x00 arrays is initially seen as two separately configured (zoned) SAS domains. In a clustered or multipath situation, where you want two hosts to have access to the same disks for failover, each domain must be configured identically in the array management software for each side of the multipath connection or cluster. The array management software provides zoning templates for common configurations, as well as the ability to import and export user-defined templates.

The Sun Storage F5100 Flash Array consists of four independent fabrics. See the array’s documentation for more information.



Note - For F5100 arrays, the array management software will aggregate the four independent domains into a single unified view when a management host, or a management host with additional proxy agents, have visibility to each domain.



Preparing for SAS Access Configuration

Checking System Requirements

Access Configuration features require one of the a supported LSI-based HBAs with the minimum required firmware installed in the array management or data host, directly connected to the J4x00 array.



Note - Sun Storage Common Array Manager also supports JBOD management via the 8-port PCIe RAID HBA (SGXPCIESAS-R-EXT-Z). However, this HBA is not supported in an Access Configuration environment.


For more information, refer to the documentation included with the installed HBA.

Planning for SAS Access Configuration

The recommended configuration sequence is to start by connecting one SAS port to a management host. Then configure SAS Access Configuration for this port, and connect the remaining hosts per your plan.



Note - If multiple SAS ports are connected to an array consisting of any SATA based disk drives during zoning configuration, the array will remember the SAS port that last accessed each SATA disk and will not allow another SAS port to access any SATA drives until the array is power cycled.


Use the planning worksheets in Appendix B as you gather data for your configuration.

1. Determine if your SAS storage will consist of one array or multiple arrays cascaded together.

2. Determine how many SAS domains you want on your storage system. If you want to form larger domains, cable SAS expanders together.

3. Note the available disks or FMods to be target devices.

4. Note which initiators to cable to which expander ports.

5. Decide how to assign storage:

a. Select a template to automatically assign SAS ports to targets.

b. Manually map SAS ports to targets and determine which SAS ports will map to which targets.

c. If you want to group storage devices into target groups of shared storage, decide which SAS ports to link to which target groups.

6. After you complete Access Configuration for one host, connect the remaining SAS ports to hosts per your plan.



Note - Sun Storage Common Array Manager automatically saves the current SAS domain settings. This will allow you to revert back to functional settings in the event of mis-configuration, or when an array component, such as a SIM card or controller module, containing Access Configuration (zoning) information is replaced.


Using SAS Multipathing



Note - The Sun Storage F5100 Flash Array does not support multipathing or clustering.


You can use the Sun Storage J4x00 array in a serial-attached SCSI (SAS) multipathing configuration to provide fault tolerant connectivity to storage. Although J4x00 arrays use single port SATA drives, the I/O circuitry provides a redundant data path to each disk port if the connections to the drives use independent controller paths (i.e., SIM0 and SIM1 for J4200/J4400 arrays and SAS A and B for the J4500 arrays).

Using the multipathing feature of the SAS protocol, you can configure the J4x00 to provide a redundant data path from host to disk. When used in conjunction with RAID and clustered server configurations, multipathing can help increase the availability of your J4x00 storage.



Note - The J4500 array is not supported in a clustering configuration.


The J4x00 multipathing supports active-active and active-passive operation, as follows:


Discovering SAS Domains

1. Check to be sure the full version of Sun Storage Common Array Manager is installed on the server. If needed, follow the instructions in Installing the Typical Full Management Software.

2. Log in to the management software.

3. Register the array using the auto-discover wizard or manually. See Registering Arrays for details.

After the array is registered, the SAS Domain Summary page displays the new array.

Viewing Discovered SAS Domains

1. From the left navigation pane, select the desired SAS Domains page located under the Host or Array that you want to configure.

The SAS Domain Summary page displays, showing the discovered domains.

2. Click a domain name in the SAS Domain Summary page.

The SAS Domain Details page is displayed.

3. Expand a domain name in the navigation pane.

The Access Configuration and Administration menu items are displayed.

4. Click one of the following links:


Link

If you want to

Access Configuration

Set up access between SAS ports and specified targets (disks or FMods). You can configure access manually or import a predefined template.

Administration

Change the name of the selected domain, change the access configuration state for the selected domain, or manage the access configuration password.


Renaming the SAS Domain Name

If you want to change a SAS domain’s default name to a name that you can easily identify, do the following:

1. Select the SAS domain name to open the SAS Domain Details page.

2. Double-click the Name field and enter a unique, meaningful name for this SAS domain.

3. Click Save.


Configuring SAS Access for New Arrays



Note - You should always configure one server at a time.




caution icon Caution - Use these procedures for configuring a new array. If data exists on the array, perform a full back up as a precautionary measure. Verify that no host-to-disk I/O will take place during Access Configuration (zoning) operations.


Importing Access Configuration Using a Template

Several templates are provided from which you can choose to configure access between SAS ports and targets. You can also create your own templates (see Creating a SAS Access Configuration Template in Online Help).

1. From the left navigation pane, click Access Configuration for the SAS domain you want to configure.

The Access Configuration Summary page displays showing any existing access configurations.

2. Click Configure.

The Configure Access Between Ports and Targets page is displayed.

3. Click Import.

The Import Access Configuration wizard is displayed.

4. Select the template that matches your configuration needs.

The templates represent some common configurations. For example, Simple Zone Split will evenly divide all available targets across all SAS ports. You can also create a custom configuration and Export to a template, as described in the Online Help.

5. If you select a template that requires more information, the wizard displays a page similar to the following. Select the appropriate targets you want to configure from the drop down menu and click Next.

6. Review the selected configuration, and select one of the following:

7. If you select Edit imported Access Configuration, the Configure Access Between Ports and Targets page is displayed. Make any additional modifications to the template and click Save.

Manually Configuring SAS Port to Target Access

1. From the left navigation pane, click Access Configuration for the SAS domain you want to configure.

The Access Configuration Summary displays showing any existing access configurations.

2. Click the Configure button to configure access between SAS ports and targets.

3. Select the SAS port you want to configure.

4. Select the targets you want the selected SAS port to access.

5. Click Add/Modify.

The selected SAS port and target configuration is displayed.

6. To save this configuration, click Save.

The array management software saves the configuration to allow access control between the specified SAS ports and targets.

7. Click Export to save the configuration to a template (see the Online Help for more information about creating SAS Access Configuration templates.


Cascading J4x00 Arrays to Existing Arrays



Note - Sun Storage F5100 Flash Arrays do not support cascading between individual domains or between F5100 arrays.


There are three sets of steps required to cascade (or add) a J4x00 array to an existing J4x00 series array from the browser interface.

If multiple arrays are to be cascaded, add them one at a time, using the following procedures:



caution icon Caution - For Linux hosts: newly added (or removed) targets (that is, disks or FMods) due to changes in Access Configuration or the addition of new storage can potentially cause the host to hang or panic due to known Linux kernel issues. Rebooting the host should solve this problem.


Preparing Existing Arrays Prior to Cascading Additional Storage

This procedure takes you through the steps required to disable the Access Configuration state for existing arrays, in preparation for cascading additional arrays.

1. Create a backup of all existing data.

This is a precautionary step.

2. From the Access Configuration page, check the SAS addresses, write down the SAS port WWN’s and associated drives for each domain, and then perform an Export operation for each.

Prior to re-cabling, you must record the SAS port WWN and the desired associated targets.The configuration will need to be recreated because the SAS port might be attached to a different array in the cascade or different ports on an array.

3. Unregister related arrays in the array management software:

a. From the navigation pane, select Storage Systems.

The Storage System Summary page is displayed.

b. Select the checkbox to the left of the array and click Remove.

c. Click OK.

Proxy hosts for un-registered arrays will automatically be removed as well.

Preparing New Arrays for Cascading (Adding Storage Capacity)

Before cascading can occur, all arrays that will be cascaded as new or additional storage must be prepared using this procedure.

1. Specify ports for each array: Connect both sides of the new array (see TABLE 8-1) directly to a server running a full CAM installation.


TABLE 8-1 Array Ports for Cascading

Array

Port

J4200

SIM0/SIM1

J4400

Host or SIM Link In

J4500

SAS A/SAS B


The array must not be cascaded to another J4x00 array at this time.

2. Log into the management host by entering the address: https://host-name:6789

where host-name is the DNS name of the server connected to the array

3. From the Storage System Summary Page, click Register and then register the attached array (following the instructions in the wizard), using the host name or host IP address of the data host in the Registration window.

4. Expand the Array tree for the server until the Access Configuration screen for the first SAS Domain appears.



caution icon Caution - Be sure you have selected the appropriate array before going to Step 5. The Reset to Default procedure clears existing zoning configurations.


  

Typically, new arrays will not have a password set. If you assigned a password for the array’s Access Configuration, you will need it to perform Step 5. If the previous password is not known, you can clear it using the methods specified in your J4200, J4400, F5100, or J4500 documentation.

5. For each SAS domain of the array, go to SAS Domains >Administration > Cascade Storage for the selected SAS domain, and click Prepare Storage.



Note - The CLI equivalent command is
sscs modify -p,--prepare-cascade sas-domain <sas-domain-name> command


6. Unregister all arrays to be cascaded from the array management software:

a. From the navigation pane, select Storage Systems.

b. On the Storage System Summary page, select the checkbox to the left of the array and click Remove.

c. Click OK.

7. Disconnect the array from the server, and then disconnect AC power to the array.

Cascading the New Array to the Existing Storage

Prerequisite: If any SAS ports from any attached hosts are not seen, verify that multipathing is disabled on those hosts. In addition, a reboot might be necessary to force an attached host to register its SAS ports with the storage arrays.

1. Disconnect all other attached hosts so your configuration resembles:

2. Connect the new array in cascade fashion to the existing J4x00 array(s).

In FIGURE 8-1 and FIGURE 8-2, Array 1 is either an existing or a new storage array. Array 2 is a new array which is attached to the primary array management server.



Note - This configuration differs from the configuration that will be used during normal operation. This configuration is temporary but required in order to synchronize the settings between the old array(s) and the new array being cascaded.


FIGURE 8-1 Temporary Cabling of J4500 for Initialization of the Cascade


Illustration showing two arrays cabled to one host.

FIGURE 8-2 Temporary Cabling of J4200 Arrays for Initialization of the Cascade


Illustration showing temporary connection of three arrays.

3. Power on all arrays by reconnecting AC power.

The new array might take a few minutes to be recognized by the server’s HBA.

4. From the Storage System Summary page, register the newly cascaded array configuration.

All attached arrays should be found. If they are not, perform a host reboot (i.e., Full reboot reconfigure on Solaris) and attempt the registration again.

5. Synchronize the password for the selected SAS domain with the current and newly attached arrays. (For more information about the SAS domain password, see Online Help.)

a. From the Administration page for the selected SAS domain, select “Change Password in the Array Registration Database.”

b. Enter your desired (or existing) password

c. Click Save.



Note - If the existing (primary) JBOD had a zoning password set before cascading: After re-discovering the JBOD cascade and before performing Synchronize Cascade, you must update the zoning password in the array database for the aggregated SAS domain with the zoning password of the primary array(s). To do this, select the third option for Zoning Password Management from the SAS Domain Administration page. This step is necessary because a new SAS domain database file is created for the aggregated SAS domain and the new SAS domain database file does not contain the zoning password.


6. Go to SAS Domains > Administration > Cascade Storage for the first SAS domain, and click Synchronize Cascade.

This synchronizes the zoning permission tables and initializes the connections between the arrays.



Note - The CLI equivalent command is:
sscs modify -y,--synch-cascade sas-domain <sas-domain-name> command


7. Attach additional hosts and change cabling from the primary array management server (host) as shown in cabling diagrams for your particular array.

When you have completed Step 7, all the arrays in the cascade should be discovered and the access configuration for all domains will be in the “disabled” state.



Note - See FIGURE 8-3 and FIGURE 8-4 for the initial cascading setup for J4500 arrays.


Important Notes

FIGURE 8-3 shows an example of how two hosts attach to two J4500 arrays. Refer to your user documentation for cabling instructions for your particular array.

FIGURE 8-3 Recommended Cascading Configuration for J4500 Array


Illustration showing recommended cabling for cascaded J4500 arrays.

FIGURE 8-4 Recommended Cascading Configuration for J4200/J4400 Array Types


Illustration showing recommended cabling for cascaded J4200/J4400 arrays.

8. From the selected SAS Domain’s Access Configuration page, click Configure.

At this time, all arrays, domains, and SAS ports from all attached hosts should be seen within the corresponding Access Configuration Pages.

If SAS ports from any attached hosts are not seen, verify that multipathing is disabled on those hosts. In addition, a reboot might be necessary to force an attached host to register their SAS ports with the storage arrays.

9. For connections between the host and array that do not attach to a different port on this array (or another array due to configuration guidelines), implement Access Configuration for those SAS ports.

a. From the selected SAS Domain’s Access Configuration page, configure the SAS port and storage for the SAS domain.

b. If multiple SAS ports are seen, they should also be configured at this time (i.e., SAS port #1 might have disks 1-6 and SAS port #2 might have disks 7-12).

10. Repeat Step 8 and Step 9 to assign targets to the server (host) for all SAS domains found under the entry for the primary management server.

11. Configure the multipathing software for each attached host so that the multipathing drivers control any drives shared by multiple paths.

12. Export Access Configuration information for each SAS port.


Configuring Multiple Host Access for a J4x00 Array

Prerequisite: If you have configured multipathing, disable multipath software until after the access configuration is complete so the arrays will see all SAS ports.

Configuring Hosts for Access Configuration

The first server you will configure is referred to as the “primary array management server” and each additional server you set up for Access Configuration is referred to as “(additional) host.” The server used to configure access configuration can also be the combination of a management station and single proxy server.

1. Install the full version of the array management software that supports zoning for the J4x00 array on the primary array management server (unless it is already installed).

2. Attach all SAS cables from all desired hosts, as indicated in your array user documentation.

For example, you might attach the first server for the J4x00 array to either the input port on one controller or an input on each side (SAS A/B or SIM 0/1) if multipathing is desired.

3. Log into Sun Storage Common Array Manager from the primary array management server you configured by opening the browser and entering the following address:

https://host-name:6789

Where host-name is the DNS name of the server connected to the array.

4. From the Storage System Summary page, click Register and follow the instructions in the wizard to register the arrays to the IP address of the first server.

5. If all attached SAS ports are not shown in the Access Configuration page, configure and reboot the primary array management and configure your multipathing software if multiple paths are attached at this point.

If the primary array management does not immediately recognize the array, use the appropriate host commands to scan for storage.

6. Configure the Access Configuration for each SAS port attached to the storage.

In the Access Configuration page, the SAS port(s) from the additional host(s) should be visible; however, they may only be represented as unique SAS addresses (no host names) since the proxy has not been discovered yet. Configuration for the additional host SAS ports should be done at this time by selecting the desired drives for one of the second host’s SAS ports, then repeating for each SAS port on the second host.

a. Expand the array tree for the server until the Access Configuration page for the first SAS Domain is displayed.

b. Click Access Configuration > Configure to assign targets to each server.

c. For each SAS port, choose the desired targets (disks or FMods) to which the SAS port should have access.

For multipath HBA initiator pairs, make sure the targets are the same.

d. Click Add/Modify.

e. Verify the Access Configuration setting is set to “Enable” and click Save.

The selected settings will be applied to the SAS Expander devices in the storage.

f. Click OK.

7. Repeat Step 6 for each SAS domain.

8. Power cycle the attached hosts using the appropriate options (i.e., reconfigure-reboot on Solaris) which will perform a full re-scan of the attached storage.


Troubleshooting Access Configuration

This section includes possible issues you might encounter when using the Access Configuration (SAS Zoning) features.

Important Notes


caution icon Caution - In a failover (multipath or clustered) configuration, granting multiple hosts access to the same disks through different controllers can lead to data loss. Be careful to properly assign the Access Configuration relationships between the hosts and storage while considering multipathing software to be used.


devfsadm -Cv

About SATA Affiliation Conflicts

The potential for SATA affiliation conflicts exists in J4500 and F5100 arrays, or in J4200 or J4400 arrays when any SATA drives are installed. Conflict can occur when more than one SAS port tries to access the drive via the same SIM or Controller path (i.e., more than one host attached to SIM0/1 on a J4200/J4400 array; more than one host attached to a F5100 array domain; or more than one host attached to SAS-A/B on a J4500 array).

Possible symptoms of SATA affiliation conflicts are:

When more than one instance of Sun Storage Common Array Manager probes a SATA drive from a single SAS domain, SATA affiliation issues occur which lead to possible symptoms as stated above. For this reason, only a single array management host is connected to a SAS domain unless drives have already been zoned to prevent SATA affiliation issues. After the access configuration (zoning) is completed from a primary array management server (or a primary array management server with only one active proxy agent), the array management software can be installed or enabled on additional proxy hosts as desired.

Clearing SATA Affiliation Conflicts

1. Un-register all CAM proxy agents on any hosts other than the one being used to configure the Access Configuration.

This can also be accomplished by un-installing the CAM proxy agent or by not installing the CAM proxy agent until Access Configuration is complete.



Note - A single CAM proxy can be used if the primary array management host is not directly attached to the storage via a SAS connection.


2. Do not run commands on hosts other than the one used to configure the Access Configuration (i.e., format, cfgadm, etc.) which might attempt to access the attached storage.

Feedback