5.1 Administering the Cluster Interconnects

This section provides the procedures for reconfiguring cluster interconnects, such as cluster transport adapters and cluster transport cables. These procedures require that you install Sun Cluster software.

Most of the time, you can use the scsetup utility to administer the cluster transport for the cluster interconnects. See the scsetup(1M) man page for more information.

For cluster software installation procedures, see the Sun Cluster 3.0 Installation Guide. For procedures about servicing cluster hardware components, see the Sun Cluster 3.0 Hardware Guide.

5.1.1 How to Check the Status of the Cluster Interconnect

You do not need to be logged in as superuser to perform this procedure.

1. Check the status of the cluster interconnect.

   # scstat -W

2. Refer to the following for common status messages.

   Status Message	Description and Possible Action
   Path online	The path is currently functioning correctly. No action is necessary.
   Path waiting	The path is currently being initialized. No action is necessary.
   Path faulted	The path is not functioning. Take corrective action.

5.1.1.1 Example--Checking the Status of the Cluster Interconnect

The following example shows the status of a functioning cluster interconnect.

# scstat -W
-- Cluster Transport Paths --
                    Endpoint             Endpoint             Status
                    --------             --------             ------
  Transport path:   phys-schost-1:qfe1   phys-schost-2:qfe1   Path online
  Transport path:   phys-schost-1:qfe0   phys-schost-2:qfe0   Path online
  Transport path:   phys-schost-1:qfe1   phys-schost-3:qfe1   Path online
  Transport path:   phys-schost-1:qfe0   phys-schost-3:qfe0   Path online
  Transport path:   phys-schost-2:qfe1   phys-schost-3:qfe1   Path online
  Transport path:   phys-schost-2:qfe0   phys-schost-3:qfe0   Path online

5.1.2 How to Add Cluster Transport Cables and Transport Adapters

1. Ensure that the physical cluster transport cables are installed.

   For the procedure on installing a cluster transport cable, see the Sun Cluster 3.0 Hardware Guide.

2. Become superuser on any node in the cluster.

3. Execute the scsetup utility.

   # scsetup

   The Main Menu appears.

4. Access the Cluster Interconnect Menu by entering 2 (Cluster interconnect).

5. Add the cable by entering 1 (Add a transport cable).

   Follow the instructions and enter the requested information. A junction is not needed for direct connections in a cluster with two nodes. However, you need to enter both the node and the adapter names of one of the endpoints of the cable you are trying to identify.

   >>> Add a Cluster Transport Cable <<<     ...     Is it okay to continue (yes/no) [yes]? <Return>     ...     To which node do you want to add the cable? nodename     Name of the adapter to use on "node"? adaptername     Name of the junction at the other end of the cable? junctionname     Okay to use the default for this cable connection [yes]? <Return>     Is it okay to proceed with the update (yes/no) [yes]? <Return>

6. Add the adapter by entering 2 (Add a transport adapter to a node).

   Follow the instructions and enter the requested information. A junction is not needed for direct connections in a cluster with two nodes. However, you need to enter both the node and the adapter names of one of the endpoints of the cable you are trying to identify.

   >>> Add a Cluster Transport Adapter <<<     ...     Is it okay to continue (yes/no) [yes]? <Return>     ...     To which node do you want to add the cable? nodename     Name of the adapter to use on "node"? adaptername     Name of the junction at the other end of the cable? junctionname     Okay to use the default for this cable connection [yes]? <Return>     Is it okay to proceed with the update (yes/no) [yes]? <Return>

7. Verify that the cluster transport cable or transport adapter is added.

   # scconf -p | grep cable # scconf -p | grep adapter

5.1.2.1 Example--Adding a Cluster Transport Cable and a Transport Adapter

The following example shows how to add a transport cable or transport adapter to a node using the scsetup command.

[Ensure the physical cable is installed.]
[Become superuser on a node in the cluster.]
[Execute the scsetup utility:]
# scsetup
[Enter option 2:]
*** Main Menu ***
    Please select from one of the following options:
    ...
      2) Cluster interconnect
    ...    Option: 2
[Enter option 1 to add a cable:]
*** Cluster Interconnect Menu ***
    Please select from one of the following options:
    ...
    1) Add a transport cable
    ...
    Option: 1
[Enter the requested information:]
>>> Add a Cluster Transport Cable <<<
    ...
    Is it okay to continue (yes/no) [yes]? <Return>	.
    ...
    To which node is the cable attached? phys-schhost-2
    Name of the adapter on "phys-schost-2"? qfe-0
    Is it okay to proceed with the update (yes/no) [yes]? <Return>	.
scconf -a -m endpoint=phys-schost-2:hme1,endpoint=hub0
    Command completed successfully.    Hit ENTER to continue: <Return>
[Enter option 2 to add an adapter:]
*** Cluster Interconnect Menu ***
    Please select from one of the following options:
    ...
    2) Add a transport adapter to a node
    ...
    Option: 2
[Enter the requested information:]
>>> Add a Cluster Transport Adapter <<<
    ...
    Is it okay to continue (yes/no) [yes]? <Return>	.
    ...
    To which node is the cable attached? phys-schhost-2
    Name of the adapter on "phys-schost-2"? qfe-0
    Is it okay to proceed with the update (yes/no) [yes]? <Return>	.
scconf -a -m endpoint=phys-schost-2:hme1,endpoint=hub0
    Command completed successfully.    Hit ENTER to continue: <Return>
[Verify that the cable and adapter are added:]
# scconf -p | grep cable
  Transport cable:   phys-schost-2:qfe0@1 ethernet-1@2    Enabled
  Transport cable:   phys-schost-3:qfe0@1 ethernet-1@3    Enabled
  Transport cable:   phys-schost-1:qfe0@0 ethernet-1@1    Enabled
# scconf -p | grep adapter
  Node transport adapters:                         qfe2 hme1 qfe0
  Node transport adapter:                          qfe0
  Node transport adapters:                         qfe0 qfe2 hme1
  Node transport adapter:                          qfe0
  Node transport adapters:                         qfe0 qfe2 hme1
  Node transport adapter:                          qfe0

5.1.3 How to Remove Cluster Transport Cables and Transport Adapters

Use the following procedure to remove cluster transport cables and cluster transport adapters from a node. When a cable is disabled, the two endpoints of the cable remain configured. An adapter cannot be removed if it is still in use as an endpoint in a transport cable.

A cluster node needs at least one functioning cable attached to the cluster interconnect to be a member of the cluster. Always verify the status of a node's cluster interconnect before disabling a cable. Only disable a cable connection after you have verified that it is redundant; that is, that another connection is available. Disabling a node's last remaining working cable takes the node out of cluster membership.

1. Become superuser on any node in the cluster.

2. Check the status of the remaining cluster transport path.

   # scstat -W

   ---

   Caution -

   If you receive an error such as "path faulted" while attempting to remove one node of a two-node cluster, investigate the problem before continuing with this procedure. Such a problem could indicate that a node path is unavailable. Removing the remaining good path takes the node out of cluster membership and could result in a cluster reconfiguration.

   ---

3. Execute the scsetup utility.

   # scsetup

   The Main Menu appears.

4. Access the Cluster Interconnect Menu by entering 2 (Cluster interconnect).

5. Remove the cable by entering 4 (Remove a transport cable).

   Follow the instructions and enter the requested information. You need to enter both the node and the adapter names of one of the endpoints of the cable you are trying to identify.

   *** Cluster Interconnect Menu ***     Please select from one of the following options:     ...     4) Remove a transport cable     ...     Option: 4     ... >>> Remove a Cluster Transport Cable <<<     ...     Is it okay to continue (yes/no) [yes]? <Return>     ...     To which node is the cable attached? nodename     Name of the adapter on "node"? adaptername     Is it okay to proceed with the update (yes/no) [yes]? <Return>     ...     Command completed successfully.    Hit ENTER to continue: <Return>

   ---

   Note -

   If you are removing a physical cable, disconnect the cable between the port and the destination device.

   ---

6. To remove an adapter, enter 5 (Remove a transport adapter from a node).

   Follow the instructions and enter the requested information. You need to enter both the node and the adapter names of one of the endpoints of the cable you are trying to identify.

   *** Cluster Interconnect Menu **    Please select from one of the following options:     ...     5) Remove a transport adapter     ...     Option: 5     ... >>> Remove a Cluster Transport Adapter <<<     ...     Is it okay to continue (yes/no) [yes]? <Return>     ...     To which node is the cable attached? nodename     Name of the adapter on "node"? adaptername     Is it okay to proceed with the update (yes/no) [yes]? <Return>     ...     Command completed successfully.    Hit ENTER to continue: <Return>

   ---

   Note -

   If you are removing a physical adapter from a node, see the Sun Cluster 3.0 Hardware Guide for hardware service procedures.

   ---

7. Verify that the cable or the adapter has been removed.

   # scconf -p | grep cable # scconf -p | grep adapter

   The transport cable or adapter removed from the given node should not appear in the output from this command.

5.1.3.1 Example--Removing a Transport Cable or Transport Adapter

The following example shows how to remove a transport cable or transport adapter using the scsetup command.

[Become superuser on a node in the cluster.]
[Execute the scsetup utility:]
# scsetup
[Enter option 2:]
*** Main Menu ***
    Please select from one of the following options:
    ...
      2) Cluster interconnect
    ...    Option: 2
[Enter option 4 to remove a cable:]
*** Cluster Interconnect Menu ***
    Please select from one of the following options:
    ...
      4) Remove a transport cable
    ...
    Option: 4
[Enter the requested information:]
>>> Remove a Cluster Transport Cable <<<
    ...
    Is it okay to continue (yes/no) [yes]? <Return>	.
    ...
    To which node is the cable attached? phys-schhost-2
    Name of the adapter on "phys-schost-2"? qfe-0
    Is it okay to proceed with the update (yes/no) [yes]? <Return>	.
scconf -a -m endpoint=phys-schost-2:hme1,endpoint=hub0
    Command completed successfully.    Hit ENTER to continue: <Return>
[Enter option 5 to remove an adapter:]
*** Cluster Interconnect Menu ***
    Please select from one of the following options:
    ...
      5) Remove a transport adapter from a node
    ...
    Option: 5
[Enter the requested information:]
>>> Remove a Cluster Transport Adapter <<<
    ...
    Is it okay to continue (yes/no) [yes]? <Return>	.
    ...
    To which node is the cable attached? phys-schhost-2
    Name of the adapter on "phys-schost-2"? qfe-0
    Is it okay to proceed with the update (yes/no) [yes]? <Return>	.
 
scconf -r -m endpoint=phys-schost-2:hme1
 
    Command completed successfully.    Hit ENTER to continue: <Return>
[Verify that the cable or adapter is removed:]
# scconf -p | grep cable
  Transport cable:   phys-schost-2:qfe0@1 ethernet-1@2    Enabled
  Transport cable:   phys-schost-3:qfe0@1 ethernet-1@3    Enabled
  Transport cable:   phys-schost-1:qfe0@0 ethernet-1@1    Enabled
# scconf -p | grep adapter
  Node transport adapters:   qfe2 hme1 qfe0
  Node transport adapter:   qfe0
  Node transport adapters:   qfe0 qfe2 hme1
  Node transport adapter:   qfe0
  Node transport adapters:   qfe0 qfe2 hme1
  Node transport adapter:   qfe0

5.1.4 How to Enable a Cluster Transport Cable

This option is used to enable an already existing cluster transport cable.

1. Become superuser on any node in the cluster.

2. Enter the scsetup utility.

   # scsetup

   The Main Menu appears.

3. Access the Cluster Interconnect Menu by entering 2 (Cluster interconnect).

4. Enable the transport cable by entering 7 (Enable a transport cable).

   Follow the instructions when prompted. You need to enter both the node and the adapter names of one of the endpoints of the cable you are trying to identify.

5. Verify that the cable is enabled.

   # scconf -p | grep cable

5.1.4.1 Example--Enabling a Cluster Transport Cable

This example shows how to enable a cluster transport cable on adapter qfe-1 located on the node phys-schost-2.

[Become superuser on any node.]
[Enter the scsetup utility:]
# scsetup
[Enter option 7:]
*** Cluster Interconnect Menu ***
    Please select from one of the following options:
    ...
      7) Enable a transport cable
    ...
    Option: 7
[Enter the requested information:]
>>> Enable a Cluster Transport Cable <<<
    ...
    Is it okay to continue (yes/no) [yes]? <Return>
    ...
    To which node is the cable attached? phys-schhost-2
    Name of the adapter on "phys-schost-2"? qfe-1
    Is it okay to proceed with the update (yes/no) [yes]? <Return>
 
scconf -c -m endpoint=phys-schost-2:qfe1,state=enabled
 
    Command completed successfully.
    Hit ENTER to continue: <Return>
[Verify that the cable is enabled:]
# scconf -p | grep cable
  Transport cable:   phys-schost-2:qfe1@0 ethernet-1@2    Enabled
  Transport cable:   phys-schost-3:qfe0@1 ethernet-1@3    Enabled
  Transport cable:   phys-schost-1:qfe0@0 ethernet-1@1    Enabled

5.1.5 How to Disable a Cluster Transport Cable

You might need to disable a cluster transport cable to temporarily shut down a cluster interconnect path. This is useful when troubleshooting a cluster interconnect problem or when replacing cluster interconnect hardware.

When a cable is disabled, the two endpoints of the cable remain configured. An adapter cannot be removed if it is still in use as an endpoint in a transport cable.

A cluster node needs at least one functioning cable attached to the cluster interconnect to be a member of the cluster. Always verify the status of a node's cluster interconnect before disabling a cable. Only disable a cable connection after you have verified that it is redundant; that is, that another connection is available. Disabling a node's last remaining working cable takes the node out of cluster membership.

1. Become superuser on any node in the cluster.

2. Check the status of the cluster interconnect before disabling a cable.

   # scstat -W

   ---

   Caution -

   If you receive an error such as "path faulted" while attempting to remove one node of a two-node cluster, investigate the problem before continuing with this procedure. Such a problem could indicate that a node path is unavailable. Removing the remaining good path takes the node out of cluster membership and could result in a cluster reconfiguration.

   ---

3. Enter the scsetup utility.

   # scsetup

   The Main Menu appears.

4. Access the Cluster Interconnect Menu by entering 2 (Cluster interconnect).

5. Disable the cable by entering 8 (Disable a transport cable).

   Follow the instructions and enter the requested information. All of the components on this cluster interconnect will be disabled. You need to enter both the node and the adapter names of one of the endpoints of the cable you are trying to identify.

6. Verify that the cable is disabled.

   # scconf -p | grep cable

5.1.5.1 Example--Disabling a Cluster Transport Cable

This example shows how to disable a cluster transport cable on adapter qfe-1 located on the node phys-schost-2.

[Become superuser on any node.]
[Enter the scsetup utility:]
# scsetup
[Enter option 8:]
*** Cluster Interconnect Menu ***
    Please select from one of the following options:
    ...
      8) Disable a transport cable
    ...
    Option: 8
[Enter the requested information:]
>>> Disable a Cluster Transport Cable <<<
    ...
    Is it okay to continue (yes/no) [yes]? <Return>
    ...
    To which node is the cable attached? phys-schhost-2
    Name of the adapter on "phys-schost-2"? qfe-1
    Is it okay to proceed with the update (yes/no) [yes]? <Return>

scconf -c -m endpoint=phys-schost-2:qfe1,state=disabled

    Command completed successfully.
    Hit ENTER to continue: <Return>
[Verify that the cable is disabled:]
# scconf -p | grep cable
  Transport cable:   phys-schost-2:qfe1@0 ethernet-1@2    Disabled
  Transport cable:   phys-schost-3:qfe0@1 ethernet-1@3    Enabled
  Transport cable:   phys-schost-1:qfe0@0 ethernet-1@1    Enabled