Exit Print View

Sun Datacenter InfiniBand Switch 72 Command Reference

Get PDF Book Print View
 

Document Information

Using This Documentation

Related Documentation

Documentation, Support, and Training

Documentation Feedback

Understanding the Commands

Understanding Hardware Commands

Understanding InfiniBand Commands

ibaddr Command

ibcheckerrors Command

ibchecknet Command

ibchecknode Command

ibcheckport Command

ibcheckportstate Command

ibcheckportwidth Command

ibcheckstate Command

ibcheckwidth Command

ibclearcounters Command

ibclearerrors Command

ibdatacounters Command

ibdatacounts Command

ibdiagnet Command

ibdiagpath Command

ibhosts Command

ibnetdiscover Command

ibnodes Command

ibportstate Command

ibroute Command

ibstatus Command

ibswitches Command

ibsysstat Command

ibtracert Command

opensm Command

opensmd Daemon

osmtest Command

perfquery Command

saquery Command

sminfo Command

smpdump Command

smpquery Command

Index

opensm Command

Runs the InfiniBand Subnet Manager and Subnet Administrator.

Syntax

opensm [-F filename][-c filename][-g guid][-l lmc][-p priority][-smkey SMKey][-r][-R engine][-A][-z][-M filename][-U filename][-S filename][-a path][-u path][-X path][-m path][-o][-s interval][-t timeout][-maxsmps number][-console[off|local|socket|loopback]][-console-port port] [-i filename][-f path][-L size][-e][-P filename][-N][-Q[-Y filename]] [-y][-B][-I][-v][-V][-D flags][-dopt][-h]

where:

Description

This InfiniBand command initiates an instance of the OpenSM Subnet Manager and Subnet Administrator, which is required to initialize the InfiniBand hardware.


Note - Similarly, both the enablesm and opensm commands invoke an instance of the same Subnet Manager. Conversely, the enablesm command merely starts the Subnet Manager while the opensm command can configure the Subnet Manager.


OpenSM can be started in a default configuration with the opensm command. Options to the opensm command can configure the operation of the Subnet Manager to better fit the needs of your InfiniBand fabric.

OpenSM uses several files for operation and configuration. The default directory is /etc/opensm. The following table lists the files and their description.

File Name
Description
opensm.conf
Default OpenSM configuration file.
ib-node-name-map
Default node name map file.
partitions.conf
Default partition configuration file.
qos-policy.conf
Default Quality of Service policy configuration file.
prefix-routes.conf
Default prefix routes file.
Options

The following table describes the options to the opensm command and their purposes:

Option
Purpose
-F
Uses the OpenSM configuration filename. The file /etc/opensm/opensm.conf is used by default.
-c
Creates the OpenSM configuration file and exit.
-g
Binds OpenSM to the local port of guid value. If no value for guid is provided, OpenSM will display available GUIDs, and wait for user input.
-l
Specifies the InfiniBand fabric’s LMC value. The value of lmc must be within the range of 0 to 7. lmc values greater than 0 permit multiple paths between ports and are used only if the topology has multiple paths between ports. The number of LIDs assigned to each port is 2lmc. By default, lmc is 0, so there is only one path between any two ports.
-p
Sets the priority of the Subnet Manager instance. The master Subnet Manager and handover conditions are based upon the priority and GUID of the Subnet Managers.
-smkey
Specifies the Subnet Manager’s 64-bit encryption key.
-r
Reassigns LIDs to all end nodes. By default, OpenSM attempts to preserve existing LID assignments while resolving multiple use of the same LID.

Note - Use of the -r option might disrupt fabric traffic.


-R
Selects the routing algorithm to use. Multiple algorithms can be specified in the order of use upon failure. The list is comma delimited. Algorithms supported are:
  • minhop – Min Hop. This default algorithm routes through the minimum number of hops with an optimized path.

  • updn – Up Down. Like minhop, but constrained with ranking rules. This algorithm is used if the fabric is not a pure fat-tree, where a deadlock might occur, due to a loop in the fabric.

  • ftree – Fat-Tree. This algorithm optimizes routing for a congestion-free shift communication pattern. The algorithm is for symmetrical or almost symmetrical fat-tree fabrics. Fat-tree routing is also constrained to ranking rules.

  • lash – LASH. This algorithm uses InfiniBand virtual layers to provide deadlock-free shortest-path routing while distributing the path between the layers. An advantage of the LASH algorithm is that it avoids use of a potentially congested root node.

  • dor – DOR. Based upon the Min Hop algorithm, but avoids port equalization except for redundant links between the same two switches. The algorithm provides deadlock-free routes for hypercubes and meshes, when the fabric is cabled as a hypercube or mesh.

-A
Enables the unicast routing cache, which prevents routing recalculations in the event that there was no topology change detected during a sweep or if recalculation is not really necessary. For example, when a host is rebooted.
-z
Forces the routing engine to make connectivity between root switches for InfiniBand architecture compliance. Use of the -z option might permit the occurrence of a deadlock.
-M
Specifies the name of the LID matrix dump file from where the Min Hop tables are loaded.
-U
Specifies the name of the LFT file from where switch forwarding tables are loaded.
-S
Specifies the name of the Subnet Administrator DB dump file from where the Subnet Administrator database is loaded.
-a
Sets the root nodes for the Up Down or Fat-Tree algorithm to the GUIDs in the provided file. One per line.
-u
Sets the compute nodes for the Fat-Tree algorithm to the GUIDs in the provided file. One GUID per line.
-X
Sets the order port GUIDs are routed for the Min Hop and Up Down algorithms to the GUIDs in the provided file. One per line.
-m
Sets a mapping of the IDs to the node GUIDs used by the Up Down algorithm in the provided file. File format is one GUID and ID per line.
-o
OpenSM configures the fabric once and exits. Port remains Active.
-s
Specifies the amount of time, in seconds, between fabric sweeps. Default is 10 seconds. An interval of 0 disables sweeps.
-t
Overrides the default timeout.
-maxsmps
Specifies the maximum number of outstanding VL15 SMP management datagrams at any one time. Default is 4. A number of 0 permits unlimited SMP management datagrams.
-console
Sets the state of the OpenSM console. States are the following:
  • off – This is the default.

  • local

  • socket

  • loopback


Note - The socket and loopback states are only available if OpenSM was built with the --enable-console-socket option.


-console-port
Specifies an alternative Telnet port for the socket state.
-i
Defines a set of node GUID and port pairs to be ignored by the link load equalization algorithm. Pairs are provided in the filename.
-f
Instructs OpenSM where to send the log file. Default is /var/log/opensm.log. To direct the log to standard output, set path to stdout.
-L
Sets the maximum size of the log file in MB. The log file is truncated when reaching this limit, so the newest entries are lost.
-e
Deletes the log file.
-P
Defines the optional partition configuration filename. Default is /etc/opensm/partitions.conf.
-N
Disables partition enforcement on switch external ports.
-Q
Enables Quality of Service setup.
-Y
Specifies the optional Quality of Service policy filename. Default is /etc/opensm/qos-policy.conf. The policy file contains a list of configuration parameters. The parameters have the following format: qostypeparameter.

Where type is one of the following:

  • nothing – The parameter affects the entire fabric.

  • _ca – The parameters are set for the channel adapters.

  • _rtr – The parameters are set for the routers.

  • _swn – The paramters are set for switch port n.

  • _swe – The parameters are set for switch external ports.

Where parameter is one of the following:

  • _max_vls value – The maximum number of virtual lanes in the fabric.

  • _high_limit value – The limit of the High Priority component of the virtual lane arbitration table (IBA 7.6.9).

  • _vlarb_low data – The low priority virtual lane arbitration table template. data is 15 pairs of virtual lane and weight (x:y), separated by commas.

  • _vlarb_high data – The high priority virtual lane arbitration table template. data is 15 pairs of virtual lane and weight (x:y), separated by commas.

  • _sl2vl data – The SL2VL mapping table (IBA 7.6.6) template. data is a comma delimited sequence of virtual lanes corresponding to service levels 0 through 15.

-y
Prevents OpenSM from exiting upon fatal initialization issues. For example, duplicate GUIDS or 12x links with poorly configured lane reversal.
-B
Runs OpenSM in the background as a daemon.
-I
Starts OpenSM in an inactive state.
-v
Increases the log verbosity.
-V
Sets log verbosity to maximum. The same as -D 0xFF.
-D
Sets the log verbosity according to the following bit flags:
  • 0x01ERROR (error messages)

  • 0x02INFO (basic messages, low volume)

  • 0x04VERBOSE (moderate volume)

  • 0x08DEBUG (diagnostic, high volume)

  • 0x10FUNCS (function entry and exit, very high volume)

  • 0x20FRAMES (dumps all SMP and GMP frames)

  • 0x40ROUTING (dumps FDB routing information)

The default is ERROR + INFO, or 0x03. The option -D 0 turns off all log messaging.


Note - High verbosity levels might require increasing the transaction timeout with the -t timeout option.


-d
Specifies debug and an option to the debug. The value of -dopt is as follows:
  • -d0 – Ignores other Subnet Manager nodes.

  • -d1 – Forces single threaded dispatching.

  • -d2 – Forces log flushing after each log message.

  • -d3 – Disables multicast support

-h
Displays usage information.
Example

The following example shows how to initiate the Subnet Manager using the Fat-Tree routing algorithm with the opensm command.

# opensm -R ftree -A -a /etc/opensm/guid.txt -s 120 
Related Information