Perform Diagnostics on the InfiniBand Fabric

The ibdiagnet command performs a collection of tests on the InfiniBand fabric and generates several files which contain parameters and aspects of the InfiniBand fabric.

1. Identify the prerequisite and subsequent tasks you must perform in conjunction with this procedure, to install the switch.

   See the table in Installation Sequence.

2. On the Linux InfiniBand host, type:

   # ibdiagnet

   In the following example, the ibdiagnet command checks for 4x link width and 10 Gbyte/sec speed and dumps the Performance Manager counters and then clears them:

   # ibdiagnet -lw 4x -ls 10 -pm -pc
   Loading IBDIAGNET from: /usr/lib64/ibdiagnet1.2
   -W- Topology file is not specified.
        Reports regarding cluster links will use direct routes.
   Loading IBDM from: /usr/lib64/ibdm1.2
   -I- Using port 2 as the local port.
   -I- Discovering ... 55 nodes (54 Switches & 1 CA-s) discovered.
   -I---------------------------------------------------
   -I- Bad Guids/LIDs Info
   -I---------------------------------------------------
   -I- No bad Guids were found
   -I---------------------------------------------------
   -I- Links With Logical State = INIT
   -I---------------------------------------------------
   -I- No bad Links (with logical state = INIT) were found
   -I---------------------------------------------------
   -I- PM Counters Info
   -I---------------------------------------------------
   -I- No illegal PM counters values were found
   -I---------------------------------------------------
   -I- Links With links width != 4x (as set by -lw option)
   -I---------------------------------------------------
   -I- No unmatched Links (with width != 4x) were found
   -I---------------------------------------------------
   -I- Links With links speed != 10 (as set by -ls option)
   -I- No unmatched Links (with speed != 10) were found
   -I---------------------------------------------------
   -I- Fabric Partitions Report (see ibdiagnet.pkey for a full hosts list)
   -I---------------------------------------------------
   -I-    PKey:0x7fff Hosts:1 full:1 partial:0
   -I---------------------------------------------------
   -I- IPoIB Subnets Check
   -I---------------------------------------------------
   -I- Subnet: IPv4 PKey:0x7fff QKey:0x00000b1b MTU:2048Byte rate:10Gbps SL:0x00
   -W- Suboptimal rate for group. Lowest member rate:40Gbps > group-rate:10Gbps
   -I---------------------------------------------------
   -I- Bad Links Info
   -I- No bad link were found
   -I---------------------------------------------------
   ----------------------------------------------------------------
   -I- Stages Status Report:
        STAGE                                    Errors Warnings
        Bad GUIDs/LIDs Check                     0      0
        Link State Active Check                  0      0
        Performance Counters Report              0      0
        Specific Link Width Check                0      0
        Specific Link Speed Check                0      0
        Partitions Check                         0      0
        IPoIB Subnets Check                      0      1
   Please see /tmp/ibdiagnet.log for complete log
   ----------------------------------------------------------------
   -I- Done. Run time was 42 seconds.
   #

   ---

   Note - The Performance Manager counters are available in the ibdiagnet.pm file.

   ---

3. Validate and check errors for the InfiniBand fabric.

   See Validate the InfiniBand Fabric and Report Errors.

Related Information

• Switch Command Reference, ibdiagnet command

• Discover the InfiniBand Fabric Topology

• Installing the InfiniBand Software Stack