Go to main content

Managing Network Datalinks in Oracle® Solaris 11.4

Exit Print View

Updated: November 2020
 
 

How to Configure DLMP Aggregation of InfiniBand HCA Ports

You can create a DLMP aggregation of InfiniBand HCA ports. However, you cannot create an aggregation with the combination of Ethernet datalinks and InfiniBand HCA ports together.

In the global zone, you can specify virtual HCA as a member port of DLMP aggregation, even though the virtual HCA port does not share the same physical HCA with the other member ports of DLMP aggregation.


Note -  A DLMP aggregation cannot have more than one virtual port (including the physical port) that belongs to a physical HCA port.

Likewise, you cannot create an InfiniBand DLMP aggregation inside a kernel zone.


Before You Begin

Ensure that your role has the appropriate rights profile to perform this procedure. See Using Rights Profiles to Perform Network Configuration.

  1. Display the InfiniBand datalinks to determine the ports to be aggregated.
    $ dladm show-ib
    LINK    HCAGUID        PORTGUID       PORT STATE   GWNAME  GWPORT   PKEYS
    net4    21280001EFA276 21280001EFA277 1    up      --      --       FFFF,8001
    net5    21280001EFA276 21280001EFA278 2    up      --      --       FFFF,8001
  2. Create a DLMP aggregation of InfiniBand datalinks.
    $ dladm create-aggr -l net4 -l net5 -m dlmp dlmp_ib0
  3. Display the aggregation.
    $ dladm show-aggr -x dlmp_ib0
    LINK       PORT    SPEED   DUPLEX  STATE     ADDRESS    PORTSTATE
    dlmp_ib0   --      32000Mb full    up       unknown    --
               net4    32000Mb full    up       unknown    attached
               net5    32000Mb full    up       unknown    attached
  4. Configure an IPoIB VNIC over the aggregation.
    $ dladm create-vnic -l dlmp_ib0 -P ffff ibvnic1
  5. Display the IPoIB VNIC.
    $ dladm show-vnic ibvnic1
    LINK        OVER       SPEED  MACADDRESS        MACADDRTYPE IDS
    ibvnic1     dlmp_ib0   32000  80:0:0:4a:fe:..   fixed       PKEY:0xffff
  6. Display aggregation information.
    • To display the IP interface associated with each port, type the following command:
      $ dladm show-aggr -C dlmp_ib0
      LINK       PORT           SPEED DUPLEX   STATE     CLIENTS
      dlmp_ib0   --             32000Mb full    up       --
                 net4           32000Mb full    up       ibvnic1
                 net5           32000Mb full    up       --
    • To display the list of PKEYs associated with DLMP aggregation of InfiniBand HCA ports, type the following command:
      $ dladm show-aggr -v
      LINK              MODE  IDS
      dlmp_ib0          dlmp  PKEY:0xFFFF,0x8001
      trunk1            trunk --