Configuring IPoIB VNICs

Language:

IP over IB (IPoIB) devices enable transporting IP packets over IB connections. You configure IPoIB VNICs by specifying the partition key. Although you can migrate IPoIB VNICs from one underlying datalink to another underlying datalink, IPoIB partition links do not support migration. For more information, see About InfiniBand Devices in Managing Devices in Oracle Solaris 11.3.

How to Configure IPoIB VNICs

Become an administrator.
For more information, see Using Your Assigned Administrative Rights in Securing Users and Processes in Oracle Solaris 11.3.
(Optional) Check the information about the IB physical link over which you want to create the IPoIB datalink.
```
# dladm show-ib link
```
The output shows the datalinks and information about their partition keys.
Create an IPoIB VNIC by specifying the partition key.
```
# dladm create-vnic [-f] -l link -P pkey -p [prop=value] VNIC
```
–f

Optional. Forces the creation of the IPoIB VNIC even though the partition key is absent on the port, the multicast group is absent, or the port is down.

–P pkey

The partition key that needs to be used. This option is mandatory for IPoIB VNICs and not applicable for other types of datalinks. When you specify the partition key, it is always considered a hexadecimal, regardless of whether it has the 0x prefix.

–p prop=value
Used to specify the value of the linkmode property of the IPoIP VNIC, which enables you to set the link transport service type on an IB partition datalink. You can set the following values for the linkmode property:
- cm - connected mode. This mode uses a default MTU of 65520 bytes and supports a maximum MTU of 65535 bytes. If connected mode is not available for a remote node, unreliable datagram mode is automatically used. cm is the default value.
- ud - unreliable datagram mode. This mode uses a default MTU of 2044 bytes and supports a maximum MTU of 4092 bytes.
(Optional) Display the IPoIB VNIC that is created.
```
# dladm show-vnic
```
You can use the dladm show-vnic command to display only IPoIB VNICs that you create by using the dladm create-vnic command. The IPoIB datalinks that you create by using the dladm create-part command are not considered VNICs and you can display them by using the dladm show-part command.
Plumb and assign an IP address to an IPoIB VNIC.
```
# ipadm create-ip interface
# ipadm create-addr -a address interface [address-object]
```
interface

The name of the IPoIB VNIC that you created.

–a address

Specifies the IP address.

address-object

A name that identifies the IP address in association with the IP interface. If address-object is not specified, the OS automatically assigns a name by using the format IP-name/protocol.

Example 5 Creating IPoIB VNICs

The following example shows how to create an IPoIB VNIC over the datalink net4 by using the partition key 0xffff.

# dladm show-ib net4
LINK      HCAGUID        PORTGUID       PORT STATE GWNAME GWPORT  PKEYS
net4      21280001A0A58C 21280001A0A58D 1    up      --     --    FFFF
# dladm create-vnic -l net4 -P 0xffff ipoib_vnic0
# dladm show-vnic
LINK         OVER    SPEED  MACADDRESS        MACADDRTYPE IDS
eth_vnic0    net0    1000   2:8:20:ef:d2:77   random      VID:0
ipoib_vnic0  net4    32000  80:0:0:4a:fe:..   fixed       PKEY:0xFFFF
# dladm create-ip ipoib_vnic0
# ipadm create-addr -a 192.0.2.10 ipoib_vnic0/v4

You can also use the dladm show-vnic command with the –o option to display the entire MAC address of a VNIC or an IPoIB VNIC.

# dladm show-vnic -o link,macaddress
LINK            MACADDRESS
eth_vnic0       2:8:20:ef:d2:77
ipoib_vnic0     80:0:0:4a:fe:80:0:0:0:0:0:0:0:21:28:0:1:a0:a5:8e

The following example shows how to create the IPoIB VNIC vnic1 with the linkmode property set to ud.

# dladm create-vnic -l net4 -P 0xffff -p linkmode=ud vnic1