C H A P T E R 4 |
Internet Protocol Over InfiniBand |
This chapter describes configuration aspects of running the Internet Protocol over InfiniBand (IPoIB) on Linux.
You might decide to change your IPoIB configuration for a variety of reasons, including the installation of an additional InfiniBand ExpressModule (IB EM).
To Install IPoIB Driver |
1. Determine whether the IPoIB driver is already installed by typing the
lsmod | grep ib command.
The output from this command shows all the IB drivers.
In the following sample output, note that the driver, ib_ipoib, is not listed.
2. To install the IPoIB driver, enter the modprobe command:
3. Enter the lsmod | grep ib command again and note that ib_ipoib is now listed.
4. Type the ifconfig command to check for network interface ib0.
Note that network interface ib0 is present but has no valid IP address.
To assign an address, see To Change IPoIB Configuration Without Rebooting.
To Change IPoIB Configuration Without Rebooting |
Caution - The changes made by this procedure are only temporary. These changes are lost during a reboot. To make permanent changes, see To Change IB Startup Behavior on Linux. |
1. Start the InfiniBand IP network by typing the ifconfig command and assigning a valid IP address for ib0.
If ib0 is unconfigured, it appears without an IP address as shown in the following output.
2. Type the route command to verify that the 10.0.0 subnet is available.
The following output shows subnet 10.0.0 present and routed through ib0.
3. As shown in the following example, you can enter the ping command to see another IPoIB node on the 10.0.0 subnet:
At this point, the IPoIB network is active and properly configured without rebooting.
To Change IB Startup Behavior on Linux |
You can change the InfiniBand startup behavior by editing the openib.conf configuration file. (The full path is /etc/infiniband/openib.conf).
In the following example, openib.conf specifies that whenever the system boots, the InfiniBand services, IPoIB, and the SDP IP service are to start up automatically (ONBOOT=yes, IPOIB_LOAD=yes, SDP_LOAD=yes). However, openib.conf specifies that the SRP service is NOT to start up automatically (SRP_LOAD=no). You can alter any and all of these parameters.
The following is an example of the ipoib.conf file.
2. Create (or edit) the ifcfg-ibn file to configure an individual network interface.
For each InfiniBand network interface, you will need a corresponding startup file (ifcfg-ibn) in your startup scripts directory.
The directory for startup scripts might be /etc/sysconfig/network/, /etc/sysconfig/network-scripts/, or similar, depending on your version of Linux distribution.
As an example, the startup file for ib0, might look something like the following.
more /etc/sysconfig/network-scripts/ifcfg-ib0 DEVICE=ib0 BOOTPROTO=static IPADDR=10.0.0.50 NETMASK=255.255.255.0 NETWORK=10.0.0.0 BROADCAST=10.0.0.255 ONBOOT=yes |
The ONBOOT=yes parameter indicates that the corresponding IP network interface is to automatically start up when the system boots. Specifying ONBOOT=no will configure the interface but not start it.
Generally, if you have enabled IPoIB services, the IB stack installation scripts automatically create the ifcfg-ibn configuration files for all IB network interfaces present. If you install an IB EM after you have installed the IB stack, you might need to manually create the ifcfg-ibn files for the newly installed network interfaces.
Copyright © 2008, Sun Microsystems, Inc. All Rights Reserved.