4.9.3 Changing InfiniBand Network Information
This procedure describes how to change the InfiniBand network information.
The procedure described in this section is based on the following assumptions:
-
All changes should be done as the
ilom-admin
user using the Integrated Lights Out Manager (ILOM) interface. -
Channel bonding is used for the client access network, such that the NET1 and NET2 interfaces are bonded to create BONDETH0. If channel bonding is not used, then replace BONDETH0 with NET1 in the procedure.
-
On Oracle Exadata X4-2 and later hardware, as of Oracle Exadata System Software release 11.2.3.3.0, the name used for InfiniBand bonding changed from BONDIB0 to IB0 and IB1. These interfaces are changed the same way as the
ifcfg-bondib0
interface. -
As of Oracle Exadata System Software release 11.2.2.1.0, the names used for bonding changed. The names are BONDIB0 for the InfiniBand bonding and BONDETH0 for Ethernet bonding. In earlier releases, the names were BOND0 and BOND1, respectively.
-
The procedure uses the
dcli
utility and theroot
user. This significantly reduces the overall time to complete the procedure by running the commands in parallel on the database servers. -
The
dcli
utility requires SSH user-equivalence. If SSH user-equivalence is not configured, then some commands must be run explicitly on each database server. -
The database group file,
dbs_group
, must exist and be located in the/root
directory. -
Ensure recent backups of the Oracle Cluster Registry (OCR) exist before changing the InfiniBand network information. OCR backups are located in the
$Grid_home/cdata/cluster-name
directory, where Grid_home represents the location of your Oracle Grid Infrastructure software installation. -
Starting with Oracle Grid Infrastructure 11g release 2 (11.2), the private network configuration is stored in the Grid Plug and Play (GPNP) profile as well as the OCR. If the GPNP definition is not correct, then Oracle Clusterware CRS does not start. Take a backup of the GPNP profile on all nodes before changing the InfiniBand network information using the following commands:
$ cd $Grid_home/gpnp/hostname/profiles/peer/ $ cp -p profile.xml profile.xml.bk