Oracle^® SuperCluster T5-8 Zones With Oracle Database on Database Domains Configuration Guide

Set Up VLAN Tagging for Zones

1. Log in to the nonglobal zone where you want to set up VLAN tagging.
2. Execute the following commands in the nonglobal zone to stop and disable the automatic startup of the Oracle Clusterware (CRS/HAS) software:

   # crsctl stop crs -f
   # crsctl disable crs
   

3. Log out of the nonglobal zone.
4. Log in to the Database Domain (the global zone) that contains the zones that you created.
5. Halt the zones that are in this Database Domain:

   # zoneadm -z zone_management_hostname halt
   

   where zone_management_hostname is the management host name (or Admin Name that was shown in Oracle Exadata Deployment Assistant) for this zone. For example:

   # zoneadm -z osc01zdbadm02 halt
   

6. Identify the client network devices to be used for this VLAN:
   1. Type:

      # ipmpstat -g
      

      Output similar to the following appears. Locate the line in the output for the bondeth0 interface, highlighted in the following example output:

      GROUP       GROUPNAME   STATE     FDT       INTERFACES
      bondmgt0    bondmgt0    ok        --        net0 (net1)
      bondib1     bondib1     ok        --        bondib1_0 (bondib1_1)
      bondib0     bondib0     ok        --        bondib0_0 (bondib0_1)
      bondeth0    bondeth0    ok        -- 
            net4 (net7)
      stor_ipmp0  stor_ipmp0  ok        --        stor_ipmp0_0 (stor_ipmp0_1)
      

   2. Note the entries for this line under the INTERFACES column.

      In the example output above, those entries would be net4 and net7.

   3. Type:

      # dladm show-phys | grep ixgbe
      

      Output similar to the following appears. Locate the lines in the output for the two entries that you noted in Step 6.b, highlighted in the following example output:

      net5              Ethernet             unknown    0      unknown   ixgbe3
      net1              Ethernet             up         1000   full      ixgbe1
      net6              Ethernet             unknown    0      unknown   ixgbe4
      net0              Ethernet             up         1000   full      ixgbe0
      net4              Ethernet           
       up         10000  full      ixgbe2
      net7              Ethernet           
       up         10000  full      ixgbe5
      

7. Modify the zone configuration:

   # zonecfg -z zone_management_hostname
   zonecfg: zone_management_hostname> select anet linkname=net_device#1
   zonecfg: zone_management_hostname:anet> set vlan-id=VLAN_ID
   zonecfg: zone_management_hostname:anet> set lower-link=net_device#1
   zonecfg: zone_management_hostname:anet> end
   zonecfg: zone_management_hostname> select anet linkname=net_device#2
   zonecfg: zone_management_hostname:anet> set vlan-id=VLAN_ID
   zonecfg: zone_management_hostname:anet> set lower-link=net_device#2
   zonecfg: zone_management_hostname:anet> end
   zonecfg: zone_management_hostname> verify
   zonecfg: zone_management_hostname> commit
   zonecfg: zone_management_hostname> exit
   

   where:

   • zone_management_hostname is the management host name (or Admin Name that was shown in Oracle Exadata Deployment Assistant) for this zone

   • VLAN_ID is a VLAN ID that you provide

   • net_device#1 is the first client network device that you saw in the output in Step 6.b

   • net_device#2 is the second client network device that you saw in the output in Step 6.b

   For example:

   # zonecfg -z osc01zdbadm02
   zonecfg: osc01zdbadm02> select anet linkname=net4
   zonecfg: osc01zdbadm02:anet> set vlan-id=13
   zonecfg: osc01zdbadm02:anet> set lower-link=net4
   zonecfg: osc01zdbadm02:anet> end
   zonecfg: osc01zdbadm02> select anet linkname=net7
   zonecfg: osc01zdbadm02:anet> set vlan-id=13
   zonecfg: osc01zdbadm02:anet> set lower-link=net7
   zonecfg: osc01zdbadm02:anet> end
   zonecfg: osc01zdbadm02> verify
   zonecfg: osc01zdbadm02> commit
   zonecfg: osc01zdbadm02> exit
   

8. Reboot the zone for the changes to take effect:

   # zoneadm -z zone_management_hostname reboot
   

   For example:

   # zoneadm -z osc01zdbadm02 reboot
   

9. Ping the default gateway to verify that the client network is up.
10. Log out of the Database Domain (the global zone).
11. Log in to the nonglobal zone where you set up VLAN tagging.
12. Execute the following commands in the nonglobal zone to enable and start the automatic startup of the Oracle Clusterware (CRS/HAS) software:

    # crsctl enable crs
    # crsctl start crs