5.1 Configuring New Installations for Virtualization

Note:

The X2-4, X3-4, X4-4, X5-4, and X6-4 Exalytics Machines are certified with Oracle VM 3.3.3.

This section includes the following topics:

5.1.1 Before You Virtualize an Exalytics Machine

Before you virtualize an Exalytics Machine, review the following sections:

5.1.1.1 Documents to Review

As you prepare to virtualize an Exalytics Machine, do the following:

5.1.1.2 Prerequisites for Configuring Exalytics Machines for Virtualization

The following prerequisites must be met before you can virtualize an Exalytics Machine:

  • The Exalytics Machine has been racked and mounted in a data center.

  • Oracle Integrated Lights Out Manager (ILOM) 3.1.2.24 or later, is configured to be accessible from the network using the web interface.

  • All networking information such as host name, IP address, subnet, gateway, and DNS are available.

  • Spare, unassigned IP addresses are available for the server pool and for each virtual machine deployed on the Exalytics Machine.

  • A Linux environment is available to install Oracle VM Manager.

  • You have access to the internet from a computer (not necessarily the Exalytics Machine) to download required software.

5.1.1.3 Removing Existing Partitions

If required, remove the existing partition on /dev/sdb which is mounted to /u01 from the Exalytics Machine. You cannot create a repository on a Oracle Virtual Machine disk which contains a partition.

Note:

Before removing the existing partition, remember to back up all data on sdb1. If you are removing the existing partition on a new machine, you do not need to back up your data.

To remove existing partitions:

  1. Log in as the root user, and enter the following command to run the disk partition utility:

    # parted /dev/sdb

    The output should look similar to the following:

    GNU Parted 1.8.1
    Using /dev/sdb
    Welcome to GNU Parted! Type 'help' to view a list of commands.
    
  2. To display the existing partition, enter the following command:

    # print

  3. To remove the existing partition, enter the following command:

    # rm 1

  4. To confirm that the existing partition has been removed, enter the following command:

    # print

    The existing partition is removed.

5.1.1.4 Reconfiguring Existing RAID Configurations on the Exalytics Machine

This section consists of the following topics.

5.1.1.4.1 Reconfiguring Existing RAID Configurations on the X2-4 Exalytics Machine

The X2-4 Exalytics Machine comprises six hard drives, each having a capacity of 600 GB. Two drives are configured as RAID1 and four drives are configured as RAID5. To optimize the use of the disk space, you must reconfigure the RAID1 and RAID5 configurations on the Exalytics Machine. Reconfigure RAID1 so that it consists of two virtual drives of 100 GB and 457 GB, and RAID5 consists of the remaining drives.

To reconfigure existing RAID configurations on the X2-4 Exalytics Machine:

  1. Restart the Exalytics Machine using Integrated Lights Out Manager (ILOM).
  2. Press Ctrl+Y and enter RAID CLI (Command Line Interface) as the Exalytics Machine is restarting.

    Note:

    The "Copyright LSI Logic Corporation" displays during the restart sequence when it is possible to enter the RAID CLI. Observe the screen carefully as the message displays for a very short time. This avoids restarting the machine again.

  3. Enter the following MegaRAID command to delete the existing RAID configuration:

    # -CfgLdDel -LALL -a0

  4. Enter the following command to create a RAID1 partition with two virtual drives of size 100 GB and 457 GB:

    # -CfgLdAdd -r1[252:0, 252:1] WB Direct NoCachedBadBBU -sz102400 -sz467968 -a0

  5. Enter the following command to create a RAID5 partition with the remaining drives:

    # -CfgLdAdd -r5[252:2, 252:3, 252:4, 252:5] WB Direct NoCachedBadBBU -a0

  6. In the left pane of the ILOM, expand Host Management, then select Power Control. In the Select Action list, select Power Cycle, then click Save.

    The Exalytics Machine restarts.

5.1.1.4.2 Reconfiguring Existing RAID Configurations on the X3-4 Exalytics Machine

The X3-4 Exalytics Machine comprises 6 hard drives, each having a capacity of 900 GB.Two drives are configured as RAID1 and four drives are configured as RAID5. To optimize the use of the disk space, you must reconfigure the RAID1 and RAID5 configurations on the Exalytics Machine. Reconfigure RAID1 so that it consists of two virtual drives of 100 GB and 657 GB, and RAID5 consists of the remaining drives.

To reconfigure existing RAID configurations on the X3-4 Exalytics Machine:

  1. Restart the Exalytics Machine using Integrated Lights Out Manager (ILOM).
  2. Press Ctrl+Y and enter RAID CLI (Command Line Interface) as the Exalytics Machine is restarting.

    Note:

    The "Copyright LSI Logic Corporation" displays during the restart sequence when it is possible to enter the RAID CLI. Observe the screen carefully as the message displays for a very short time. This avoids restarting the machine again.

  3. Enter the following MegaRAID command to delete the existing RAID configuration:

    # -CfgLdDel -LALL -a0

  4. Enter the following command to create a RAID1 partition with two virtual drives of size 100 GB and 657 GB:

    # -CfgLdAdd -r1[252:0, 252:1] WB Direct NoCachedBadBBU -sz102400 -sz734688 -a0

  5. Enter the following command to create a RAID5 partition with the remaining drives:

    # -CfgLdAdd -r5[252:2, 252:3, 252:4, 252:5] WB Direct NoCachedBadBBU -a0

  6. In the left pane of the ILOM, expand Host Management, then select Power Control. In the Select Action list, select Power Cycle, then click Save.

    The Exalytics Machine restarts.

5.1.1.4.3 Reconfiguring Existing RAID Configurations on the X4-4 Exalytics Machine

The X4-4 Exalytics Machine comprises six hard drives, each having a capacity of 1.2 TB. Two drives are configured as RAID1 and four drives are configured as RAID5. To optimize the use of the disk space, you must reconfigure the RAID1 and RAID5 configurations on the Exalytics Machine. Reconfigure RAID1 so that it consists of two virtual drives of 100 GB and 1000 GB, and RAID5 consists of the remaining drives.

To reconfigure existing RAID configurations on the X4-4 Exalytics Machine:

  1. Restart the Exalytics Machine using Integrated Lights Out Manager (ILOM).
  2. Press Ctrl+Y and enter RAID CLI (Command Line Interface) as the Exalytics Machine is restarting.

    Note:

    The "Copyright LSI Logic Corporation" displays during the restart sequence when it is possible to enter the RAID CLI. Observe the screen carefully as the message displays for a very short time. This avoids restarting the machine again.

  3. Enter the following MegaRAID command to delete the existing RAID configuration:

    # -CfgLdDel -LALL -a0

  4. Enter the following command to create a RAID1 partition with two virtual drives of size 100 GB and 1000 GB:

    # -CfgLdAdd -r1[252:0, 252:1] WB Direct NoCachedBadBBU -sz102400 -sz999000 -a0

  5. Enter the following command to create a RAID5 partition with the remaining drives:

    # -CfgLdAdd -r5[252:2, 252:3, 252:4, 252:5] WB Direct NoCachedBadBBU -a0

  6. In the left pane of the ILOM, expand Host Management, then select Power Control. In the Select Action list, select Power Cycle, then click Save.

    The Exalytics Machine restarts.

5.1.1.4.4 Reconfiguring Existing RAID Configuration on an X6-4 and X5-4 Exalytics Machine

The X5-4 Exalytics Machine comprises six hard drives, each having a capacity of 1.2 TB. Two drives are configured as RAID1 and four drives are configured as RAID5. To optimize the use of the disk space, you must reconfigure the RAID1 and RAID5 configurations on the Exalytics Machine. Reconfigure RAID1 so that it consists of two virtual drives and RAID5 consists of the remaining drives.

To reconfigure existing RAID configurations on the X6-4 and X5-4 Exalytics Machine:

  1. Restart the Exalytics Machine using Integrated Lights Out Manager (ILOM).

  2. At the prompt, Press Ctrl><R> for WebBIOS... , press Ctrl+Y to access the LSI MegaRAID utility as the Exalytics Machine is restarting.

    Note:

    Observe the screen carefully as the Press Ctrl><R> for WebBIOS... .message displays for a very short time. This avoids restarting the machine again.

    The Virtual Drive Management screen is displayed.

  3. Delete the existing RAID configuration, by performing the following actions:

    1. Select the first virtual drive and Press F2.

    2. Select Delete VD.

    3. At the prompt, Press Yes.

    4. Repeat the above steps (a to c) to delete the second virtual drive.

  4. Create a RAID1 partition of two virtual drive, by performing the following actions:

    1. On the Virtual Drive Management screen, Press F2.

    2. Select Create Virtual Drive.

      The Create New VD screen is displayed.

    3. In the RAID Level drop down field, select RAID1.

    4. Under Basic Settings, in the Size field, enter 100.

    5. Select Advanced.

      The Create Virtual Drive-Advanced screen is displayed.

    6. Select Initialize, and then select OK.

      The "Initialization complete on VD 0" message is displayed.

    7. Select OK.

      The Virtual Drive Management screen displays the 100 GB virtual disk created.

    8. To create the second virtual drive, select Drive Group: 0, RAID1, press F2, and then select Add New VD.

    9. In the RAID Level drop down field, select RAID1.

    10. Under Basic Settings, in the Size field, accept the default value, and select Advanced.

    11. Select Initialize, and then select OK.

      The "Initialization complete on VD 1" message is displayed.

    12. Select OK.

      The Virtual Drive Management screen displays the RAID1 partition created of two virtual drives.

  5. Create a RAID5 partition with the remaining drives, by performing the following actions:

    1. On the Virtual Drive Management screen, select LSI MegaRAID, press F2, and then select Create Virtual Drive.

      The Create New VD screen is displayed.

    2. In the RAID Level drop down field, select RAID5.

    3. Select the four virtual drives (02, 03, 04, 05).

      Note:

      For each virtual drive, accept the default size of the drive.

    4. Select Advanced.

    5. Select Initialize, and then select OK.

      The "Initialization complete on VD 2" message is displayed.

    6. Select OK.

      The Virtual Drive Management screen displays the RAID5 partition created of four four virtual drives.

  6. In the left pane of the ILOM, expand Host Management, then select Power Control. In the Select Action list, select Power Cycle, then click Save.

    The Exalytics Machine restarts.

5.1.1.4.5 Resetting RAID Configuration (Optional)

If you are on a virtual Exalytics virtualization and want to revert back to a nonvirtual Exalytics deployment, you must reset the RAID configuration by performing the following steps:

To reset RAID configuration:

  1. Restart the Exalytics Machine using Integrated Lights Out Manager (ILOM).
  2. Press Ctrl+Y and enter RAID CLI (Command Line Interface) as the Exalytics Machine is restarting.

    Note:

    The "Copyright LSI Logic Corporation" displays during the restart sequence when it is possible to enter the RAID CLI. Observe the screen carefully as the message displays for a very short time. This avoids restarting the machine again.

  3. Enter the following MegaRAID command to delete the existing RAID configuration:

    # -CfgLdDel -LALL -a0

  4. Enter the following command to restore the RAID1 partition to an Exalytics deployment:

    # -CfgLdAdd -r1[252:0, 252:1] WB Direct NoCachedBadBBU -a0

  5. Enter the following command to create a RAID5 partition with the remaining drives:

    # -CfgLdAdd -r5[252:2, 252:3, 252:4, 252:5] WB Direct NoCachedBadBBU -a0

  6. In the left pane of the ILOM, expand Host Management, then select Power Control. In the Select Action list, select Power Cycle, then click Save.

    The Exalytics Machine restarts.

5.1.2 Configuring an Exalytics Machine for Virtualization

This section includes the following topics:

5.1.2.1 Installing and Configuring Oracle VM Server

This section includes the following topics:

5.1.2.1.1 Installing Oracle VM Server 3.3.3

To install Oracle VM Server 3.3.3:

  1. Navigate to the Oracle Software Delivery Cloud web site at the following link:

    http://edelivery.oracle.com

  2. In the Select a Product Pack list, select Oracle Exalytics Software 2.0.0.1.0.

  3. Select Release 2.1 related to the download queue.

  4. Click Continue.

  5. Choose the required part number in the available list of softwares.

  6. Download and unzip the Oracle Exalytics Base Image 2.2.0.1.0 for Exalytics Oracle VM x86-64 (Part number V789434-01) to a local directory.

    The zip file contains the Exalytics_2.2.0.0.0_X4-4_OVS3.3.3_751_<DATE>.iso file. Use this iso file to install the Oracle VM Server 3.3.3 on an X2-4, X3-4, X4-4 or X5-4 Exalytics Machine.

  7. On the Exalytics Machine, connect and log on to Oracle Integrated Lights Out Manager (ILOM).

    Note:

    If you are installing Oracle VM Server 3.2.9 on an X2-4 or X3-4 Exalytics Machine, you must use ILOM 3.1.2.24.d or later version. If you are installing Oracle VM Server 3.3.3 on an X4-4, X5-4 or X6-4 Exalytics Machine, you must use ILOM 3.2.4.18 or later version.

    For the latest Exalytics certified ILOM versions, see the Oracle Exalytics Certification Matrix. The Oracle Exalytics Certification Matrix is located at:

    http://www.oracle.com/technetwork/middleware/ias/downloads/fusion-certification-100350.html

  8. On the Summary Information screen, under Actions, click Launch to launch the Remote Console.

    The ILOM remote console is displayed.

  9. For X2-4, X3-4, X4-4, X5-4, or X6-4 machines, from the menu bar, select KVMS, then Storage.

    • Click Add to link to the Oracle VM Server 3.3.3 image (Exalytics_2.2.0.0.0_X4-4_OVS3.3.3_751_<DATE>.iso) as a remote virtual CD-ROM in ILOM.

    • Click Connect.

  10. In the left pane of the ILOM, expand Host Management, then select Host Control. In the Next Boot Device list, select CDROM, then click Save.

  11. Restart the machine by expanding in the left pane of the ILOM, Host Management, then select Power Control. In the Select Action list, select Power Cycle, then click Save.

    The Exalytics Machine restarts and displays the Oracle VM Server screen.

  12. Press Enter to install Oracle VM Server.

    The Oracle VM Server is installed on the Exalytics Machine. After Oracle VM Server is installed, the Exalytics Machine restarts automatically.

5.1.2.1.2 Installing Oracle VM Server 3.3.3 on X6-4 and X5-4 Machines

To install Oracle VM Server 3.3.3:

  1. Navigate to My Oracle Support (MOS) and download the patch number 22546910.

  2. Download the package and unzip to a local directory.

    The downloaded zip file contains Exalytics_2.2.0.0.0_X6-4_OVS3.3.3_<DATE>.iso and a patch file p20431965_20001_Linux-x86-64.zip.

  3. On the Exalytics Machine, connect and log on to Oracle Integrated Lights Out Manager (ILOM).

    Note:

    For the latest Exalytics certified ILOM versions, see the Oracle Exalytics Certification Matrix. The Oracle Exalytics Certification Matrix is located at:

    http://www.oracle.com/technetwork/middleware/ias/downloads/fusion-certification-100350.html

  4. On the Summary Information screen, under Actions, click Launch to launch the Remote Console.

    The ILOM remote console is displayed.

  5. From the menu bar, select KVMS, then Storage. Click Add to link to the Oracle VM Server 3.3.3 image for X6-4 machine (Exalytics_2.2.0.0.0_X6-4_OVS3.3.3<DATE>.iso) as a remote virtual CD-ROM in ILOM. Click Connect.

  6. In the left pane of the ILOM, expand Host Management, then select Host Control. In the Next Boot Device list, select CDROM, then click Save.

  7. Restart the machine by expanding in the left pane of the ILOM, Host Management, then select Power Control. In the Select Action list, select Power Cycle, then click Save.

    The Exalytics Machine restarts and displays the Oracle VM Server screen.

  8. Press Enter to install Oracle VM Server.

    The Oracle VM Server is installed on the Exalytics Machine. After Oracle VM Server is installed, the Exalytics Machine restarts automatically.

5.1.2.1.3 Postinstallation Steps

Perform the following postinstallation steps to configure the network on Oracle VM Server.

Editing the /etc/sysconfig/network File

You edit the /etc/sysconfig/network file to add the hostname of the machine and gateway and netmask for the network.

To edit the /etc/sysconfig/network file:

  1. Navigate to and open the /etc/sysconfig/network file in a text editor.

  2. Change the HOSTNAME to the name of the machine.

  3. Enter the GATEWAY and NETMASK for the network.

    For example:

    NETWORKING=yes

    NETWORKING_IPV6=no

    GATEWAY=xx.xxx.xxx.x

    NETMASK=xxx.xxx.xxx.x

    HOSTNAME=<name of the machine>

  4. Save the file.

Configuring bond0

You configure bond0 by editing the ifcfg-bond0 file.

To edit the ifcfg-bond0 file:

  1. Navigate to and open the /etc/sysconfig/network-scripts/ifcfg-bond0 file in a text editor.

  2. Change the BOOTPROTO to static.

    For example:

    BOOTPROTO=static

  3. Add the IP Address of the machine.

    For example:

    IPADDR=xx.xxx.xx.xxx

Editing the hosts File

To edit the hosts file:

  1. Navigate to and open the /etc/hosts file in a text editor.

  2. Add the IP Address, host name, and alias for the host.

    For example:

    xx.xxx.xx.xxx exalyticsHost1.mycompany.com.exalytics Host1

    Note:

    Ensure the IP Address of the host is the same as the IP Address you entered in the ifcfg-bond0 file.

Editing the resolv.conf File

To edit the resolve.conf file:

  1. Navigate to and open the /etc/resolve.conf file in a text editor.

  2. Enter the DNS Server name and the Search base.

    For example:

    nameserver xxx.xxx.xxx.xxx

    search xxx.mycompany.com

    Note:

    You can create additional bonded ports from Oracle VM Manager after the server is registered. See Creating a New Network Channel for Virtual Machines

Restarting the Exalytics Machine

To restart the Exalytics Machine:

  1. In the left pane of the ILOM, expand Host Management, then select Power Control.

  2. In the Select Action list, select Power Cycle, then click Save.

5.1.2.1.4 Upgrading Exalytics Base Image

You upgrade the Exalytics Base Image for Oracle VM 2.2.0.1.0 by applying the patch on Oracle VM Server. The patch upgrades the Base Image to 2.2.0.1.0, installs Flash drivers and utilities.

To upgrade Oracle Exalytics Base Image for Oracle VM to 2.2.0.1.0:

  1. Use the appropriate patch for the machines:

    1. For X6-4 machine using Oracle VM Server 3.3.3, use the patch file p20431965_20001_Linux-x86-64.zip downloaded in Installing Oracle VM Server 3.3.3 on X6-4 and X5-4 Machines.

    2. For X5-4 machine using Oracle VM Server 3.3.3, use the patch file p20431965_20001_Linux-x86-64.zip downloaded in Installing Oracle VM Server 3.3.3 on X6-4 and X5-4 Machines.

    3. For X4-4 and earlier machines, navigate to My Oracle Support and download patch number 20431965: Patchset Upgrade Utility for Exalytics Base Image 2.2.0.1.0 Oracle VM for Linux x86-64. The patch contains the p2.6.39-400.248.3.el6uek x86_64.zip file. The zipped file contains Flash drivers and Flash configurator scripts.

  2. Log on to the Exalytics Machine as the root user.

  3. Extract the contents of the file into an appropriate directory on the Exalytics Machine.

  4. Unzip the file into a temporary (/tmp) directory.

    The following directory is created:

    exalytics_ovs_server_base_image_upgrade_to_2.2.0.1.0.

  5. Navigate to the directory by entering the following command:

    # cd exalytics_ovs_server_base_image_upgrade_to_2.2.0.1.0

  6. To upgrade the Base Image to 2.2.0.1.0 and to install Flash, enter the following command:

    # ./update.sh

    The output looks similar to the following:

    current_kernel_version=2.6.39-400.215.9.el6uek 
    minimum_kernel_version=2.6.39-400.215.9.el6uek
     
    OS Version check passed..
    Update to 2.2.0.1.0.ovs-3.2.9 starting at DAY-DD-MM-YYYY HR:MIN:SEC
    Removing unnecessary packages...
    Skipping removing rpm kernel-ib-devel as it doesn't exist...
     
    Skipping removing rpm kernel-ib as it doesn't exist...
    Skipping removing rpm ibvf-config as it doesn't exist...
    Removing RPM OpenIPMI-tools ...
    Done
     
    Running new install steps...
    Preparing...         ################################################## [100%]
    exalogic.tools       ################################################## [100%]
    --------------------------------------------------------
     
           Successfully installed exalogic.tools
     
    --------------------------------------------------------
    .....[exalogic.tools] := Post Transaction called...............
    Running update...
    Applying libibumad
    Preparing...          ################################################## [100%]
    libibumad             ################################################## [100%]
    Preparing...          ################################################## [100%]
    libibmad              ################################################## [100%]
    Preparing...          ################################################## [100%]
    openib                ################################################## [100%]
    Preparing...          ################################################## [100%]
    opensm-libs           ################################################## [100%]
    opensm                ################################################## [100%]
    error: Failed dependencies:
    infiniband-diags is needed by ovsvf-config-1.0-10.noarch
     
    Preparing...          ################################################## [100%]
    infiniband-diags      ################################################## [100%]
    Preparing...          ################################################## [100%]
    exalytics-flash       ################################################## [100%]
    postInstall (exalytics-flash) 1 ...
    [EXALYTICS_INFO:GENERAL] Updating exalytics-flash-config file to set FLASH_INSTALL_TYPE=OVS ...
    postInstall (exalytics-flash) 1; done
    Preparing...          ################################################## [100%]
    Installing....
    Lib_Utils             ################################################## [100%]
    MegaCli               ################################################## [100%]
    Preparing...          ################################################## [100%]
    hesiod                ################################################## [100%]
    autofs                ################################################## [100%]
    sas_snmp              ################################################## [100%]
    Starting snmpd
    Starting snmpd: [  OK  ]
     
    Registering Service lsi_mrdsnmpd
    Starting LSI SNMP Agent
    Starting LSI SNMP Agent:LSI MegaRAID SNMP Agent Ver 3.18.0.2 (Oct 30th, 2012) Started
    [  OK  ]
    Preparing...          ################################################## [100%]
    policycoreutils-1.33.12-14.8.el6
    oracle-hmp-libs       ################################################## [100%]
    oracle-hmp-hwmgmt     ################################################## [100%]
    /usr/sbin/semanage: SELinux policy is not managed or store cannot be accessed.
    ipmiflash             ################################################## [100%]
    ipmitool              ################################################## [100%]
     
    mstflint              ################################################## [100%]
    oracle-hmp-snmp       ################################################## [100%]
    oracle-hmp-tools      ################################################## [100%]
    oracle-hmp-tools-biosconfig############################################# [100%]
    oracle-hmp-tools
    ubiosconfig           ################################################## [100%]
    QConvergeConsoleCLI   ################################################## [100%]
    Preparing...          ################################################## [100%]
    package glibc-common-2.5-123.0.1.el6_11.1.x86_64 is already installed
    package glibc-2.5-123.0.1.el6_11.1.x86_64 is already installed
    package glibc-2.5-123.0.1.el6_11.1.i686 is already installed
    package nscd-2.5-123.0.1.el6_11.1.x86_64 is already installed
     
    Removing bm flash scripts...
    Running post install script...
    Running post patch script
    
    Setting SET_IPOIB_CM=yes
    file /etc/sysconfig/network-scripts/ifcfg-bondib0 not found
    /usr/lib/init-exalogic-node/init-ipoib.sh not exist in /etc/rc.local , nothing to delete
    Completed post patch script
    
    Enabling services...
    Updating dom0 memory to 16G.. 
    Copying Exa* files...
    Updating imageinfo...
    Image name in imageinfo is already uptodate
    finished; DAY-DD-MM-YYYY HR:MIN:SEC
    finished; DAY-DD-MM-YYYY HR:MIN:SEC
    
  7. To verify that the upgrade was successful, enter the following command:

    # imageinfo

    The output looks similar to the following:

    Exalytics 2.2.0.1.0.ovs-3.3.3 (build:r20151215.1)
     
    Image version       : 2.2.0.1.0.ovs-3.3.3
    Image build version : 20151215.1
    Creation timestamp  : 2016-09-19_21-25-14
    Kernel version      : 3.8.13-68.3.3.el6uek.x86_64
    Image activated     : 2016-09-19_21-25-14
    Image status        : SUCCESS
    
  8. To verify that Flash is installed and the number of Flash cards installed, enter the following command:

    # ddcli

    For an X2-4 or X3-4 configuration, six Flash cards are displayed. The output looks similar to the following:

    ****************************************************************************
       LSI Corporation WarpDrive Management Utility
       Version  107.00.00.04 (2012.06.05)
       Copyright (c) 2011 LSI Corporation. All Rights Reserved.
    ****************************************************************************
     
    ID    WarpDrive     Package Version    PCI Address
    --    ---------     ---------------    -----------
    1     ELP-4x100-4d-n    08.05.01.00        00:11:00:00
    2     ELP-4x100-4d-n    08.05.01.00        00:21:00:00
    3     ELP-4x100-4d-n    08.05.01.00        00:31:00:00
    4     ELP-4x100-4d-n    08.05.01.00        00:a1:00:00
    5     ELP-4x100-4d-n    08.05.01.00        00:c1:00:00
    6     ELP-4x100-4d-n    08.05.01.00        00:d1:00:00
     
    Select the WarpDrive [1-6 or 0:Quit]: 0
    

    Note:

    For an X4-4, X5-4, and X6-4 configuration, three Flash cards are displayed.

5.1.2.2 Installing and Configuring Oracle VM Manager

You install and configure Oracle VM Manager, as described in the following sections:

5.1.2.2.1 Installing Oracle VM Manager 3.2.9 on Exalytics X2-4, X3-4, and X4-4 Machines

Oracle recommends that you install Oracle VM Manager on a separate machine than the Exalytics Machine, preferably colocated geographically within Oracle VM Server.

To install Oracle VM Manager 3.2.9:

  1. Download patch number 16410417 from the My Oracle Support web site at the following link:
  2. Install Oracle VM Manager 3.2.9. For instructions, see Chapter 4, "Installing Oracle VM Manager" in Oracle VM Installation and Upgrade Guide for Release 3.2. The guide is located at:

5.1.2.2.2 Installing Oracle VM Manager 3.3.3 on Exalytics X6-4 and X5-4 Machines

Oracle recommends that you install Oracle VM Manager on a separate machine than the Exalytics machine, preferably colocated geographically within Oracle VM Server. OVM Manager 3.3.3 is supported with X6-4 and X5-4 servers due to NVMe hardware incompatibility in OVM Manager 3.2.9.

To install Oracle VM Manager 3.3.3:

  1. Download the Oracle VM Manager from the following link:

    https://edelivery.oracle.com/osdc/faces/SearchSoftware

    1. In the Oracle Software Delivery Cloud home page, select the checkbox

      Linux/OVM/VMs

    2. Search by entering Oracle VM Manager 3.3.3 in the search box.

    3. Select Releases in the drop down.

    4. Click Continue. It will prompt to download

      V77113-01.iso

  2. Unzip the downloaded file. It should contain the installer ISO file.

  3. Mount the ISO file to a directory as the root user with the following command:

    #mkdir /OVMCD

    #mount –o loop ovmm-3.3.3-installer-OracleLinux-b1085.iso /OVMCD

  4. Run the Oracle VM Manager installer using the following commands:

    #cd /OVMCD

    #./ createOracle.sh

    #./runInstaller.sh

  5. Install Oracle VM Manager 3.3.3. For instructions, see "Installing Oracle VM Manager" in Oracle VM Installation and Upgrade Guide for Release 3.2. The guide is located at:

    http://docs.oracle.com/cd/E35328_01/E35330/html/index.html

5.1.2.2.3 Discovering Oracle VM Servers

Adding Oracle VM Servers to your Oracle VM Manager environment is known as discovering Oracle VM Servers. Discovering servers is the first step to configuring the virtualization environment.

To discover Oracle VM Servers:

  1. Connect to Oracle VM Manager.

  2. Select the Servers and VMs tab.

  3. In the left pane, right-click Server Pools, and then select Discover Servers.

    The Discover Dialog box is displayed.

  4. Enter the following information for the server:

    1. Oracle VM Agent Port. The default port number is 8899.

    2. Oracle VM Agent Password. The default password is "oracle".

    3. IP Address.

  5. Click OK.

    Oracle VM Server and its details, including number of processors, IP address, processor speed, RAM, networking ports and configuration are discovered and added to the Unassigned Servers folder.

For more information, see "Chapter 6, Managing Server Pools and Oracle VM Servers" in Oracle VM User's Guide for Release 3.2.

5.1.2.2.4 Creating Virtual Network Interface Controllers

A Virtual Network Interface Controller (VNIC) is used by virtual machines as network cards. You create virtual network interfaces by defining a range of MAC addresses to use for each VNIC. Each MAC address corresponds with a single virtual Network Interface Controller (NIC), which is used by a virtual machine.

To create Virtual Network Interface Controllers:

  1. Log on to Oracle VM Manager.
  2. Select the Servers and VMs tab.
  3. In the left pane, right-click Server Pools, and then select Create VNICs.

    The MAC selector panel is displayed.

  4. Click Next to retrieve the next available MAC addresses.
  5. Select the number of addresses that you want to create, and click Create.

    Note:

    Select the number of addresses that corresponds to the number of virtual machines you are deploying.

    The VNICs are created and listed in the Virtual NIC table.

  6. Click Close.

For more information, see "Chapter 7, Managing Virtual Machines" in Oracle VM User's Guide for Release 3.2.

5.1.2.2.5 Creating Server Pools and Adding a Server

A server pool consists of at least one Oracle VM Server. If you find a server pool does not have sufficient resources, such as CPU or memory, to run the virtual machines, you can expand the server pool by adding more Oracle VM Servers.

Before creating a server pool, you must have:

  • An IP address for the server pool

  • An IP address for each virtual machine

  • The password to access the Oracle VM Agent installed on Oracle VM Server

For information on creating server pools and adding servers, see "Chapter 6, Managing Server Pools and Oracle VM Servers" in Oracle VM User's Guide for Release 3.2.

Note:

When creating a server pool, you must deselect the Activate Cluster option.

5.1.2.2.6 Creating an Exalytics Repository

A repository stores Oracle VM resources, such as virtual machines, templates for creating virtual machines, virtual machine assemblies, and so on.

Note:

Oracle recommends that you create a repository on each physical disk available. Use the smaller repository to store Oracle VM templates and cloned virtual machines and the larger repository to store virtual drives that are assigned to the virtual machines.

You use Oracle VM Manager to create and configure Exalytics repositories, and to present the repositories to Oracle VM Servers.

To create an Exalytics repository:

  1. Log on to Oracle VM Manager.

  2. Select the Repositories tab.

  3. In the toolbar, click Create New Repository to display the Create a Data Repository dialog.

  4. Perform the following actions:

    1. In the Repository Name field, enter the name for the repository.

    2. For Repository Location, select Physical Disk and click Search.

    3. From the drop-down list, select a local storage array and select the smaller of the two storage drives.

    4. Click OK.

    5. Select the server pool for the repository.

    6. Click Next.

      The new repository is available to be presented to Oracle VM Server. To enable your Oracle VM Server to use the repository, you must present the repository to Oracle VM Server.

  5. Select and move Oracle VM Server from the Servers field to the Present to Server(s) field and click Finish.

    The repository is listed in the Repository tab.

For more information, see "Chapter 4, Managing Storage" in Oracle VM User's Guide for Release 3.2.

5.1.2.2.7 Creating VM Network Channel

You create a VM Network channel in Oracle VM Manager to enable Oracle VM Guests in the server pool to communicate with each other and also to communicate with external networks. The VM Network channel instructs Oracle VM Servers to create a Xen bridge that controls network traffic to and from Oracle VM Guests.

A Server Management Network channel that enables communication between Oracle VM Manager and Oracle VM Servers is automatically created by Oracle VM Manager. You can use this existing Server Management Network channel to communicate with virtual machines, or create a new network channel.

Note:

Oracle recommends that you create a new network channel for the virtual machines.

To create a VM Network Channel, follow the procedures described in one of the following topics:

Using the Existing Server Management Network Channel for Virtual Machines

For simple network deployments, you can use the default Server Management Network channel to communicate with virtual machines.

To use the Existing Server Management Network channel for Virtual Machines:

  1. Log on to Oracle VM Manager.

  2. Select the Networking tab.

  3. Select the Server Management Network channel address.

    Note:

    The Server Management Network channel address is similar to the Gateway address you entered except the trailing digit at the end of the address is a zero. For example, if you entered 10.244.138.1 as the Gateway address, the Server Management Network channel address is displayed as 10.244.138.0.

  4. Click the Edit icon.

    The Edit Network screen in displayed.

  5. To enable the virtual machine to connect the Server Management Network channel, select Virtual Machine.

  6. Click Next.

  7. Accept the default server settings, and click Next.

  8. Accept the default port settings, and click Next.

  9. Click Finish.

    The Virtual Machine column against the Server Management Network channel address displays a check mark indicating that the virtual machine is connected to the network.

Creating a New Network Channel for Virtual Machines

Before you can create a new network channel you must connect additional Ethernet cable to the Gigabit Ethernet connector ports and create a new bonded port through the Oracle VM Manager user interface.

Note:

The following procedure describes how to create and use a bonded port for the network channel. If you need to, you can use a single ethernet port for the channel instead of a bond. Oracle recommends using a bonded port.

To create a new bonded port and network channel:

  1. Log on to Oracle VM Manager.

  2. Select the Servers and VMs tab.

  3. To create a new bonded port, perform the following tasks:

    1. In the left pane, expand Server Pools, and then select the Exalytics Machine on which the Oracle VM Server is running.

    2. In the Perspective list, select Bond Ports.

    3. Click Create Bond Port.

      The Create Bond Port page is displayed.

    4. In the Addressing list, select IP Address.

    5. In the IP Address field, enter an IP address for the bond.

    6. In the Mask field, enter a Netmask for the bond.

    7. Leave the MTU field at the default number.

    8. Enter a description for the bond.

    9. In the Available Ports section, select the connected ports and move it to the Selected Ports section.

    10. Click OK.

  4. To create a new network channel, perform the following tasks:

    1. Select the Networking tab.

    2. Click Create New Network.

      The Create Network page is displayed.

    3. Select Create a network with bond/ports only, and click Next.

    4. In the Name field, enter a name for the network.

    5. Enter a description.

    6. Select Virtual Machine, and then click Next.

    7. In the Available Servers section, select the server on which the Oracle VM Manager is running, move it to the Selected Servers section, and then click Next.

    8. In the Available Ports section, select the bonded port you created in Step 3, move it to the Selected Ports section, and then click Next.

      The Ports page is displayed.

    9. Confirm the settings on the Ports page and then click Finish.

For more information, see "Chapter 5, Managing Networks" in Oracle VM User's Guide for Release 3.2.

5.1.2.3 Upgrading to Oracle Exalytics Release 2.1 on a Virtualized Environment

New customers must upgrade to Oracle Exalytics Release 2.1 (2.0.0.1.0) on the virtualized environment. For instructions, see Upgrading to Oracle Exalytics Release 2.1 (2.2.0.0.0.ovs-3.3.3) on Virtual Deployments

5.1.2.4 Creating Virtual Machines

You use virtual templates to create virtual machines. The process of creating a virtual machine from a template is known as cloning. Before you create virtual machines, ensure that you have the following resources available:

  • A server pool

  • An Oracle VM Server

  • VM templates

The process of creating virtual machines from templates consists of the following steps:

5.1.2.4.1 Downloading VM Templates

To download VM templates:

  1. Download and save the Exalytics Oracle Release 2 VM Template (2.2.0.0.0) for Exalytics Oracle VM x86-64, by performing the following steps:

    1. Navigate to the Oracle Software Delivery Cloud web site at the following link:

      http://edelivery.oracle.com

    2. In the Select a Product Pack list, select Oracle Business Intelligence.

    3. In the Platform list, select Linux X86-64.

    4. Click Go.

    5. Select Oracle Exalytics Software Media Pack for Linux x86-64 Release: 2.0.0.0.

    6. Click Continue.

    7. To install VM template on a Linux 6 operating system, download the Oracle Exalytics Oracle VM Template 2.2.0.0.0.el6, Part Number:V76309-01.

    8. Save the template on a web server.

5.1.2.4.2 Importing VM Templates into Oracle VM Manager

After downloading the templates, you import them into Oracle VM Manager.

To import VM templates into Oracle VM Manager:

  1. Log on to Oracle VM Manager.
  2. Select the Repositories tab.
  3. In the left pane, select the Repository in which you want to store the template.
  4. Select VM Templates.
  5. In the toolbar, click Import VM Template to display the Import VM Template dialog.
  6. Select the Oracle VM Server and enter the HTTP or FTP URL to the VM template that you downloaded on the web server.
  7. Click OK to import the VM template.

5.1.2.4.3 Creating Virtual Machines from VM Templates

After importing the template in Oracle VM Manager, you use the template to create a virtual machine.

Note:

Oracle recommends that you use Oracle VM Manager to create virtual drives of the sizes required for your system on the larger repository. Associate these virtual drives with the virtual machines deployed on your system. These virtual drives provide enough storage for installing the Exalytics software and the various files associated with the Exalytics Machine.

Before you create virtual machines, keep the following guidelines in mind:

  • Ensure that Hyperthreading is disabled on Oracle VM Server and in order to disable the hyperthreading, update the vCPUs value to 10 in the grub.conf file.

    Note:

    Oracle recommends that Hyperthreading be disabled when creating new virtual machines.

  • Maximum number of virtual machines you can create for a non-InfiniBand configuration on an X2-4, X3-4, X4-4, X5-4, and X6-4 Exalytics Machine is ten.

  • Total virtual processors (vCPUs) you can assign on Oracle VM Server for an X2-4, X3-4, X4-4, X5-4, and X6-4 Exalytics Machine is ten.

  • Total memory you can allocate on Oracle VM Server for an X2-4, X3-4, X4-4, X5-4, and X6-4 Exalytics Machine is 16 GB.

  • Review Table 5-1 for the total vCPUs and memory you can allocate on all virtual machines and the maximum vCPUs and memory you can allocate to each virtual machine.

Table 5-1 Total and Maximum vCPUs and Memory Allowed For Virtual Machines

System Total vCPUs for all Virtual Machines Maximum vCPUs for each Virtual Machine Total RAM for all Virtual Machines Maximum RAM for each Virtual Machine

X2-4

40

28

984 GB

800 GB

X3-4

40

28

984 GB

800 GB

X4-4

60

28

1984 GB

800 GB

X5-4

72

28

1984 GB

800 GB

X6-4

72

28

1984 GB

800 GB

Note:

For the X2-4 and X3-4 Exalytics Machine, total memory on Oracle VM Server (16 GB) and all virtual machines (984 GB) cannot exceed 1000 GB. For the X4-4, X5-4, and X6-4 Exalytics Machine, total memory on Oracle VM Server (16 GB) and all virtual machines (1984 GB) cannot exceed 2000 GB.

To create virtual machines from a VM template:

  1. Log on to Oracle VM Manager.

  2. Select the Servers and VMs tab.

  3. In the left pane toolbar, click Create Virtual Machine.

    The Create Virtual Machine dialog is displayed.

  4. Select Clone from an existing VM Template.

  5. Perform the following actions:

    1. In the Clone Count list, select the number of machines you want to clone.

    2. In the Repository list, select a repository for the machine.

    3. In the VM Template list, select the VM template from which you want to create the virtual machine.

    4. Enter a name for the virtual machine.

    5. In the Server Pool list, select a server pool.

    6. Enter a description for the virtual machine.

  6. Click Finish.

    The virtual machine is created and is ready to be configured.

    To configure and start a virtual machine, configure a network on a virtual machine, and configure SWAP on a virtual machine, see Maintaining Virtual Machines.

For more information, see "Chapter 7, Managing Virtual Machines" in Oracle VM User's Guide for Release 3.2.