6.8 Checking Oracle Exadata Database Servers

Before installing the software, check the configuration of the Oracle Exadata Database Servers.

Perform the following checks on each Exadata database server:

  1. Connect to the database server console.

    Use one of the following connection options:

    • Attach a serial cable between a console and the SER MGT port on the server.

      Connections through the modular jack serial port must use shielded cables to comply with radio frequency emission limits.

      Set the terminal device communication properties to these values: 9600 baud, 8 bit, no parity, 1 stop bit.

      After you connect to ILOM, run the start /SP/console command to connect to the host console.

      For more details, see Connect to Oracle ILOM.

    • Attach an Ethernet cable to the NET MGT port on the server and then connect using a workstation on the network.

      After you connect to ILOM, run the start /SP/console command to connect to the host console.

      For more details, see Connect to Oracle ILOM.

    • Connect using the KVM switch, if one is available.
  2. Log in as the root user to the database server.

    Note:

    If you do not have the password for the root user, then contact Oracle Support Services.
  3. Verify the SysSN label for the server matches the product_serial_number value using the following command:

    # ipmitool sunoem cli "show /SYS product_serial_number"
    Connected.Use ^ D to exit.
    ->show /SYS product_serial_number
    
    /SYS
       Properties: 
           product_serial_number =093ABCD5001
    
    ->Session closed
    Disconnected
  4. Change to the /opt/oracle.SupportTools/firstconf directory.

    cd /opt/oracle.SupportTools/firstconf
  5. Create a group file with the list of server IP addresses to use in the dcli utility commands, if required.

    If you are configuring Oracle Exadata Rack X8M, then you must manually create a file and add the IP addresses.

    On racks that use InfiniBand Network Fabric, you can use the following command to identify the servers and copy the results into a text file.

    # ibhosts | awk '/elastic/ {print $8}' | cut -c1-14 > group_file
    

    In the preceding command, group_file is name of the file to create with the server IP addresses.

  6. Verify the hardware profile is correct using the following command. The command checks CPU type and count, component firmware, and so on.

    # dcli -l root -g group_file "/opt/oracle.SupportTools/CheckHWnFWProfile  \
    -c  strict" > /tmp/checkhwfw.out
    
    # more /tmp/checkhwfw.out

    The following is an example of a check that failed:

    172.108.1.6:[WARNING ]The hardware and firmware are not supported.
    See details below
    [DiskControllerPCIeSlotWidth ]
    Requires:
    x8
    Found:
    x4
    [WARNING ]The hardware and firmware are not supported. See details above

    If a profile check fails and the firmware needs to be refreshed, then run the following command from the system with the problem.

    # /opt/oracle.SupportTools/CheckHWnFWProfile -U /opt/oracle.cellos/iso/cellbits
    Now updating the ILOM and the BIOS …

    The command must be entered on a single line. After running the command, power off the system, reset the Integrated Lights Out Manager (ILOM), and wait 10 minutes before powering on the system.

  7. Verify the disks on the server are visible and online.

    • If you are using Oracle Exadata System Software release 19c or later, then use the following command:

      # cd /opt/MegaRAID/storcli
      # ./storcli64 /call show | grep "Physical Drives" -A 25
      Physical Drives = 8
      
      PD LIST :
      =======
      
      ------------------------------------------------------------------------------
      EID:Slt DID State DG       Size Intf Med SED PI SeSz Model            Sp Type
      ------------------------------------------------------------------------------
      39:0     31 Onln   0 278.464 GB SAS  HDD N   N  512B ST930003SSUN300G U  -
      39:1     35 Onln   0 278.464 GB SAS  HDD N   N  512B ST930003SSUN300G U  -
      39:2     41 Onln   0 278.464 GB SAS  HDD N   N  512B H103030SCSUN300G U  -
      39:3     37 Onln   0 278.464 GB SAS  HDD N   N  512B ST930003SSUN300G U  -
      39:4     38 Onln   0 278.464 GB SAS  HDD N   N  512B ST930003SSUN300G U  -
      39:5     44 Onln   0 278.464 GB SAS  HDD N   N  512B H109030SESUN300G U  -
      39:6     33 Onln   0 278.464 GB SAS  HDD N   N  512B ST930003SSUN300G U  -
      39:7     43 Onln   0 278.464 GB SAS  HDD N   N  512B ST930003SSUN300G U  -
      ------------------------------------------------------------------------------
      
      EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup
      DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare
      UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface
      Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
      SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition|F-Foreign
      UGUnsp-Unsupported|UGShld-UnConfigured shielded|HSPShld-Hotspare shielded
      CFShld-Configured shielded|Cpybck-CopyBack|CBShld-Copyback Shielded
      
      
    • If you are using Oracle Exadata System Software release 18c or earlier, then use the following command:

      # cd /opt/MegaRAID/MegaCli
      # ./MegaCli64 -Pdlist -aAll |grep "Slot \|Firmware"
      Slot Number:0
      Firmware state:Online, Spun Up
      Slot Number:1
      Firmware state:Online, Spun Up
      Slot Number:2
      Firmware state:Online, Spun Up
      Slot Number:3
      Firmware state:Online, Spun Up
      Slot Number:4
      Firmware state:Online, Spun Up
      Slot Number:5
      Firmware state:Online, Spun Up
      Slot Number:6
      Firmware state:Online, Spun Up
      Slot Number:7
      Firmware state:Online, Spun Up
      Slot Number:8
      Firmware state:Online, Spun Up
      Slot Number:9
      Firmware state:Online, Spun Up
      Slot Number:10
      Firmware state:Online, Spun Up
      Slot Number:11
      Firmware state:Online, Spun Up
  8. Examine the output of the following command:

    • If you are using Oracle Exadata System Software release 19c or later, then use the following command:

      /opt/MegaRAID/storcli/storcli64 -LdInfo -LAll -aAll 
    • If you are using Oracle Exadata System Software release 18c or earlier, then you can use the following command:

      /opt/MegaRAID/MegaCli/MegaCli64 -LdInfo -LAll -aAll 
  9. (Oracle Exadata Database Machine based on Sun Fire X4170 Oracle Database Servers only) Check that the ILOM is configured for the proper fan cooling on each database server using the following command:

    # ipmitool sunoem cli "show /SP/policy"
    • If the policy is present and enabled, then no additional steps are needed.

    • If the policy is present and disabled, then enable the policy using the following command:

      # ipmitool sunoem cli "set /SP/policy FLASH_ACCELERATOR_CARD_ \
      INSTALLED=enabled"

      The command must be entered as a single line.

  10. Verify that NTP servers are configured the same for all servers using the following command. The command is run on each database server individually.

    # ntpq -p
  11. Log out of the system using the following command:

    # logout