Table of Contents

• Title and Copyright Information
• Preface
  • Audience
  • Documentation Accessibility
  • Diversity and Inclusion
  • Related Documentation
  • Conventions
• 1 General Maintenance Information
  • 1.1 Overview of Roles and Responsibilities
    • 1.1.1 Common Administrative Tasks for Oracle Exadata Management
    • 1.1.2 Understanding the Administrative Differences with Oracle Exadata
  • 1.2 Powering On and Off Oracle Exadata Rack
    • 1.2.1 Non-emergency Power Procedures
      • 1.2.1.1 Powering On Oracle Exadata Rack
      • 1.2.1.2 Powering On Servers Remotely using ILOM
      • 1.2.1.3 Powering Off Oracle Exadata Rack
        • 1.2.1.3.1 Powering Off Database Servers
        • 1.2.1.3.2 Powering Off Oracle Exadata Storage Servers
        • 1.2.1.3.3 Powering Off Multiple Servers at the Same Time
      • 1.2.1.4 Powering On and Off Network Switches
    • 1.2.2 Emergency Power-off Considerations
      • 1.2.2.1 Emergency Power-off Procedure
      • 1.2.2.2 Emergency Power-off Switch
    • 1.2.3 Cautions and Warnings
  • 1.3 Using Auto Service Request to Manage Hardware Faults
    • 1.3.1 Understanding Auto Service Request
    • 1.3.2 Installing and Configuring ASR
  • 1.4 Monitoring the System Using Oracle Enterprise Manager Cloud Control
  • 1.5 Monitoring the System Using Oracle Configuration Manager
  • 1.6 Changing Component Passwords
    • 1.6.1 Changing the Database Server Passwords
      • 1.6.1.1 Changing the User Account Password on the Database Server
      • 1.6.1.2 Changing the GRUB Account Password on the Database Server
    • 1.6.2 Changing the Exadata Storage Server Passwords
    • 1.6.3 Changing the Power Distribution Unit Password
    • 1.6.4 Changing the ILOM Password
    • 1.6.5 Changing the InfiniBand Switch Password
    • 1.6.6 Changing the Cisco Management Network Switch or RoCE Network Fabric Switch Password
      • 1.6.6.1 Changing the Password for Cisco 93xx Switches
      • 1.6.6.2 Changing the Cisco 4948 Ethernet Switch Password
        • 1.6.6.2.1 Changing the Cisco 4948 Ethernet Switch Password for Serial Port Access
        • 1.6.6.2.2 Changing the Cisco 4948 Ethernet Switch Password for Telnet or SSH Access
    • 1.6.7 Changing the KVM Password
  • 1.7 Determining the Server Model
  • 1.8 Monitoring Ambient Temperature of Servers
  • 1.9 Replacing a Disk Controller Battery Backup Unit
    • 1.9.1 Replacing a Disk Controller BBU on a Database Server
      • 1.9.1.1 Step 1: Prepare the Disk Controller BBU for Removal
        • 1.9.1.1.1 Preparing Systems with Remote Mount BBU
        • 1.9.1.1.2 Preparing Systems That Do Not Have a Remote Mount BBU
      • 1.9.1.2 Step 2: Replace the Disk Controller BBU
      • 1.9.1.3 Step 3: Enable and Verify the New Disk Controller BBU
    • 1.9.2 Replacing a Disk Controller BBU on an Exadata Storage Server
      • 1.9.2.1 Step 1: Prepare the Disk Controller BBU for Removal
      • 1.9.2.2 Step 2: Replace the Disk Controller BBU
      • 1.9.2.3 Step 3: Enable the New Disk Controller BBU
  • 1.10 Overview of the dbmsrv Service
    • 1.10.1 Using a Script to Change User IDs and Group IDs for dbmsrv
    • 1.10.2 Manually Changing User IDs and Group IDs for dbmsrv
  • 1.11 Configuring Password Expiration for Users Accessing the Server Remotely
  • 1.12 State of Storage Server and Database Servers During Configuration Changes
  • 1.13 Rescue Plan
  • 1.14 Using ExaWatcher Charts to Monitor Oracle Exadata Performance
    • 1.14.1 About ExaWatcher Charts
    • 1.14.2 Requirements for Using ExaWatcher Charts
    • 1.14.3 IO Charts
      • 1.14.3.1 IO Stat Summary
      • 1.14.3.2 I/O Stat Detail
    • 1.14.4 CPU Charts
    • 1.14.5 CPU Detail
    • 1.14.6 Cell Server Charts
    • 1.14.7 Alert History
• 2 Maintaining Exadata Database Servers
  • 2.1 Management Server on Database Servers
  • 2.2 Maintaining the Local Storage on Exadata Database Servers
    • 2.2.1 Verifying the Database Server Configuration
      • 2.2.1.1 About the RAID Storage Configuration
      • 2.2.1.2 Verifying the Disk Controller Configuration on Systems Without a RAID Controller
      • 2.2.1.3 Verifying the Disk Controller Configuration on Systems With a RAID Controller
      • 2.2.1.4 Verifying Virtual Drive Configuration
      • 2.2.1.5 Verifying Physical Drive Configuration
    • 2.2.2 Monitoring a Database Server RAID Set Rebuilding
    • 2.2.3 Reclaiming a Hot Spare Drive After Upgrading to Oracle Exadata System Software Release 12.1.2.1.0 or Later
    • 2.2.4 Understanding Automated File Deletion Policy
  • 2.3 Maintaining Flash Disks on Exadata Database Servers
    • 2.3.1 Monitoring the Status of Flash Disks
    • 2.3.2 Performing a Hot-Pluggable Replacement of a Flash Disk
  • 2.4 Adding the Disk Expansion Kit to Database Servers
    • 2.4.1 Adding the Disk Expansion Kit to Database Servers: X9M-2 and Later
    • 2.4.2 Adding the Disk Expansion Kit to Database Servers: X8M-2 and Prior
  • 2.5 Adding Memory Expansion Kit to Database Servers
  • 2.6 Verifying and Modifying the Link Speed on the Client Network Ports for X7 and Later Systems
  • 2.7 Adding and Configuring an Extra Network Card on Oracle Exadata
    • 2.7.1 Viewing the Network Interfaces
    • 2.7.2 Configuring the Additional Network Card for a Non-Oracle VM Environment
    • 2.7.3 Configuring the Additional Network Card for an Oracle VM Environment
  • 2.8 Increasing the Number of Active Cores on Database Servers
  • 2.9 Extending LVM Partitions
    • 2.9.1 Extending the root LVM Partition
      • 2.9.1.1 Extending the root LVM Partition on Systems Running Oracle Exadata System Software Release 11.2.3.2.1 or Later
      • 2.9.1.2 Extending the root LVM Partition on Systems Running Oracle Exadata System Software Earlier than Release 11.2.3.2.1
    • 2.9.2 Resizing a Non-root LVM Partition
      • 2.9.2.1 Extending a Non-root LVM Partition on Systems Running Oracle Exadata System Software Release 11.2.3.2.1 or Later
      • 2.9.2.2 Extending a Non-root LVM Partition on Systems Running Oracle Exadata System Software Earlier than Release 11.2.3.2.1
      • 2.9.2.3 Reducing a Non-root LVM Partition on Systems Running Oracle Exadata System Software Release 11.2.3.2.1 or Later
    • 2.9.3 Extending the Swap Partition
  • 2.10 Creating a Snapshot-Based Backup of Oracle Linux Database Server
    • 2.10.1 Creating a Snapshot-Based Backup of Exadata Database Servers X8M and Later with Uncustomized Partitions
    • 2.10.2 Creating a Snapshot-Based Backup of Exadata X8 or Earlier Database Servers with Uncustomized Partitions
    • 2.10.3 Creating a Snapshot-Based Backup of Oracle Linux Database Server with Customized Partitions
  • 2.11 Recovering Oracle Linux Database Servers Using a Snapshot-Based Backup
    • 2.11.1 Overview of Snapshot-Based Recovery of Database Servers
    • 2.11.2 Recovering Oracle Linux Database Server with Uncustomized Partitions
    • 2.11.3 Recovering Exadata X9M Database Servers with Customized Partitions
    • 2.11.4 Recovering Exadata X8M Database Servers with Customized Partitions
    • 2.11.5 Recovering Exadata Database Servers X7 or X8 with Customized Partitions
    • 2.11.6 Recovering Exadata X6 or Earlier Database Servers with Customized Partitions
    • 2.11.7 Configuring Oracle Exadata Database Machine Eighth Rack Oracle Linux Database Server After Recovery
      • 2.11.7.1 Configuring Eighth Rack On X3-2 or Later Machines Running Oracle Exadata Storage Server Release 12.1.2.3.0 or Later
      • 2.11.7.2 Configuring Eighth Rack On X3-2 Machines Running Oracle Exadata Storage Server Release 12.1.2.2.3 or Earlier
  • 2.12 Re-Imaging the Oracle Exadata Database Server
    • 2.12.1 Contact Oracle Support Services
    • 2.12.2 Download Latest Release of Cluster Verification Utility
    • 2.12.3 Remove the Database Server from the Cluster
    • 2.12.4 Image the Database Server
    • 2.12.5 Configure the Re-imaged Database Server
    • 2.12.6 Prepare the Re-imaged Database Server for the Cluster
    • 2.12.7 Apply Oracle Exadata System Software Patch Bundles to the Replacement Database Server
    • 2.12.8 Clone Oracle Grid Infrastructure to the Replacement Database Server
    • 2.12.9 Clone Oracle Database Homes to the Replacement Database Server
  • 2.13 Changing Existing Elastic Configurations for Database Servers
    • 2.13.1 Adding a New Database Server to the Cluster
    • 2.13.2 Moving an Existing Database Server to a Different Cluster
    • 2.13.3 Dropping a Database Server from an Oracle RAC Cluster
  • 2.14 Managing Quorum Disks
    • 2.14.1 Using Quorum Disks
    • 2.14.2 Creating Quorum Disks In New Oracle Exadata Deployments
    • 2.14.3 Overview of Quorum Disk Manager
    • 2.14.4 Software Requirements for Quorum Disk Manager
    • 2.14.5 quorumdiskmgr Reference
      • 2.14.5.1 Syntax for the Quorum Disk Manager Utility
      • 2.14.5.2 quorumdiskmgr Objects
      • 2.14.5.3 Creating a Quorum Disk Configuration (--create --config)
      • 2.14.5.4 Creating a Target (--create --target)
      • 2.14.5.5 Creating a Device (--create --device)
      • 2.14.5.6 Listing Quorum Disk Configurations (--list --config)
      • 2.14.5.7 Listing Targets (--list --target)
      • 2.14.5.8 Listing Devices (--list --device)
      • 2.14.5.9 Deleting Configurations (--delete --config)
      • 2.14.5.10 Deleting Targets (--delete --target)
      • 2.14.5.11 Deleting Devices (--delete --device)
      • 2.14.5.12 Changing Owner and Group Values (--alter --config)
      • 2.14.5.13 Changing the RDMA Network Fabric IP Addresses (--alter --target)
    • 2.14.6 Reconfigure Quorum Disk After Restoring a Database Server
  • 2.15 Using vmetrics
    • 2.15.1 About the vmetrics Package
    • 2.15.2 Installing and Starting the vmetrics Service
    • 2.15.3 Files in the vmetrics Package
    • 2.15.4 Displaying the Statistics
    • 2.15.5 Adding Metrics to vmetrics
  • 2.16 Using FIPS mode
  • 2.17 Exadata Database Server LED Indicator Descriptions
  • 2.18 Exadata Database Server Images
    • 2.18.1 Oracle Exadata X10M Database Server Images
    • 2.18.2 Oracle Server X9-2 Database Server Images
    • 2.18.3 Oracle Server X8-2 Database Server Images
    • 2.18.4 Oracle Server X7-2 Oracle Database Server Images
    • 2.18.5 Oracle Server X6-2 Oracle Database Server Images
    • 2.18.6 Oracle Server X5-2 Oracle Database Server Images
    • 2.18.7 Sun Server X4-2 Oracle Database Server Images
    • 2.18.8 Sun Server X3-2 Oracle Database Server Images
    • 2.18.9 Sun Fire X4170 M2 Oracle Database Server Images
    • 2.18.10 Sun Fire X4170 Oracle Database Server Images
    • 2.18.11 Oracle Server X8-8 Database Server Images
    • 2.18.12 Oracle Server X7-8 Oracle Database Server Images
    • 2.18.13 Oracle Server X5-8 and X6-8 Oracle Database Server Images
    • 2.18.14 Sun Server X4-8 Oracle Database Server Images
    • 2.18.15 Sun Server X2-8 Oracle Database Server Images
    • 2.18.16 Sun Fire X4800 Oracle Database Server Images
• 3 Maintaining Oracle Exadata Storage Servers
  • 3.1 Maintaining Oracle Exadata Storage Servers
    • 3.1.1 Shutting Down Exadata Storage Server
    • 3.1.2 Checking the Status of an ASM Rebalance Operation
    • 3.1.3 Enabling Network Connectivity with the Diagnostic ISO
  • 3.2 Using Exadata Extended (XT) Storage Servers
    • 3.2.1 About Oracle Exadata Extended (XT) Storage Servers
    • 3.2.2 What Data Can Be Stored on Oracle Exadata Extended (XT) Storage Servers?
    • 3.2.3 Enabling Smart Scan on Exadata Extended (XT) Storage Servers
  • 3.3 Maintaining the Hard Disks of Oracle Exadata Storage Servers
    • 3.3.1 Monitoring the Status of Hard Disks
    • 3.3.2 Replacing a Hard Disk Due to Disk Failure
    • 3.3.3 Replacing a Hard Disk Due to Disk Problems
    • 3.3.4 Replacing a Hard Disk Due to Bad Performance
    • 3.3.5 Replacing a Hard Disk Proactively
    • 3.3.6 Moving All Drives to Another Exadata Storage Server
    • 3.3.7 Repurposing a Hard Disk
    • 3.3.8 Removing and Replacing the Same Hard Disk
    • 3.3.9 Re-Enabling a Hard Disk That Was Rejected
  • 3.4 Maintaining Flash Disks on Oracle Exadata Storage Servers
    • 3.4.1 Replacing a Flash Disk Due to Flash Disk Failure
    • 3.4.2 About Flash Disk Degraded Performance Statuses
    • 3.4.3 Replacing a Flash Disk Due to Flash Disk Problems
    • 3.4.4 Performing a Hot Pluggable Replacement of a Flash Disk
    • 3.4.5 Enabling Write Back Flash Cache
      • 3.4.5.1 Enable Write Back Flash Cache for 11.2.3.3.1 or Higher
      • 3.4.5.2 Enabling Write Back Flash Cache on a Rolling Basis for Software Versions Lower Than 11.2.3.3.1
      • 3.4.5.3 Enabling Write Back Flash Cache in a Non-Rolling Basis for Software Versions Lower Than 11.2.3.3.1
    • 3.4.6 Disabling Write Back Flash Cache
      • 3.4.6.1 Disable Write-Back Flash Cache Along With Write-Back PMEM Cache
      • 3.4.6.2 Disable Write Back Flash Cache for 11.2.3.3.1 or Higher
      • 3.4.6.3 Disabling Write Back Flash Cache on a Rolling Basis for Software Versions Lower Than 11.2.3.3.1
      • 3.4.6.4 Disabling Write Back Flash Cache on a Non-Rolling Basis for Software Versions Lower Than 11.2.3.3.1
    • 3.4.7 Enabling Flash Cache Compression
    • 3.4.8 Monitoring Exadata Smart Flash Cache Usage Statistics
    • 3.4.9 Disabling Flash Cache Compression
  • 3.5 Maintaining PMEM Devices on Oracle Exadata Storage Servers
    • 3.5.1 Replacing a PMEM Device Due to Device Failure
    • 3.5.2 Replacing a PMEM Device Due to Degraded Performance
    • 3.5.3 Enabling and Disabling Write-Back PMEM Cache
      • 3.5.3.1 Enable Write-Back PMEM Cache
      • 3.5.3.2 Disable Write-Back PMEM Cache
  • 3.6 Maintaining the M.2 Disks of Oracle Exadata Storage Server
    • 3.6.1 Monitoring the Status of M.2 Disks
    • 3.6.2 Replacing a M.2 Disk Due to Failure or Other Problems
  • 3.7 Using the Oracle Exadata System Software Rescue Procedure
    • 3.7.1 About the Oracle Exadata System Software Rescue Procedure
    • 3.7.2 Performing the Rescue Procedure
    • 3.7.3 Configuring Oracle Exadata Storage Servers After Rescue
    • 3.7.4 Configuring Oracle Exadata Database Machine Eighth Rack Storage Servers After Rescue
    • 3.7.5 Re-creating a Damaged CELLBOOT USB Flash Drive
  • 3.8 Changing Existing Elastic Configurations for Storage Cells
    • 3.8.1 Adding a Storage Server
    • 3.8.2 Adding a New Storage Server to an Eighth Rack Cluster
    • 3.8.3 Adding Storage Cells using OEDACLI
    • 3.8.4 Expanding an Existing Exadata Storage Grid
    • 3.8.5 Dropping a Storage Server from an Existing Disk Group or Storage Grid
    • 3.8.6 Dropping Storage Servers using OEDACLI
  • 3.9 Managing Disk Controller Batteries
    • 3.9.1 About Disk Controller Batteries
    • 3.9.2 Monitoring Storage Server Hard Disk Controller Batteries and Caching Mode
    • 3.9.3 Monitoring Batteries in the Database Servers
    • 3.9.4 Replacing Batteries in Disk Controllers
  • 3.10 Managing F20 PCIe Energy Storage Modules
    • 3.10.1 About F20 PCIe Energy Storage Modules
    • 3.10.2 Replacing Flash ESM
  • 3.11 Exadata Storage Server LED Indicator Descriptions
  • 3.12 Exadata Storage Server Images
    • 3.12.1 Oracle Exadata Storage Server X10M Extreme Flash Server Images
    • 3.12.2 Oracle Exadata Storage Server X10M High Capacity Server Images
    • 3.12.3 Oracle Exadata Storage Server X10M Extended Server Images
    • 3.12.4 Oracle Exadata Storage Server X9M-2 Extreme Flash Server Images
    • 3.12.5 Oracle Exadata Storage Server X9M-2 High Capacity Server Images
    • 3.12.6 Oracle Exadata Storage Server X9M-2 Extended Server Images
    • 3.12.7 Oracle Exadata Storage Server X8M-2 and X8-2 High Capacity and Extended (XT) Server Images
    • 3.12.8 Oracle Exadata Storage Server X8M-2 and X8-2 Extreme Flash Server Images
    • 3.12.9 Oracle Exadata Storage Server X7-2 High Capacity Server Images
    • 3.12.10 Oracle Exadata Storage Server X7-2 Extreme Flash Server Images
    • 3.12.11 High Capacity Exadata Storage Server X6-2 Images
    • 3.12.12 Extreme Flash Exadata Storage Server X6-2 Images
    • 3.12.13 High Capacity Exadata Storage Server X5-2 Images
    • 3.12.14 Extreme Flash Exadata Storage Server X5-2 Images
    • 3.12.15 Exadata Storage Server X4-2L Images
    • 3.12.16 Exadata Storage Server X3-2L Images
    • 3.12.17 Exadata Storage Server with Sun Fire X4270 M2 Images
    • 3.12.18 Exadata Storage Server with Sun Fire X4275 Images
• 4 Maintaining Other Oracle Exadata Components
  • 4.1 Replacing a Power Distribution Unit
    • 4.1.1 Reviewing the PDU Replacement Guidelines
    • 4.1.2 Replacing a PDU
  • 4.2 Resetting a Non-Responsive ILOM
    • 4.2.1 Resetting the ILOM Using SSH
    • 4.2.2 Resetting the ILOM Using the ILOM Remote Console
    • 4.2.3 Resetting the ILOM Using IPMItool
    • 4.2.4 Resetting the ILOM Using the SP Reset Pin on Oracle Exadata Database Machine X2-2 Servers and Exadata Storage Servers
    • 4.2.5 Removing the SP from Sun Fire X4800 Oracle Database Servers and Sun Server X2-8 Oracle Database Servers
    • 4.2.6 Unplugging the ILOM Power Supply
  • 4.3 Configuring Service Processor and ILOM Network Settings
  • 4.4 Verifying and Modifying the Link Speed on the Client Network Ports for X7 and Later Systems
  • 4.5 Verify the Link Speed on Network Ports
  • 4.6 Changing from 1 GbE Connections to 10 GbE Connections
    • 4.6.1 Task 1: Verify ping Functionality
    • 4.6.2 Task 2: Back up the Current Interface Files
    • 4.6.3 Task 3: Edit the 10 GbE Interface Settings
    • 4.6.4 Task 4: Verify the 10 GbE Interfaces
  • 4.7 Maintaining the RoCE Network Fabric
    • 4.7.1 Backing Up Settings on the Cisco Nexus 9336C-FX2 RoCE Network Fabric Switch
    • 4.7.2 Applying Golden Configuration Settings on Cisco Nexus 9336C-FX2 RoCE Network Fabric Switches
    • 4.7.3 Restoring Settings on a Cisco Nexus 9336C-FX2 RoCE Network Fabric Switch
    • 4.7.4 Using Access VLANs with Cisco Nexus 9336C-FX2 RoCE Network Fabric Switches
    • 4.7.5 Replacing a Failed RoCE Network Fabric Switch
    • 4.7.6 Verifying the RoCE Network Fabric Configuration
    • 4.7.7 Verifying RoCE Network Fabric Operation
    • 4.7.8 Upgrading the Switch Firmware for RoCE Network Fabric
    • 4.7.9 Downgrading the RoCE Network Fabric Switch Software
  • 4.8 Maintaining the InfiniBand Network Fabric Network
    • 4.8.1 Backing Up and Restoring InfiniBand Switch Settings
      • 4.8.1.1 Backing Up Settings on a Switch with 2.1.3-4 Firmware
      • 4.8.1.2 Backing Up Settings on a Switch with 1.1.3-2 Firmware
      • 4.8.1.3 Backing Up Settings on a Switch with 1.0.1 Firmware
      • 4.8.1.4 Restoring Settings on a Switch with 2.1.3-4 Firmware
      • 4.8.1.5 Restoring Settings on a Switch with 1.1.3-2 Firmware
      • 4.8.1.6 Restoring Settings on a Switch with 1.0.1 Firmware
    • 4.8.2 Verifying the InfiniBand Network Fabric Configuration
    • 4.8.3 Using the verify-topology Utility
    • 4.8.4 Verifying InfiniBand Network Fabric Operation
    • 4.8.5 Understanding the Network Subnet Manager Master
    • 4.8.6 Upgrading the Switch Firmware for InfiniBand Network Fabric
    • 4.8.7 Downgrading the InfiniBand Network Fabric Switch Software
  • 4.9 Modifying the InfiniBand Network Fabric Configuration
    • 4.9.1 Configuring InfiniBand Partitioning
    • 4.9.2 Changing InfiniBand IP Addresses and Host Names
    • 4.9.3 Changing InfiniBand Network Information
  • 4.10 Configuring Network Routing on Database Servers
    • 4.10.1 About Network Routing on Database Servers
    • 4.10.2 Task 1: Configure for Boot-Time Routing
    • 4.10.3 Task 2: Configure for Real-Time Routing
    • 4.10.4 Task 3: Verify Network Routing Rules and Routes
    • 4.10.5 Removing Network Routing Configuration for Troubleshooting
    • 4.10.6 Returning to Default Routing
  • 4.11 Changing the DNS Servers
    • 4.11.1 Change the DNS Server Address on the Database Server
    • 4.11.2 Change the DNS Server on Oracle Exadata Storage Server
    • 4.11.3 Change the DNS Server Address on the Cisco RoCE Network Fabric Switches
    • 4.11.4 Change the DNS Server Address on the Cisco 9300 Series Management Network Switch
    • 4.11.5 Change the DNS Server Address on the Cisco 4948 Ethernet Switch
    • 4.11.6 Change the DNS Server Address on the InfiniBand Network Fabric Switch
    • 4.11.7 Change the DNS Server on the KVM Switch
  • 4.12 Changing the NTP Servers
    • 4.12.1 Set the NTP Server Address on the Database Servers
    • 4.12.2 Change the NTP Server on Oracle Exadata Storage Server
    • 4.12.3 Set the NTP Server Address on the Cisco RoCE Network Fabric Switches
    • 4.12.4 Set the NTP Server Address on the Cisco 9300 Series Management Network Switch
    • 4.12.5 Set the NTP Server Address on the Cisco 4948 Ethernet Switch
    • 4.12.6 Set the NTP Server Address on the InfiniBand Network Fabric Switch
  • 4.13 Changing the Time Zone Settings
    • 4.13.1 Change Time Zone Settings on Storage Servers
    • 4.13.2 Change Time Zone Settings on the Database Servers
    • 4.13.3 Change Time Zone Settings on the InfiniBand Network Fabric Switches
    • 4.13.4 Change Time Zone Settings on the Cisco RoCE Network Fabric Switches
    • 4.13.5 Change Time Zone Settings on the Cisco Management Network Switch
  • 4.14 Managing the KVM Switch
    • 4.14.1 Configuring the KVM Switch
    • 4.14.2 Configuring the KVM Switch to Access a Server
    • 4.14.3 Accessing a Server Using the KVM Switch
  • 4.15 LED Status Descriptions
    • 4.15.1 Sun Datacenter InfiniBand Switch 36 Switch LEDs
    • 4.15.2 Cisco Nexus 9336C-FX2 Switch LEDs
• 5 Managing Oracle VM User Domains
  • 5.1 Oracle VM and Oracle Exadata
    • 5.1.1 About Oracle VM
    • 5.1.2 Oracle VM Deployment Specifications and Limits
    • 5.1.3 Supported Operations in the Management Domain (dom0)
    • 5.1.4 Oracle VM Resources
      • 5.1.4.1 Storage Configuration for Management Domain
      • 5.1.4.2 Storage Configuration for User Domain
  • 5.2 Migrating a Bare Metal Oracle RAC Cluster to an Oracle RAC Cluster in Oracle VM
  • 5.3 Showing Running Domains
  • 5.4 Monitoring a User Domain Console
  • 5.5 Monitoring Oracle VMs with Oracle Enterprise Manager
  • 5.6 Starting a User Domain
  • 5.7 Managing Automatic Startup of Oracle VM User Domains
    • 5.7.1 Enabling User Domain Automatic Start
    • 5.7.2 Disabling User Domain Automatic Start
  • 5.8 Shutting Down a User Domain From Within the User Domain
  • 5.9 Shutting Down a User Domain From Within the Management Domain
  • 5.10 Backing Up and Restoring Oracle Databases on Oracle VM User Domains
  • 5.11 Modifying the Memory Allocated to a User Domain
  • 5.12 Modifying the Number of Virtual CPUs Allocated to a User Domain
  • 5.13 Increasing the Disk Space in a User Domain
    • 5.13.1 Adding a New LVM Disk to a User Domain
    • 5.13.2 Increasing the Size of the root File System
    • 5.13.3 Increasing the Size of the /u01 File System
    • 5.13.4 Increasing the Size of the Grid Infrastructure Home or Database Home File System
    • 5.13.5 Increasing the Size of the Swap Area
  • 5.14 Expanding /EXAVMIMAGES After Adding the Database Server Disk Expansion Kit
    • 5.14.1 Expanding /EXAVMIMAGES on Management Domain on Release 18.1.x or Later
    • 5.14.2 Expanding /EXAVMIMAGES on Management Domain on Release 12.2.x
    • 5.14.3 Expanding /EXAVMIMAGES on Management Domain on Releases Earlier than 12.2.x
  • 5.15 Adding an Oracle VM Cluster
  • 5.16 Expanding an Oracle RAC Cluster on Oracle VM Using OEDACLI
  • 5.17 Creating a User Domain Without Oracle Grid Infrastructure and Oracle Database
  • 5.18 Moving a User Domain to a Different Database Server
  • 5.19 Backing up the Management Domain and User Domains in an Oracle VM Deployment
    • 5.19.1 Backing up the Management Domain dom0 Using Snapshot-Based Backup
    • 5.19.2 Backing up the User Domains
      • 5.19.2.1 Method 1: Back up All the User Domains
      • 5.19.2.2 Method 2: Back up Individual User Domains
      • 5.19.2.3 Method 3: Back up a User Domain from Inside the User Domain
  • 5.20 Recovering an Oracle VM Deployment
    • 5.20.1 Overview of Snapshot-Based Recovery of Database Servers
    • 5.20.2 Scenario 1: Recovering a Management Domain and Its User Domains from Backup
      • 5.20.2.1 Recovering a Management Domain and Its User Domains (Releases Prior to 12.2.1.1.0)
      • 5.20.2.2 Recovering a Management Domain and Its User Domains (Releases 12.2.1.1.0 and Later)
      • 5.20.2.3 Recovering a Management Domain and Its User Domains (Release 18.1 and X7 and Later)
    • 5.20.3 Scenario 2: Re-imaging the Management Domain and Restoring User Domains from Backups
    • 5.20.4 Scenario 3: Restoring and Recovering User Domains from Snapshot Backups
  • 5.21 Removing an Oracle RAC Cluster Running in Oracle VM
  • 5.22 Removing a User Domain
    • 5.22.1 Removing a User Domain from an Oracle VM Cluster Using OEDACLI
    • 5.22.2 Removing a User Domain from an Oracle VM Cluster Using domu_maker
  • 5.23 Implementing Tagged VLAN Interfaces
  • 5.24 Implementing InfiniBand Partitioning across Oracle VM Oracle RAC Clusters on Oracle Exadata
    • 5.24.1 About InfiniBand Partitioning Across Oracle RAC Clusters Running in Oracle VM
    • 5.24.2 Requirements for Implementing InfiniBand Partitioning across OVM RAC Clusters
    • 5.24.3 About InfiniBand Partitioning Network Configuration
    • 5.24.4 Configuring InfiniBand Partitioning across Oracle VM RAC Clusters
    • 5.24.5 Implementing InfiniBand Partitioning across OVM RAC Clusters: Setting up Limited Membership
  • 5.25 Running Oracle EXAchk in Oracle VM Environments
• 6 Managing Oracle Linux KVM Guests
  • 6.1 Oracle Linux KVM and Oracle Exadata
    • 6.1.1 About Oracle Linux KVM
    • 6.1.2 Oracle Linux KVM Deployment Specifications and Limits
    • 6.1.3 Supported Operations in the KVMHost
    • 6.1.4 Oracle Linux KVM Resources
  • 6.2 Migrating a Bare Metal Oracle RAC Cluster to an Oracle RAC Cluster in Oracle Linux KVM
  • 6.3 Showing Running Domains
  • 6.4 Starting a Guest
  • 6.5 Starting a Guest using the Diagnostic ISO File
  • 6.6 Monitoring a Guest Console During Startup
  • 6.7 Managing Automatic Startup of Oracle Linux KVM Guests
    • 6.7.1 Enabling Guest Automatic Start
    • 6.7.2 Disabling Guest Automatic Start
  • 6.8 Shutting Down a User Domain From Within the User Domain
  • 6.9 Shutting Down a Guest From Within the KVM host
  • 6.10 Backing up the KVM host and Guests
    • 6.10.1 Backing up the KVM host Using Snapshot-Based Backup
    • 6.10.2 Backing up the Oracle Linux KVM Guests
      • 6.10.2.1 Method 1: Back Up All of the KVM Guests
      • 6.10.2.2 Method 2: Back Up an Individual Guest
      • 6.10.2.3 Method 3: Back Up a Guest Internally
  • 6.11 Backing Up and Restoring Oracle Databases on KVM Guests
  • 6.12 Modifying the Memory Allocated to a Guest
  • 6.13 Modifying the Number of Virtual CPUs Allocated to a Guest
  • 6.14 Increasing the Disk Space in a Guest
    • 6.14.1 Adding a New LVM Disk to a Guest
    • 6.14.2 Increasing the Size of the root File System
    • 6.14.3 Increasing the Size of the /u01 File System
    • 6.14.4 Increasing the Size of the Grid Infrastructure Home or Database Home File System
    • 6.14.5 Increasing the Size of the Swap Area
  • 6.15 Expanding /EXAVMIMAGES on the KVM host
  • 6.16 Adding an Oracle Linux KVM Cluster
  • 6.17 Expanding an Oracle RAC Cluster in Oracle Linux KVM Using OEDACLI
  • 6.18 Moving a Guest to a Different Database Server
  • 6.19 Recovering a KVM Deployment
    • 6.19.1 Overview of Snapshot-Based Recovery of KVM Hosts
    • 6.19.2 KVM System Recovery Scenarios
      • 6.19.2.1 Recovering a KVM Host and the Guests from Backup
        • 6.19.2.1.1 Recover the KVM Host on Exadata X9M-2
        • 6.19.2.1.2 Recover the KVM Host on Exadata X8M-2
        • 6.19.2.1.3 Reboot the KVM Host
        • 6.19.2.1.4 Recover and Restart the KVM Guests
      • 6.19.2.2 Re-imaging a KVM Host and Restoring the Guests from Backup
      • 6.19.2.3 Recover and Restart a KVM Guest
      • 6.19.2.4 Restoring and Recovering Guests from Snapshot Backups
  • 6.20 Removing a Guest
    • 6.20.1 Removing a Guest from an Oracle RAC Cluster Using OEDACLI
    • 6.20.2 Removing a Guest Using vm_maker
  • 6.21 Using Client Network VLAN Tagging with Oracle Linux KVM
  • 6.22 Using Exadata Secure RDMA Fabric Isolation with Oracle Linux KVM
  • 6.23 Adding a Bonded Network Interface to an Oracle Linux KVM Guest
  • 6.24 Using Oracle EXAchk in Oracle Linux KVM Environments
    • 6.24.1 Running Oracle EXAchk in Oracle Linux KVM Environments
    • 6.24.2 Audit Checks Performed by Oracle EXAchk
    • 6.24.3 Oracle EXAchk Command Line Options for Oracle Exadata
• 7 VM_MAKER Command Reference
  • 7.1 About the vm_maker Utility
  • 7.2 add-bonded-bridge Command
  • 7.3 add-single-bridge Command
  • 7.4 allocate-bridge Command
  • 7.5 attach Command
  • 7.6 autostart Command
  • 7.7 boot-from-hd Command
  • 7.8 boot-from-iso Command
  • 7.9 change-sf-vlan Command
  • 7.10 check Command
  • 7.11 cleanup-ip Command
  • 7.12 configure-system Command
  • 7.13 console-log Command
  • 7.14 create Command
  • 7.15 detach Command
  • 7.16 dumpxml Command
  • 7.17 list Command
  • 7.18 list-domains Command
  • 7.19 network-discovery Command
  • 7.20 reboot Command
  • 7.21 remove-bridge Command
  • 7.22 remove-domain Command
  • 7.23 set Command
  • 7.24 setup-ip Command
  • 7.25 start-domain Command
  • 7.26 stop-domain Command
  • 7.27 update-mac Command
  • 7.28 validate-ip Command
  • 7.29 vhostmd Command
• 8 Updating Exadata Software
  • 8.1 About Updating Exadata Software
    • 8.1.1 About Upgrading to Oracle Linux 8 on Exadata Servers
    • 8.1.2 About Upgrading to Oracle Linux 7 on Exadata Servers
  • 8.2 Planning for Software Maintenance
    • 8.2.1 Understanding Exadata Database Machine Software and Updates
      • 8.2.1.1 What Software Do You Update on Oracle Exadata?
      • 8.2.1.2 Software Release Types
      • 8.2.1.3 Software Release Availability
      • 8.2.1.4 Software Update Frequency
      • 8.2.1.5 Software Update Utilities
    • 8.2.2 Configuration and Operational Best Practices for Software Maintenance
      • 8.2.2.1 Understanding Rolling and Non-Rolling Updates
      • 8.2.2.2 Online Updates for Oracle Linux Kernel and Oracle Database Interim Fixes
      • 8.2.2.3 Configuration Practices for Optimal Software Maintenance
      • 8.2.2.4 Operational Practices for Optimal Software Maintenance
      • 8.2.2.5 Version Compatibility and Mixed Version Support
    • 8.2.3 Understanding the Exadata Software Image Version
    • 8.2.4 Rules for Updating to Newer Exadata Version
  • 8.3 Overview of Performing Exadata Software Updates
    • 8.3.1 Actions to Perform Before Any Software Maintenance
    • 8.3.2 Overview of Performing Exadata Storage Server Updates
    • 8.3.3 Overview of Performing Exadata Database Servers Updates
      • 8.3.3.1 Steps for Updating Non-Virtualized Configurations
      • 8.3.3.2 Steps for Updating Virtualized Configurations
    • 8.3.4 Overview of Performing RoCE Network Fabric Switch Updates
    • 8.3.5 Overview of Performing InfiniBand Network Fabric Switch Updates
    • 8.3.6 Overview of Performing Oracle Grid Infrastructure and Oracle Database Updates
    • 8.3.7 Using sudo When Performing Software Updates
      • 8.3.7.1 Running patchmgr (and dbnodeupdate Orchestration) Using sudo
      • 8.3.7.2 Running dbnodeupdate.sh Using sudo
  • 8.4 Exadata Patchmgr Update Utility
    • 8.4.1 About the Exadata Patchmgr Update Utility
    • 8.4.2 Obtaining Patchmgr
    • 8.4.3 Patchmgr Syntax
      • 8.4.3.1 Patchmgr Syntax for Storage Servers
      • 8.4.3.2 Patchmgr Syntax for Database Servers
      • 8.4.3.3 Patchmgr Syntax for RoCE Network Fabric Switches
      • 8.4.3.4 Patchmgr Syntax for InfiniBand Network Fabric Switches
      • 8.4.3.5 Patchmgr Syntax for the Management Network Switch
  • 8.5 Updating Oracle Exadata Database Servers
    • 8.5.1 Overview of Oracle Exadata Database Server Updates
    • 8.5.2 Installing, Updating, and Managing Non-Oracle Software
    • 8.5.3 Customization Levels and Impact
    • 8.5.4 Update Utility for Exadata Database Servers
    • 8.5.5 Update Tool Execution Host
    • 8.5.6 Running the Update Utility as a Non-root User and Running Multiple Invocations Concurrently
    • 8.5.7 Recommended Timeline for Updating Exadata Database Servers
    • 8.5.8 Preparing and Populating the YUM Repository with the Oracle Exadata Channel Content
      • 8.5.8.1 Downloading the ISO Image as a YUM Repository from My Oracle Support and Passing the Location of the Compressed Image to the Update Utility
      • 8.5.8.2 Setting Up a Local Mirror as a YUM HTTP Repository from the ULN Oracle Exadata Channel on a Separate Server
      • 8.5.8.3 Downloading the ISO Image as a YUM Repository from My Oracle Support and Making It Available as a YUM HTTP Repository on a Web Server
    • 8.5.9 Managing Exadata Obsoleted Packages
    • 8.5.10 Updating Individual Packages
    • 8.5.11 Running Prerequisite Checks
    • 8.5.12 Backing up Exadata Database Servers Before Planned Maintenance
    • 8.5.13 Running the Update
    • 8.5.14 Rolling Back Updates
  • 8.6 Updating Database Servers Running Oracle Exadata System Software Release 11.2.2.4.2
    • 8.6.1 Preparing to Use the dbnodeupdate.sh Utility on Database Servers with Release 11.2.2.4.2
    • 8.6.2 Running the dbnodeupdate.sh Utility
  • 8.7 Updating Software on Oracle Exadata Storage Servers
    • 8.7.1 Overview of Oracle Exadata Storage Server Updates
    • 8.7.2 Scheduling Automated Updates of Storage Servers
    • 8.7.3 Update Utility for Oracle Exadata Storage Server
    • 8.7.4 Recommended Timeline for Updating Oracle Exadata Storage Server
    • 8.7.5 Preparing Exadata Storage Servers for Update
    • 8.7.6 Running the Update for Exadata Storage Servers
    • 8.7.7 Rolling Back Updates for Exadata Storage Servers
  • 8.8 Upgrading and Downgrading RoCE Network Fabric Switch Firmware
    • 8.8.1 Preparing for RoCE Network Fabric Switch Firmware Upgrades or Downgrades
    • 8.8.2 Upgrading RoCE Network Fabric Switch Firmware Software
    • 8.8.3 Downgrading RoCE Network Fabric Switch Firmware
  • 8.9 Updating InfiniBand Network Fabric Switch Firmware
    • 8.9.1 Preparing for InfiniBand Network Fabric Switch Firmware Updates
    • 8.9.2 Updating InfiniBand Network Fabric Switch Firmware Software
    • 8.9.3 Downgrading InfiniBand Network Fabric Switch Firmware
  • 8.10 Upgrading Oracle Java SE on Oracle Linux
    • 8.10.1 Stop the MS Process
    • 8.10.2 Download and Update the Java JDK Package
      • 8.10.2.1 Using YUM and ULN to Update the JDK Package on Database Servers
        • 8.10.2.1.1 Configuring YUM to Connect to the Oracle Public Repository
        • 8.10.2.1.2 Registering an Oracle Linux System with ULN
        • 8.10.2.1.3 Upgrading JDK on Database Servers Using ULN
      • 8.10.2.2 Manually Update the JDK Package on Oracle Exadata System Software versions 12.1.2.1.0 to 12.1.2.2.0
      • 8.10.2.3 Manually Update the JDK Package on Oracle Exadata System Software Release 12.1.2.2.1 and Later
    • 8.10.3 Reconfigure and Restart Management Server (MS)
  • 8.11 Setting up SSH Equivalence
  • 8.12 Troubleshooting Software Updates on Oracle Exadata
    • 8.12.1 Troubleshooting Exadata Database Server Updates
    • 8.12.2 Monitoring, Validating, and Troubleshooting Exadata Storage Server Updates
    • 8.12.3 Troubleshooting a Failing Prerequisite Check Due to Dependency Problems on Exadata Database Server
    • 8.12.4 Troubleshooting a Multilib Problem on Exadata Database Server
• 9 Using the DBMCLI Utility
  • 9.1 Overview of the DBMCLI Utility
    • 9.1.1 Starting DBMCLI
    • 9.1.2 Understanding Command Syntax and Options for DBMCLI
    • 9.1.3 Reserved Words
    • 9.1.4 DBMCLI Command-Line Editing
    • 9.1.5 DBMCLI Input and Output Options
    • 9.1.6 Comments in DBMCLI Scripts
    • 9.1.7 Line Continuation in DBMCLI Commands
  • 9.2 About DBMCLI Administration Commands
  • 9.3 About DBMCLI Object Commands
  • 9.4 About DBMCLI Object Types
  • 9.5 DBMCLI Object Attributes
    • 9.5.1 Restrictions on Values of Common Attributes
    • 9.5.2 Attribute Lists in LIST Command
    • 9.5.3 Attribute Filters in LIST and ALTER Commands
  • 9.6 Monitoring Database Server with Metrics
    • 9.6.1 About Metrics
    • 9.6.2 Displaying Metrics
      • 9.6.2.1 Displaying Specific Attributes for Metrics
      • 9.6.2.2 Displaying Metric Definitions
      • 9.6.2.3 Displaying Current Metrics
      • 9.6.2.4 Displaying Metric History
    • 9.6.3 Database Server Metrics
    • 9.6.4 Real-Time Insight
    • 9.6.5 Using Real-Time Insight
      • 9.6.5.1 Using Fine-Grained Metrics
        • 9.6.5.1.1 Controlling Fine-Grained Metric Collection
        • 9.6.5.1.2 Customizing Fine-Grained Metric Collection
      • 9.6.5.2 Uploading Metric Observations to a Collection Platform
        • 9.6.5.2.1 Controlling the Automatic Metric Upload Frequency
        • 9.6.5.2.2 Customizing the Metric Stream
        • 9.6.5.2.3 Configuring the Endpoints for Automatic Metric Upload
      • 9.6.5.3 Downloading Metric Observations from an Exadata Server
      • 9.6.5.4 Tagging Metric Observations
      • 9.6.5.5 Understanding the Metric Stream Format
  • 9.7 DBMCLI Command Reference
    • 9.7.1 ALTER
      • 9.7.1.1 ALTER ALERTHISTORY
      • 9.7.1.2 ALTER DBSERVER
        • 9.7.1.2.1 Real-Time Insight Attributes
      • 9.7.1.3 ALTER IBPORT
      • 9.7.1.4 ALTER METRICDEFINITION
      • 9.7.1.5 ALTER SOFTWAREUPDATE
      • 9.7.1.6 ALTER THRESHOLD
      • 9.7.1.7 ALTER USER
    • 9.7.2 CREATE
      • 9.7.2.1 CREATE DBSERVER
      • 9.7.2.2 CREATE DIAGPACK
      • 9.7.2.3 CREATE ROLE
      • 9.7.2.4 CREATE THRESHOLD
      • 9.7.2.5 CREATE USER
    • 9.7.3 DESCRIBE
      • 9.7.3.1 DESCRIBE ALERTDEFINITION
      • 9.7.3.2 DESCRIBE ALERTHISTORY
      • 9.7.3.3 DESCRIBE DBSERVER
      • 9.7.3.4 DESCRIBE IBPORT
      • 9.7.3.5 DESCRIBE LUN
      • 9.7.3.6 DESCRIBE METRICCURRENT
      • 9.7.3.7 DESCRIBE METRICDEFINITION
      • 9.7.3.8 DESCRIBE METRICHISTORY
      • 9.7.3.9 DESCRIBE PHYSICALDISK
      • 9.7.3.10 DESCRIBE ROLE
      • 9.7.3.11 DESCRIBE SOFTWAREHISTORY
      • 9.7.3.12 DESCRIBE SOFTWAREUPDATE
      • 9.7.3.13 DESCRIBE THRESHOLD
      • 9.7.3.14 DESCRIBE USER
    • 9.7.4 DROP
      • 9.7.4.1 DROP ALERTHISTORY
      • 9.7.4.2 DROP DBSERVER
      • 9.7.4.3 DROP ROLE
      • 9.7.4.4 DROP SOFTWAREHISTORY
      • 9.7.4.5 DROP THRESHOLD
      • 9.7.4.6 DROP USER
    • 9.7.5 GRANT
      • 9.7.5.1 GRANT PRIVILEGE
      • 9.7.5.2 GRANT ROLE
    • 9.7.6 HELP
    • 9.7.7 LIST
      • 9.7.7.1 LIST ALERTDEFINITION
      • 9.7.7.2 LIST ALERTHISTORY
      • 9.7.7.3 LIST DBSERVER
      • 9.7.7.4 LIST DIAGPACK
      • 9.7.7.5 LIST IBPORT
      • 9.7.7.6 LIST LUN
      • 9.7.7.7 LIST METRICCURRENT
      • 9.7.7.8 LIST METRICDEFINITION
      • 9.7.7.9 LIST METRICHISTORY
      • 9.7.7.10 LIST METRICSTREAM
      • 9.7.7.11 LIST PHYSICALDISK
      • 9.7.7.12 LIST ROLE
      • 9.7.7.13 LIST SOFTWAREHISTORY
      • 9.7.7.14 LIST SOFTWAREUPDATE
      • 9.7.7.15 LIST THRESHOLD
      • 9.7.7.16 LIST USER
    • 9.7.8 REVOKE
      • 9.7.8.1 REVOKE PRIVILEGE
      • 9.7.8.2 REVOKE ROLE
    • 9.7.9 SET
    • 9.7.10 SPOOL
    • 9.7.11 START
• 10 Using the ExaCLI Utility
  • 10.1 ExaCLI Command Reference
  • 10.2 ExaCLI Security
  • 10.3 Creating Users for Use with ExaCLI
  • 10.4 Differences in Commands Between ExaCLI and DBMCLI/CellCLI
  • 10.5 Certificates for ExaCLI
    • 10.5.1 Using the Default Self-Signed Certificate
    • 10.5.2 Using a CA-Certified Security Certificate
  • 10.6 Running Commands Remotely Using URLs
• 11 Using the exadcli Utility
  • 11.1 exadcli Command Reference
  • 11.2 Using exadcli for the First Time
  • 11.3 exadcli Examples