2 New Features for Oracle Exadata System Software 24ai

This section describes the new features introduced in Oracle Exadata System Software 24ai (release 24.x).

• What's New in Oracle Exadata System Software Release 24.1
  

2.1 What's New in Oracle Exadata System Software Release 24.1

• AI Smart Scan
  
• Increased Number of Virtual Machines on Database Servers
  
• Columnar Cache on Exadata RDMA Memory (XRMEM)
  
• Exadata Cache Observability
  
• Automatic Loading of KEEP Objects into Exadata Smart Flash Cache
  
• Improved RoCE Network Resilience
  
• Enhanced RoCE Network Discovery
  
• Exadata Live Update
  
• KVM Guest Secure Boot
  
• SNMP Security Enhancements
  
• JSON Output from Management Server
  
• Features Coupled with Oracle Database 23ai
  
• Minimum Versions and Other Requirements
  

2.1.1 AI Smart Scan

Oracle Database 23ai includes artificial intelligence (AI) vector search capabilities designed to efficiently query data based on semantic similarities. AI vector search enables applications like voice assistants, chatbots, language translators, recommendation systems, and anomaly detection systems. AI vector search also facilitates sophisticated search and recognition capabilities on images and videos.

In conjunction with Oracle Database 23ai, Oracle Exadata System Software release 24.1.0 introduces AI Smart Scan, a collection of Exadata-specific optimizations capable of improving the performance of various AI vector query operations by orders of magnitude.

AI Smart Scan automatically accelerates Oracle Database 23ai AI Vector Search with optimizations that deliver low-latency parallelized scans across massive volumes of vector data. AI Smart Scan processes vector data at memory speed, leveraging ultra-fast Exadata RDMA Memory (XRMEM) and Exadata Smart Flash Cache in the Exadata storage servers, and performs vector distance computations and top-K filtering at the data source, avoiding unnecessary network data transfer and database server processing.

2.1.2 Increased Number of Virtual Machines on Database Servers

Starting with Exadata X10M database server hardware, Oracle Exadata System Software release 24.1.0 introduces various optimizations that enable up to fifty (50) virtual machine (VM) guests on each KVM host. This capability gives customers much greater flexibility to utilize the large number of CPU cores available starting with Exadata X10M.

In addition to enabling more guests, the optimizations in Oracle Exadata System Software release 24.1.0 reduce the deployment time for each guest to approximately half of the time required in earlier releases. Regardless of whether you need to deploy 50 guests or just a few, this improvement benefits all users on all systems using Oracle Linux KVM.

2.1.3 Columnar Cache on Exadata RDMA Memory (XRMEM)

First introduced in Oracle Exadata System Software release 12.2.1.1.0, the storage server columnar cache is a portion of Exadata Smart Flash Cache containing data in columnar format, typically used to accelerate complex analytical queries. Based on query and data profiles, Exadata software automatically identifies and converts selected data in Exadata Smart Flash Cache to columnar format and writes it in the columnar cache, transparently aiding query performance.

Oracle Exadata System Software release 24.1.0 extends the storage server columnar cache to leverage Exadata RDMA Memory (XRMEM) on Exadata storage server models starting with Exadata X10M. With this capability, the most active columnar data regions in the flash cache are automatically replicated into the XRMEM cache, providing substantially quicker columnar read performance and improved query performance.

2.1.4 Exadata Cache Observability

Oracle Exadata System Software release 24.1.0 introduces the Exadata Storage Cache Statistics utility (ecstat), which provides real-time statistics about Exadata Smart Flash Cache.

The ecstat utility improves cache observability on each Exadata storage server and enables administrators to understand:

• What is the balance of I/O operations across the main storage and Exadata Smart Flash Cache?

• How are different types of I/O operations (small reads, large reads, small writes, and large writes) serviced in the storage server?

• What is the I/O throughput, in I/Os per second (IOPS) and megabytes per second (MB/s), handled by main storage and Exadata Smart Flash Cache?

• Is Exadata Smart Flash Cache undersized or performing acceptably?

The ecstat utility is conceptually similar to the Linux iostat utility, providing a periodic snapshot of I/O performance for each storage and cache device. Storage administrators can run ecstat on demand to understand real-time I/O performance. Additionally, Exawatcher includes ecstat output in its log files.

2.1.5 Automatic Loading of KEEP Objects into Exadata Smart Flash Cache

Exadata enables users to override the automatic caching policy for Exadata Smart Flash Cache and elevate the priority for various database objects, such as regular tables and indexes, partitioned tables and indexes, and index-organized tables.

You can use the SQL CREATE or ALTER command to elevate the caching priority for a specific database object by including CELL_FLASH_CACHE KEEP in the STORAGE clause.

For example, assuming sufficient cache space, the following command instructs Exadata to keep data from t1 in Exadata Smart Flash Cache:

SQL> ALTER TABLE t1 STORAGE (CELL_FLASH_CACHE KEEP);

Starting with Oracle Exadata System Software release 24.1.0 in conjunction with Oracle Database 23ai, database objects configured with the KEEP option are automatically loaded into Exadata Smart Flash Cache. This feature benefits online transaction processing (OLTP) workloads by avoiding cache misses on database objects configured with the KEEP option. Previously, the KEEP option was only effective after the data was read into the cache.

2.1.6 Improved RoCE Network Resilience

Oracle Exadata relies on the high-performance RoCE Network Fabric that connects all the database and storage servers. Occasionally, administrator errors or network firmware issues can interfere with the RoCE Network Fabric, resulting in seemingly functional network links that cannot support network traffic. If left unattended, such cases can cause various failures, including database instance failures and cluster outages.

Oracle Exadata System Software release 24.1.0 contains an automatic monitoring function that constantly checks the RoCE Network Fabric. If network traffic stalls without any apparent link error, the associated IP address automatically migrates to the partner link. Later, when the stalled link resumes functioning, the IP address automatically returns to the working link.

This capability improves the resilience of the RoCE Network Fabric and automatically guards against a variety of potential failures caused by issues in the RoCE Network Fabric.

2.1.7 Enhanced RoCE Network Discovery

Oracle Exadata relies on the high-performance RoCE Network Fabric that connects all the database and storage servers. Oracle Exadata System Software release 24.1.0 introduces new capabilities that make it easier to discover and monitor the RoCE Network Fabric:

• configure_roce_hostinfo.sh scans the RoCE Network Fabric and labels each RoCE switch port, identifying the hostname, IP address, and port number of the link target. This information makes it easy to understand what each RoCE switch port is connected to and can be used to construct a map of the RoCE Network Fabric.

• rocelinkinfo scans the RoCE Network Fabric and presents real-time status information for each link. The output is presented using the same format as the output of the Linux iblinkinfo command. This utility does not depend on configure_roce_hostinfo.sh. However, the output from rocelinkinfo is more informative after all of the RoCE switch ports have been labeled by running configure_roce_hostinfo.sh.

2.1.8 Exadata Live Update

Oracle Exadata System Software release 24.1.0 introduces Exadata Live Update, a suite of enhancements to the mechanisms that orchestrate Exadata software updates on Exadata database servers.

Exadata Live Update includes the following key capabilities:

• Exadata Live Update uses online update capabilities based on standard Linux technologies, such as RPM and ksplice. Depending on the specific contents of the update, the update operation might occur without interrupting databases or rebooting the server.

  Any update items that cannot be completed online are staged for completion during a later server reboot. You can schedule the outstanding items to be completed at a specific time or during the next graceful server reboot. You can also choose to defer the outstanding items indefinitely.

• Exadata Live Update enables partial updates to address security issues. When using Exadata Live Update, you must choose from the following options:

  • highcvss: Performs only critical security updates to address vulnerabilities with a Common Vulnerability Scoring System (CVSS) score of 7 or greater.

  • allcvss: Performs only security updates to address vulnerabilities with a CVSS score of 1 or greater.

  • full: Performs a full update, which includes all security-related updates and all other non-security updates.

• Exadata Live Update can be controlled using the Exadata patchmgr utility, which provides an easy and familiar experience for existing Exadata users.

2.1.9 KVM Guest Secure Boot

Oracle Exadata System Software release 24.1.0 extends Secure Boot to Oracle Linux KVM guests.

KVM Guest Secure Boot leverages the UEFI boot framework in Oracle Linux KVM to restrict which binaries can boot the KVM guest, only allowing boot loaders that carry the cryptographic signature of trusted entities. During each reboot of the KVM guest, every component in the boot sequence is verified, preventing malware from hiding embedded code in the boot sequence.

For details, see Restricting the Binaries Used to Boot the System in Oracle Exadata Database Machine Security Guide.

2.1.10 SNMP Security Enhancements

Oracle Exadata System Software release 24.1.0 introduces the following security enhancements for SNMP connections used by Management Server (MS) on all Exadata storage servers and database servers to propagate management information and alerts.

• For all SNMP subscriber definitions, the administrator must specify the SNMP connection type, which implies the SNMP version being used. SNMP V3 is supported and encouraged for general subscribers (type=v3) and Oracle Auto Service Request (ASR) subscribers (type=v3ASR). The original type definitions for SNMP V1 (type=v1) and Oracle ASR (type=ASR) remain available. However, new SNMP V1 subscriber definitions are discouraged by a warning message recommending SNMP V3.

• For all SNMP V1 (type=v1) and Oracle ASR subscribers (type=ASR), the administrator must specify the SNMP community. Furthermore, common default community values, such as public and private, are discouraged by a warning message.

• For all SNMP V3 subscribers (type=v3 or type=v3ASR), the following SHA2 authentication protocols are available: SHA-224, SHA-256, SHA-384, and SHA-512.

  These protocols may be specified when adding a user for SNMP V3 subscriptions. For example:

  CellCLI> alter cell snmpuser.exampleuser512=(authprotocol='SHA-512',authpassword=*)

2.1.11 JSON Output from Management Server

Oracle Exadata System Software release 24.1.0 introduces support for JSON output from the Exadata Management Server (MS).

This capability enables JSON formatted output from CellCLI, DBMCLI, ExaCLI, and the MS REST interface.

2.1.12 Features Coupled with Oracle Database 23ai

Oracle Exadata System Software release 24.1.0 introduces the following capabilities in conjunction with Oracle Database 23ai.

• Smart Scan on Wide Tables
  
• Smart Scan on Index-Organized Tables
  
• Smart Scan on AES-XTS Encrypted Data
  
• Smart Scan during Online Encryption
  
• Smart Scan during Timezone Upgrades
  
• Smart Scan for Oracle Database 23ai Functions and Operators
  
• In-Memory Columnar Speed JSON Query
  
• Transparent Cross-Tier Scan
  
• Faster Opening of Pluggable Databases
  
• Pipelined Log Writes
  
• Faster Hash Joins on Large Tables
  

2.1.12.1 Smart Scan on Wide Tables

Oracle Database 23ai introduces support for wide tables containing up to 4096 columns. Wide tables facilitate applications that use denormalized (flat) schemas to avoid SQL joins. Use cases include modern analytics, machine learning, and Internet of Things (IoT) applications.

In conjunction with Oracle Database 23ai, Oracle Exadata System Software release 24.1.0 enables Exadata Smart Scan on wide tables.

Support for wide tables must be configured in the database by setting MAX_COLUMNS=EXTENDED in the database parameter file (init.ora). Once enabled in the database, the full power of Exadata Smart Scan is automatically and transparently applied to wide tables.

2.1.12.2 Smart Scan on Index-Organized Tables

In conjunction with Oracle Database 23ai, Oracle Exadata System Software release 24.1.0 introduces support for Exadata Smart Scan on index-organized tables (IOTs), including all types of compressed IOTs.

This capability substantially improves query performance for applications that use index-organized tables and requires no initial configuration or ongoing administration.

You can verify the usage of Smart Scan on IOTs by viewing the query execution plan generated using the EXPLAIN PLAN SQL command. In the output, Smart Scan on an IOT is indicated when either of the following STORAGE operations appear:

• INDEX STORAGE FAST FULL SCAN

• INDEX STORAGE FULL SCAN

2.1.12.3 Smart Scan on AES-XTS Encrypted Data

Oracle Database 23ai with Transparent Database Encryption (TDE) introduces support for tablespace encryption using AES-XTS, a de-facto industry standard for protecting data at rest.

In conjunction with Oracle Database 23ai, Oracle Exadata System Software release 24.1.0 transparently enables Exadata Smart Scan on data in tablespaces encrypted using AES-XTS. AES-XTS provides improved security and better performance, especially on Exadata where TDE can take advantage of parallel processing and specialized instructions built into processor hardware.

2.1.12.4 Smart Scan during Online Encryption

In conjunction with Oracle Database 23ai, Oracle Exadata System Software release 24.1.0 enables Exadata Smart Scan during online encryption operations. With this new feature, Exadata Smart Scan remains fully enabled during long-running online encryption, decryption, and rekeying operations. Previously, Exadata Smart Scan was disabled during such operations.

2.1.12.5 Smart Scan during Timezone Upgrades

Oracle Database uses timezone definitions to handle time calculations and daylight-saving time transitions. Timezone changes potentially alter data stored in columns using the TIMESTAMP WITH TIMEZONE data type. Previously, Exadata Smart Scan was disabled for the entire database during an upgrade of the timezone definitions.

In conjunction with Oracle Database 23ai, Oracle Exadata System Software release 24.1.0 reduces the impact of timezone upgrades. Under the new arrangement, Exadata Smart Scan remains enabled for queries on all tables without TIMESTAMP WITH TIMEZONE columns. Furthermore, the impact of timezone changes is now contained within a pluggable database (PDB). So, if a timezone change impacts one PDB, Exadata Smart Scan remains enabled for all the other PDBs.

2.1.12.6 Smart Scan for Oracle Database 23ai Functions and Operators

Oracle Exadata System Software release 24.1.0 enables Exadata Smart Scan in conjunction with the following new functions and operators introduced in Oracle Database 23ai:

• CEIL (datetime) function

• CEIL (interval) function

• FLOOR (datetime) function

• FLOOR (interval) function

• ROUND (interval) function

• TRUNC (interval) function

• TO_BOOLEAN function

• IS FALSE predicate operator

• IS NOT FALSE predicate operator

• IS TRUE predicate operator

• IS NOT TRUE predicate operator

2.1.12.7 In-Memory Columnar Speed JSON Query

In conjunction with Oracle Database 23ai and Oracle Database In-Memory, Oracle Exadata System Software release 24.1.0 introduces in-memory columnar caching of data in JSON documents. When Exadata encounters JSON data, using either the JSON data type introduced in Oracle Database 21c or the OSON-formatted BLOB data type available in Oracle Database 19c, the key/value pairs in the JSON are transparently and automatically converted to an in-memory columnar format and stored in Exadata Smart Flash Cache.

Subsequent queries on the JSON data can use Exadata Smart Scan and the cached JSON data to offload the processing of JSON operators to Exadata storage and substantially improve query performance. JSON operators supported by Exadata Smart Scan include JSON_EXISTS, JSON_VALUE, JSON_QUERY, IS JSON, and IS NOT JSON.

2.1.12.8 Transparent Cross-Tier Scan

In conjunction with Oracle Database 23ai and Oracle Database In-Memory, Oracle Exadata System Software release 24.1.0 enables a single query to utilize the combined power of in-memory columnar scan on the database servers along with Exadata Smart Scan and columnar cache on the storage servers. Previously, a single query could use an in-memory columnar scan on the database servers or Exadata Smart Scan and columnar cache on the storage servers, but not both.

Known as Transparent Cross-Tier Scan, this capability enables a query to efficiently utilize all available system resources and data representations to deliver better query performance. A Transparent Cross-Tier Scan ideally suits analytical queries on large tables where the data is spread across the database servers and storage servers.

2.1.12.9 Faster Opening of Pluggable Databases

In conjunction with Oracle Exadata System Software release 24.1.0, Oracle Database 23ai contains enhancements to store the database control file in Exadata RDMA Memory (XRMEM) on the storage servers and perform multiple concurrent reads using remote direct memory access (RDMA). Previously, RDMA reads to a database control file in XRMEM were serialized (one by one).

This capability enables multiple pluggable databases (PDBs) to open in parallel on Exadata systems, which considerably speeds up the process of opening PDBs, particularly in environments where a container database (CDB) contains many PDBs. Speeding up the process of opening PDBs also minimizes the application impact when a PDB opens on another database server in response to a database instance failure or a database shutdown for a planned maintenance operation.

2.1.12.10 Pipelined Log Writes

Redo log latency has always been critical for On-Line Transaction Processing (OLTP) performance. Previously, to streamline processing and avoid potential interruptions associated with process coordination, each log write was treated as a serial atomic operation.

Starting with Exadata X10M, the Oracle Database log writer can use the high-performance Exadata RoCE Network Fabric and Exadata Smart Flash Log to facilitate pipelined log writes. This capability leverages advancements in modern system hardware to run multiple concurrent log writes in parallel without impacting the latency of each redo log write. The result is a considerable overall improvement in OLTP performance by minimizing the need to queue log writes.

In conjunction with Oracle Exadata System Software release 24.1.0, this feature is available in Oracle Database 23ai and is also incorporated in the January 2024 release update for Oracle Database 19c.

2.1.12.11 Faster Hash Joins on Large Tables

A Bloom Filter is a data structure used to efficiently check if an element is a member of a set. Exadata Smart Scan uses Bloom Filters to perform hash joins inside the storage servers.

In conjunction with Oracle Database 23ai, Oracle Exadata System Software release 24.1.0 relaxes the previous internal limitation on the maximum size of a Bloom Filter sent to the storage servers. By enabling larger Bloom Filters, Exadata Smart Scan can perform more efficient hash joins with substantially faster results, especially on complex join queries involving large tables.

2.1.13 Minimum Versions and Other Requirements

The following list outlines the minimum versions and other requirements that apply to Oracle Exadata System Software 24.1.0:

• Minimum supported Oracle Database and Oracle Grid Infrastructure releases:

  • Release 19c: Version 19.15, April 2022 Release Update (RU)

    Note:

    Systems using Oracle Grid Infrastructure 19c versions before 19.23 (April 2024) also require patch 36114443 (19.22.0.0.240116ACFSRU) before upgrading to Oracle Exadata System Software release 24.1.0. The patch applies to all Oracle Grid Infrastructure 19c versions before 19.23 and is included in Oracle Grid Infrastructure 19c releases starting with version 19.23.

  • Release 21c: Version 21.6, April 2022 Release Update (RU)

    Note:

    Systems using Oracle Grid Infrastructure 21c versions before 21.14 (April 2024) also require patch 36114443 (21.13.0.0.240116ACFSRU) before upgrading to Oracle Exadata System Software release 24.1.0. The patch applies to all Oracle Grid Infrastructure 21c versions before 21.14 and is included in Oracle Grid Infrastructure 21c releases starting with version 21.14.

• Minimum system hardware versions:

  • 2-socket: Oracle Exadata X6-2

  • 8-socket: Oracle Exadata X6-8

• Minimum Oracle Exadata System Software version required on an existing system before updating to release 24.1.0: Oracle Exadata System Software 21.2.10 (March 2022)

  Note:

  On systems configured with virtual machines (VMs) on the database servers, you can upgrade the hypervisor (Oracle VM Server or Oracle Linux KVM) before or after the guest VMs. However, each VM guest must meet the minimum Oracle Exadata System Software requirement before being upgraded. Likewise, the hypervisor must meet the minimum Oracle Exadata System Software requirement before being upgraded.