Data Flow now Supports Spark 3.5.0
- Services: Data Flow
- Release Date: April 19, 2024
Data Flow now supports Spark 3.5.0. For more information on migrating to Spark 3.5.0, see the Data Flow documentation.
40 Release Notes
Data Flow now supports Spark 3.5.0. For more information on migrating to Spark 3.5.0, see the Data Flow documentation.
You can now select GPU shapes for your drivers and executors with Data Flow.
More information on using GPUs in …
Data Flow now Supports SQL Endpoints.
Data Flow SQL Endpoints:
A Data Flow Pool is a group of pre-allocated Compute resources that can be used to run Data Flow based Spark …
You can now select Arm-based compute shapes for your drivers and executors with Data Flow. For more information, see the …
Data Flow integration with Data Science integration with Data Science uses fully managed Jupyter Notebooks to enable data scientists and …
When using Data Flow with private networks, SCAN Proxy is now supported to access databases in a RAC environment.
Data Flow now supports Spark 3.2.1. More information on migrating your Data Flow Applications to Spark 3.2.1 is available in …
Data Flow lets you use Oracle Cloud Infrastructure Logging to provide Spark diagnostic logs and (custom) Application logs in the …
To help you save resources and reduce time on management, Spark Dynamic Allocation is now enabled in Data Flow.. …
You can now select flexible compute shapes with Data Flow.
More information on the supported compute shapes and how to …
Spark Oracle datasource simplifies connection from Apache Spark to Oracle databases, Autonomous DB, and Exadata databases for Data Flow. It …
Data Flow now allows you to use up to five private endpoints at any one time. For more information, see …
Data Plane metrics have been added to the existing metrics available for use with Data Flow. For more information, see …
Data Flow now supports Resource Principal Authentication for both Spark Streaming and in batch. For more information, see Getting Started …
Streaming applications require continuous execution for a long period of time that often extends beyond 24 hours, and might be …
You can now use Hive metastore with Data Flow. For more information, see the service guide.
Data Flow is now available in the Brazil Southeast (Vinhedo) region.
For more information, see the Data Flow service guide …
Data Flow now supports Spark 3.0.2 as well as Spark 2.4.4. For more information, see the Data Flow documentation.
Data Flow now supports Spark-submit functionality, an industry standard command for running applications on Spark clusters.
For more information see …
Data Flow is now available in US government regions:
US Gov West (Phoenix)
US DoD North (Chicago)
US DoD West …
Metrics functionality is now available in Oracle Cloud Infrastructure Data Flow. The metrics are Run Start Up Time, Run Execution …
Data Flow is now available in the Chile (Santiago) region.
For more information, see Data Flow.
Data Flow is now available in the UK West (Newport) region.
For more information, see Data Flow.
Data Flow is now available in the UAE East (Dubai) region.
For more information, see Data Flow.
The Driver and Executor shapes that you select when creating a Data Flow Application now include the block storage volume …
You can now use a private endpoint in Data Flow applications. It allows secure access to resources that are in …
Data Flow is now available in the US West (San Jose) region.
For more information, see Data Flow.
Bootstrapping functionality is now available in Oracle Cloud Infrastructure Data Flow. Your PySpark applications might need custom dependencies in the form …
Data Flow is now available in the South Korea North (Chuncheon) region.
For more information, see Data Flow.
Data Flow is now available in the India South (Hyderabad) region.
For more information, see Data Flow.
Data Flow is now available in the Saudi Arabia West (Jeddah) region.
For more information, see Data Flow.
Data Flow is now available in the Australia South East (Melbourne) and Canada South East (Montreal) regions.
For more information, …
Data Flow is now available in the Japan Central (Osaka) and Netherlands Northwest (Amsterdam) regions.
For more information, see Data …
Data Flow is now available in the Australia East (Sydney) and South Korea Central (Seoul) regions.
For more information, see …
Data Flow is now available in the Switzerland North (Zurich) and India West (Mumbai) regions.
For more information, see Data …
Data Flow is now available in the Brazil East (Sao Paulo) region.
For more information, see Data Flow.
Data Flow is now available in the UK South (London) region.
For more information, see Data Flow.
Data Flow is now available in the Canada South East (Toronto) and Japan East (Tokyo) regions.
For more information, see …
Data Flow is a fully managed service for running Apache Spark ™ applications. It allows developers to focus on their …