This diagram shows the conversion of enterprise application, flat file, event, and sensor data from multiple sources by using components in an Oracle Cloud Infrastructure region to produce usable insights for data consumers.
The following components apply to the entire Oracle Cloud Infrastructure region:
The region is divided into functional layers that house physical or functional components:
Data Sources layer: Data sources include nterprise applications, devices, end users, events, sensors, files and any data source of any type. Metadata from the enterprise applications databases is harvested and flows into the block Governance (Data Catalog).
Ingest, Transform layer: Data is refined by using batch and federation methods, leveraging different services depending on the use case.
A block labeled Batch Ingest (OCI Data Integration, Data Integrator, Data Transforms) handles data that is ingested and transformed in batches or micro batches. Raw data is stored in object storage.
A block labeled Batch Processing (Data Flow, OCI Data Integration, Data Integrator) processes data from both cloud storage and the serving database in the Persist, Curate, Create layer.
Data from any source can also be directly stored in Cloud Storage (Object Storage) and metadata from enterprise applications is stored in the block labeled Data Governance (Data Catalog) in the Persist, Curate, Create layer.
Persist, Curate, Create: Data is persisted in the lakehouse in Oracle Autonomous Data Warehouse or Oracle Cloud Infrastructure Object Storage or both. It is accessed by APIs and is used for analytics, visualization, and data science. Metadata passes to the block labeled Data Governance (Data Catalog).
Additional processing is provided by Batch Processing (Data Flow, OCI Data Integration, Data Integrator).
Analyze, Learn, Predict layer: Oracle Analytics Cloud uses the data for analytics and visualization. Data Science and AI use data for predictions. The resulting data is served to consumers. Oracle Functions and Oracle API Gateway provide the data to applications and to IoT consumers.
Measure, Act layer: People and partners use analytics data, applications and IoT consumers use refined data, and Data Share recipients can access the data provided by the serving engine directly.