Ingesting data
Data Ingestion is the process that brings your external source data into Oracle Unity, maps it to one or more data objects, and persists it to the Oracle Unity data warehouse so you can start mastering it. Each data ingestion method provides different options for ingesting your data. You can ingest data using the following methods:
-
Ingest Jobs
Use ingest jobs to bring external source data into Oracle Unity, map the data, and transform the data.
-
The Near real time ingestion API
Ingest data directly from your source system into Oracle Unity data warehouse data objects.
-
The Stream API
Stream data directly from your source system into Oracle Unity, then run data warehouse jobs to action the data.
The following table outlines some of the features and use cases supported by each Data Ingestion method:
| Feature / use case | Ingest Jobs | Stream API | Near real time ingestion API |
|---|---|---|---|
| Import data directly from an application using an API | |||
| CSV files with bulk data via SFTP | |||
| CSV files with bulk data via Oracle Object Store | |||
| Oracle Applications |
Ingesting data using the API
Use the API endpoints to stream data directly from your application into Oracle Unity. There are two APIs that ingest data directly into Oracle Unity:
Here's a comparison of the features of each API.
| Feature / use case | Near real time ingestion API | Stream API |
|---|---|---|
| Use an API to import data directly from an application | ||
| Ingest data in near real-time | ||
| Ingest data directly into data warehouse data objects |
Ingest jobs
Ingest jobs enable you to specify an external data source that Oracle Unity retrieves data from. You can specify the following external data sources:
-
Oracle Object Stores
-
CSV files hosted on SFTP sites
-
Oracle applications such as Oracle Responsys and Oracle Eloqua.
Refer to the Unity Help Center for a list of applications.
The ingestion job process also maps and transforms incoming data.
For more information about ingest jobs, refer to the Oracle Unity Help Center.
Next steps
Ingesting data using the Near real time ingestion API