Load, Link, and Feed Data

Before You Begin

Ensure that:

You selected or connected to an Autonomous AI Database.
The source file or object is available in the selected location, and you have permission to read it.
The target schema exists and your database user can create or update the target table.
You have information about the target table, whether it is a new or an existing table.

Cloud-storage sources also require:

You have permission to browse the storage resource containing the source file.
You have a valid credential for the selected cloud provider.

If the load or link workflow provides a credential-creation option, create the credential within that workflow; otherwise, configure the credential before starting.

Work with Cloud Storage Sources

Data Studio supports loading and linking data from cloud object stores, including OCI Object Storage, Amazon S3, Azure Blob Storage, and Google Cloud Storage.

When you select a cloud-storage source, Data Studio displays the storage resources and labels for the selected provider. Select a file to preview its contents and continue with a load or link workflow.

The storage resources and actions depend on the selected cloud provider, your access, and the capabilities supported for that provider.

Start a Data Load or Data Link Workflow

Open Catalog Navigator and do the following:

Go to the storage provider that contains your source data.
Select the bucket and the file or folder and click Add data.

The Add data wizard helps you to specify the source and target details, preview the data, review the generated SQL, and create a data load or data link job.

1. Select the Operation

Load data

Copies the source data into a database table. For more information, see Loading Data.
Link data

Creates a reference to the source data without actually copying it. The source data remains in its original location and is available through database objects such as external tables or views. For more information, see Linking Data.

Select the required operation and click Next to proceed.

2. Configure Data Structure

Review the Source path and edit it as needed.

Target settings

Specify the target action and target table details. For example, for load data you can select Create Table, select the Target schema, and enter the Target table name. Similarly, for link data you can specify table action as Create External Table.
Parsing settings

For delimited files, review the parsing settings: Encoding, Delimiter, and Header rows.
Column mapping

Review the column mapping to verify source columns, target columns, data types, length or precision, and format masks. Select or clear columns to include or exclude them from the operation.

3. Preview the Data

Use Preview to verify how Data Studio parses the source data before you create the load or link job.

Select Table to view the parsed rows and columns.
Select Raw to inspect the source data as raw text, when available.

4. Review and Create the Workflow

Review the data flow details, such as source, selected mode, target information, and action.

You can click Show code to preview the generated SQL.

Note:

You can go back to a previous step to change settings or switch between Load data and Link data.

Finally, click Create data load or Create data link depending on the selected operation.

After creating the data load or link workflow, you can monitor the progress and error information on the Jobs page. See Monitor and Manage Jobs.

Start a Livefeed Workflow

Set up a data stream to load data automatically into a table in your database from Object Storage.

Data Streams: A data stream can load data at a specified interval or when a new file is added to the source location. You can continue using other Data Studio features while the data stream completes.

For more information, see Feeding Data.

Create a Livefeed

Open Catalog Navigator and do the following:

Go to the storage provider that contains your source data.
Select the bucket and the file or folder and click Create Livefeed.
Specify the Data Source details, such as storage link, folder, file type, and credentials. Review the matching files in the selected source.
Review the Source path and specify Target settings, Parsing settings, and Column mapping as needed.
Select the file to preview the data.
Select the notification preferences and scheduling information.

You can click Show code to preview the generated SQL or go back to a previous step to change any setting.
Click Create to create the Livefeed data stream.

You can monitor the progress and manage the Livefeed from the Jobs page. See Monitor and Manage Jobs.