Add an Extract for Snowflake
Learn to capture data from a Snowflake source in OCI GoldenGate.
Before you begin
Ensure that you have:
-
A Snowflake connection created and assigned to your target Big Data deployment.
-
Enabled
CHANGE_TRACKINGon every table in Snowflake before the Extract start position. A start time earlier than the table’s tracking history cannot be served. For more details, refer to enable change tracking and plan retention. -
Set
DATA_RETENTION_TIME_IN_DAYSso the requested start and any unexpected outage or catch-up period remain within Time Travel retention. See Snowflake Time Travel. -
Reviewed supported Snowflake Source Data Types.
-
(Optional) Provided a Snowflake virtual warehouse for Extract queries. A separate warehouse is recommended to isolate capture query load, queueing, credit usage, and monitoring from analytics workloads; it is not separate Snowflake storage and does not need to be a separate account.
-
Reviewed required Snowflake roles and privileges.
Add an Extract
-
In the OCI GoldenGate deployment console navigation menu, select Extracts.
-
On the Extracts page, select Add Extract.
-
In the Add Extract panel, on the Extract Information page, complete the following fields as needed, and then select Next:
-
Enter a Process Name, no more than 8 characters long.
-
(Optional) Enter a Description to help you distinguish this process from others.
-
Select Snowflake from the Source dropdown.
-
Select an Extract Type:
-
Select Change Data Capture Extract for real-time change data capture.
-
Select Initial Load Extract for initial loads. For more details, see Precise instantiation for Oracle using Initial Load Extract.
-
-
-
On the Extract Options page, complete the following fields as needed, and then select Next:
-
Select Source Credentials.
-
For Extract Trail:
-
Enter a Name for the Extract process.
-
Enter Trail Sequence to set the starting number for Trail files.
-
Enter a Trail Size to set the max size for the generated trail file.
-
For Begin, select when to start the extract. For more details, see Precise instantiation for Oracle using Initial Load Extract.
-
Select an Encryption Profile. The Local Wallet profile is selected by default if an encryption profile wasn’t created.
-
Select an Encryption Algorithm.
-
-
-
On the Managed Options page, complete the following optional fields as needed, and then select Next:
-
Profile Name
-
Critical to deployment health
-
Auto Start
-
Auto Restart
-
-
On the Parameter file page, update the source mapping. For example:
TABLE "CATALOG_A"."SALES"."ORDERS"; -
Select Create and Run to create and start the Extract. If you select Create, then you can manually start the Extract later from the Extracts page.
You return to the Extracts page, where you can view the status of the Extract process. Select Details from the Extract Action menu to view process information, checkpoint, statistics, parameters, and reports.