Replicate data from PostgreSQL to Google BigQuery
Learn how to use OCI GoldenGate to replicate data from PostgreSQL to Google BigQuery.
Before you begin
To successfully complete this quicktart, you must have the following:
- A PostgreSQL installation to serve as the source database (Installation instructions follow in Environment set up.)
- Open port 5432 in your VCN's security list.
- Create a connection to Google Cloud
Storage.
Note
Ensure that the GCS bucket and the BigQuery dataset exist in the same location/region. - Google Cloud Service Account Key.
- Google Cloud Platform BigQuery Permissions.
Task 1: Create the OCI GoldenGate resources
- Create a deployment for the source PostgreSQL database.
- Create a Big Data deployment for the target Google BigQuery.
- Create a connection to the to the target Google BigQuery.
- Create a connection to the source PostgreSQL database.
- For Type, ensure that you select PostgreSQL Server.
- For Database name, enter
ociggll
. - For Host, enter the public IP of the Compute instance that PostgreSQL runs on.
- For Port, enter
5432
. - For Username, enter
ggadmin
. - For Password, enter a password.
- For Security Protocol, select Plain.
- Create a connection to GoldenGate, and then assign this connection to the source PostgreSQL deployment.
- Assign the source connection to the source PostgreSQL deployment..
- Assign the target connection to the target Big Data deployment.
Task 4: Create the Distribution Path for Change Data Capture
To create a Distribution Path for Change Data Capture, complete the following:
- In the Oracle Cloud console, on the Deployments page, select the target Big Data deployment.
- On the deployment details page, click Launch Console. Log in with the admin user details created in task 1, step 2.
- If using IAM credential store, proceed to the Create a Distribution
Path step. If using GoldenGate credential store, create a user with which the
source GoldenGate uses to connect to the target GoldenGate.
- In the source PostgreSQL deployment console, create a Path connection for the
user created in the previous step.
- Click Add Distribution Path.
- Complete the Add Path form as follows:
- In the target Big Data deployment console, click Receiver Service, and then review the Receiver Path created.