Oracle by Example brandingCreate a User-Managed Data Integration Platform Cloud Instance on OCI Classic

section 0Before You Begin

This tutorial shows you how to create a user-managed Data Integration Platform Cloud instance on Oracle Cloud Infrastructure (OCI) Classic. While this tutorial takes approximately 30 minutes to complete, it doesn't include wait times for instances to be provisioned.

Background

Data Integration Platform Cloud (DIPC) is an Oracle Cloud service that offers a single platform to connect to hundreds of on-premises and cloud data sources. From this platform, you extract, load, and transform (ELT) data entities of any shape and format, synchronize or replicate selected data sources, integrate with big data technologies, perform data analytics, and maintain data quality.

When you create an Oracle Data Integration Platform Cloud instance, you create a data integration environment in the cloud. Data integration applications are installed for you on one or more VMs which offer consoles that will be your data integration platform.

For Data Integration Platform Cloud, you can select one of the following editions:

  • Standard Edition: For a bulk copy of your data sources to the cloud, or to extract, load and transform your data.
  • Enterprise Edition: For a selective copy or real time replication of your data sources, or to extract, load and transform your data.
  • Governance Edition: To extract, load, transform, manage, replicate, and maintain data quality. (For this tutorial, you create an instance with Governance Edition.)

All these editions are offered both as self-managed (autonomous) and user-managed.

Wiith user-managed instances you get access to the VMs of the instances and you can configure the applications installed on them such as GoldenGate parameter files. You will also perform administrative tasks such as patching. User-managed instances are created on OCI Classic. On the other hand, there are autonomous instances, that are self-managed. For these instances patching/upgrade, rollback, VM start/stop/restart, WebLogic Admin and Managed server start/stop/restart operations are all done automatically. These self-managed instances are hosted on OCI which has a different architecture than the traditional OCI Classic.

The following regions are dedicated to OCI. All other regions are dedicated to OCI Classic. If you select any of these regions for your instances, then you will have self-managed instances so be careful when you select a region, when you create your instances.

  • Phoenix, AZ (PHX)
  • Ashburn, VA (IAD)
  • Frankfurt, Germany (FRA)
  • London, United Kingdom (LHR)

What Do You Need?

  • The link, username and password to My Services page for your Oracle cloud services.
  • A web browser

section 1Find Your Services and Backup Location

  1. Log in to Oracle Cloud's My Services page.
  2. Enter your username and password, and then click Sign In.
    Oracle Cloud Account Sign In
    Description of the illustration 001.002.png
  3. After you log in successfully, click Dashboard, and then click Customize Dashboard.
  4. Click Show for the following three services, they're not already displayed:
    • Under Infrastructure, show Storage Classic.
    • Under Data Management, show Database.
    • Under Integration, show Data Integration Platform Cloud.
  5. Confirm that these three services appear as three tiles on your dashboard.
    My Services Dashboard with service tiles displayed
    Description of the illustration 001.005.png
  6. Click the action menu of the Storage Classic tile, and then click View Details.
    Storage Classic Action menu - View Details
    Description of the illustration 001.006.png
  7. In the Additional Information section, copy the REST Endpoint  URL and paste it into a text editor to use later in this tutorial.
    REST Endpoint URL
    Description of the illustration 001.007.png
  8. Click Open Service Console.
    OCI Object Storage Classic - Open Service Console button
    Description of the illustration 001.008.png
  9. A replication policy defines your primary data center (dc) and whether your data should be replicated to a geographically distant (secondary) data center. If it's your first time, you'll see the Set a Georeplication Policy before continuing dialog. Ask the administrator of your Object Storage Classic service to select a policy. If you are the Storage Classic administrator of your account, then read the instructions and select a policy from the drop-down menu and click Set Policy. You'll only have to set this policy once and you can't change it later. If your policy is already set, then go to the next section Learn more.
    Set Georeplication Policy
    Description of the illustration 001.009.png
  10. Click the offscreen toggle menu (displayed as a hamburger icon) and then click My Services to go back to the list of services.

section 2Create a Database Deployment

  1. In the My Services Dashboard, locate Database in the list of services. If you don't see the tile, refer to step 1-4. From its Action Menu select Open Service Console.
    2. My Services Dashboard - Database Action menu - Open Service Console
    Description of the illustration 002.001.png
  2. If you encounter a welcome page, click Go to Console.
  3. On the Instances page, click Create Instance.
  4. Complete the Instance page as follows, and then click Next: (You may see less fields according to your subscription type.)
    • Service Name: DBCSDEF
    • Description: DEF database for DIPC 
    • Notification Email: <a valid email address to receive provisioning status>
    • Region: No Preference (If you select a region, then you'll get a deployment on Oracle Cloud Infrastructure (OCI) and you can't use it for the DIPC instance in the next section.)
    • Tags: warehouse (Click the Click to Create a Tag button, create a tag called warehouse and then click OK.)
    • Bring Your Own License : deselect (You may not have this option.)
    • Service Level: Oracle Database Cloud Service (You may not have this option.)
    • Metering Frequency: Monthly (You won't have this option for trial versions)
    • Software Release: Oracle Database 12c Release 1
    • Software Edition: Enterprise Edition
    • Database Type: Single Instance
    5. Create Instance Wizard - Instance page
    Description of the illustration 002.004.png
  5. On the Details page, complete the Database Configuration fields as follows, and then click Next:
    • DB Name: ORCL
    • PDB Name: PDB1
    • Administration Password and Confirm Password fields: password
    • Usable Data Storage (GB):25

      • The entry for Usable Database Storage, populates the Total Data File Storage (GB) field to reflect the amount of storage for your instance, such as space for operating system and product binaries, supporting files, database data and configuration files. After you create the instance, you can add more data storage later.

    • Total Data File Storage (GB): 88.5
    • Compute Shape: OC3 - 1.0 OCPU, 7.5 GB RAM
    • Click Edit for SSH Public Key.
    • In the SSH Public Key for VM Access dialog, select Create a New Key, then click Enter.
      SSH Public Key for VM Access
      Description of the illustration 002.005.png
    • Click Download in the Download Keys dialog.
    • Save the sshkeybundle.zip file to your computer.
    • Confirm that the SSH Public Key field now contains a public key value.
    Database Configuration
    Description of the illustration 002.005c.png
  6. Expand Advanced Settings, and then complete the fields as follows:
    • Listener Port: 1521
    • Select your timezone from the Timezone menu.
    • Select Enable Oracle GoldenGate.
    • De-select Include "Demos" PDB to save database space.
    Advanced Settings
    Description of the illustration 002.006.png
  7. Complete the Backup and Recovery Configuration fields as follows, and then click Next:
    • Backup Destination: Both Cloud Storage and Local Storage
    • Cloud Storage Container: The container field is automatically filled with the proper container URL format. This format is the REST Endpoint URL you found in step 1-7, appended with a slash and then the container name. If you want a new container created for you, just append a new name (it can be different name than the pre-populated one). For this tutorial, change the pre-populated container name which is dbcs-DBCSDEF with the name, dbcsDEF.
      Format: rest_endpoint_url/containerName
      Example: https://dipc.storage.oraclecloud.com/v1/Storage-dipc/dbcsDEF
    • Username: Enter the username for My Services which applies to Storage Classic, Database and Data Integration Platform Cloud. If you don't know it, refer to the What Do You Need section of this tutorial. (
    • Password: Enter the password for My Services. Use your latest password. If you don't know it, refer to the What Do You Need section of this tutorial. If the Storage Classic administrator has changed the password after you received your service credentials, then you need the latest password which may be different than the one for My Services.)
    • Create Cloud Storage Container: Select

      • Note: If your Storage administrator has already created a container for you to use, then deselect this checkbox and use the existing container name in the Cloud Storage Container field with the format of rest_endpoint_url/existingContainerName

      REST Endpoint URL
      Description of the illustration 002.007.png
  8. Click Next and ensure that in the Confirm step, you get a message that the container was created.
    Confirmation Cloud Storage container created
    Description of the illustration 002.008.png
  9. Review the details for your database cloud deployment. If you need to make changes, click Previous or use the navigation train to go back. Otherwise, click Create.
  10. Click the DBCSDEF instance and refresh the Service Overview page until the status displays Ready.
    11. DBCSDEF service instance details - Status Ready
    Description of the illustration 002.010.png

section 3Create a Data Integration Platform Cloud Instance

  1. On the My Services dashboard, locate the Data Integration Platform Cloud tile, and then select Open Service Console from the Actions menu.
    DIPC Actions menu - Open Service Console
    Description of the illustration 003.001.png
  2. If you encounter a welcome page, click Go to Console.
  3. On the Instances page, click Create Instance.
  4. Complete the Instance fields as follows, and then click Next:
    • Service Name: DIPCDEF
    • Service Description: Data Integration Platform Cloud for DEF instance
    • Notification Email:<a valid email address to receive provisioning status>
    • Tags: DEF (Click the plus symbol to create a tag called DEF)
    • Cluster Size: 2
    • Service Edition: Governance Edition (Refer to Before you Begin section of this tutorial to learn more about these editions.)
      Create New Instance wizard - Instance page
      Description of the illustration 003.004.png
  5. Complete the Database Configuration fields as follows: (This database is used to store the schema of the Data Integration Platform Cloud server for this instance.)
  6. Complete the Backup and Recovery Configuration fields as follows:
    • As a rule of thumb, for Storage containers you enter the URL of a new or existing container in the format of the REST Endpoint URL that you found in step 2-6 and you append it with a slash and then the container name. If you want a new container created for you, you append a new name, instead of an existing container name, and then select the checkbox to create the container. (For this tutorial, you create a new one. Not all services , pre-poluate the REST endpoint URL for the Cloud Storage Container field so it will come in handy to know how to find the REST endpoint URL.)
      Format: rest_endpoint_url/containerName
      Example: https://dipc.storage.oraclecloud.com/v1/Storage-dipc/dipcDEF
    • Cloud Storage Username: Enter the username for My Services which applies to Storage Classic, Database and Data Integration Platform Cloud. If you don't know it, refer to the What Do You Need section of this tutorial.
    • Cloud Storage Password: Enter the password for My Services. Use your latest password. If you don't know it, refer to the What Do You Need section of this tutorial. If the Storage Classic administrator has changed the password after you received your service credentials, then you need the latest password which may be different than the one for My Services.)
    • Create Cloud Storage Container: select checkbox
      Backup and Recovery Configuration
      Description of the illustration 003.006.png
  7. Complete the WebLogic Server Configuration fields as follows, and then click Next:
    • Compute Shape: OC3m - 4.0 OCPU, 60.0 GB RAM
    • Click Edit for SSH Public Key.
    • Separately, in your computer's file browser, find the zipped folder containing the system generated key for the database deployment, called sshkeybundle.zip and unzip it. (Refer to section 2-5 of this tutorial. You can also create a new key for this section.)
    • In the SSH Public Key for VM Access dialog box, select Key File Name and then browse to sshkeybundle folder and select publicKey. Then click Enter.
      • SSH Public Key for VM Access
      Description of the illustration 003.007a.png
    • Administrator Username: <Your choice of username to access consoles of Data Integration Platform Cloud>
    • Password: <Your choice of password for the username in this section>
    • Confirm Password: <Confirm your choice of password for the username in this section>
      WebLogic Server Configuration
      Description of the illustration 003.007b.png
  8. Review the details for your Data Integration Platform Cloud instance. If you need to make changes, click Previous or use the navigation train to go back. Otherwise, click Create.
  9. On the Instances page, confirm that the DIPCDEF instance appears in the list of instances with the Status displayed as: Creating service...
    DIPCDEF Service instance details
    Description of the illustration 003.010.png
  10. Refresh the Instances page until the Status: Creating service ... is no longer displayed on this page.
  11. Click the DIPCDEF instance to go to the Instance Overview page and then confirm that the Status field displays Ready.
  12. Go back to the Instances page, click the Action Menu of DIPCDEF, and then click Data Integration Platform Console to access this console.

more informationWant to Learn More?