16 Configure Remote Agents

Depending on the type of Task you want to perform in Data Integration Platform Cloud, there are additional agent configuration steps.

Topics:

• Set up a Remote Agent for ODI

• Set up an External Library Path for GoldenGate 12c

• Set up Remote Agent for Autonomous Data Warehouse Cloud

• Set up a Remote Agent for Big Data

• Upgrade an On-Premises Agent

Set up a Remote Agent for ODI

When you select Data Integrator (ODI) in the Download Agent Installer dialog, ODI binaries are included in your Agent package. You need these bits when performing Synchronize Data and ODI Execution Tasks.

The ODI plug-in for Agents enables you to perform data integration tasks remotely in the on-premises environment. Once downloaded and configured, the Agent starts working on the remote environment. The Agent gets registered in Data Integration Platform Cloudand appears in the Agents list.

Description of the illustration oracle_data_integrator_plugin_architecture.png

To download and configure the Remote Agent for ODI:

1. Log in to Data Integration Platform Cloud and click Agents in the left navigation.
2. On the Agents page, click Download Installer and select Data Integrator (ODI) and Oracle 12c (OGG) in the Download Agent Installer dialog, and then click Download.
3. Create a directory called dicloud for installing the agent, move the agent package to that directory, and then unzip the agent package.
4. After the files are unzipped, move to the dicloud directory and then run the agent configuration with authentication type BASIC and the odiRemote flag.

   ./dicloudConfigureAgent.sh -authType=BASIC -odiRemote

   Note:

   Port 3307 must be kept free for installing MySQL.

   For more detailed information about configuring the remote agent, see Set Your Agent Properties.

5. Follow the prompts and enter your Data Integration Platform Cloud instance name, your managed server port number, username and password. Be aware that a username confirmation is required before entering the password.

When the script completes, MySQL, your Data Integration Platform Cloud agent, GoldenGate, and the on-premises ODI are installed. You can now start the agent.

> cd $DIPC_AGENT_DIR/dicloud/agent/dipcagent001/bin
> ./startAgentInstance.sh

Set up an External Library Path for GoldenGate 12c

To configure the database library paths for a particular supported database for Oracle GoldenGate 12c, you must set an external library path for Oracle GoldenGate.

ggExternalLibraryPath is a property in agent.properties. You use it to set an external library path for Oracle GoldenGate 12c on Windows.

Note:

Make sure that you’ve an Oracle GoldenGate 12c client installed on Windows.

Binaries should be the client binary of the corresponding Oracle GoldenGate 12c database.

To set the Oracle GoldenGate 12c dependent library path on Windows:

1. Edit your agent.properties file located at <agent_unzip_loc>/dicloud/agent/<dipcagent001>/conf/agent.properties.
2. Set ggExternalLibraryPath=<path to oracle 12c windows lib path>;<path2>
3. In the path or in the terminal where the agent is started, set ORACLE_HOME to the same value as ggExternalLibraryPath.
4. To download the database library binaries, go to:

To download the database library binaries:

• 12.1.0.2: https://www.oracle.com/technetwork/database/database12c-win64-download-2297732.html

• 12.2.0.1: https://www.oracle.com/technetwork/database/enterprise-edition/downloads/oracle12c-windows-3633015.html

Set up Remote Agent for Autonomous Data Warehouse Cloud

To replicate data to Oracle Autonomous Data Warehouse Cloud (ADWC) using Data Integration Platform Cloud, you must set up the remote Agent.

Note:

If any error message appears, you can track it from the drill-down status list of Agents.

To set up the Remote Agent for ADWC:

Perform the steps below, before you Create a Replicate Data Task for ADWC.

1. Stop the DIPC Agent using:

   <agent install location>/dicloud/agent/dipcagent001/bin/stopAgentInstance.sh

2. Stop/kill all running OGG processes (Manager, extract, pump, replicat, pmsrvr).
3. Download the 12.2 Instant Client from here: 

   https://www.oracle.com/technetwork/topics/linuxx86-64soft-092277.html

4. Extract the required Instant client packages listed below to disk.
5. Copy selected OCI libraries (overwrite) the files under <agent Install location>/dicloud/oci.

   From 12.2 Instant Client Package - Basic zip, you need these files:

   libclntsh.so.12.1

   libclntshcore.so.12.1

   libocijdbc12.so

   liboramysql12.so

   libipc1.so

   libnnz12.so

   libons.so

   libmql1.so

   libocci.so.12.1

   From 12.2 Instant Client Package - ODBC zip, you need this file:

   libsqora.so.12.1

   From 12.2 Instant Client Package - JDBC Supplement zip, you need this file:

   libheteroxa12.so

   From 12.2 Instant Client Package - SQL*Plus zip, you need this file:

   libsqlplus.so

6. Download the client credentials zip file from ADWC console, and extract the files on disk.

   This zip file will contain cwallet.sso, ewallet.p12, keystore.jks, ojdbc.properties, sqlnet.ora, tnsnames.ora, truststore.jks files.

   • From extracted wallet, update the extracted sqlnet.ora file with correct location of the wallet.

     The sample sqlnet.ora:

     NAMES.DIRECTORY_PATH= (TNSNAMES, EZCONNECT)
     WALLET_LOCATION = (SOURCE = (METHOD = file) (METHOD_DATA = (DIRECTORY=<Location of extracted Wallet file>)))
     SSL_SERVER_DN_MATCH=yes
     SQLNET.USE_HTTPS_PROXY=on
     bequeath_detach=true
     SQLNET.ALLOWED_LOGON_VERSION=8

   • From extracted wallet, update the extracted tnsnames.ora with proxy and port. The use of proxy is optional. The sample tnsnames.ora:

     odidb_low = (description= (address=(https_proxy=www-proxy-adwc.example.com)(https_proxy_port=80)
     (protocol=tcps)(port=1522)(host=adwc.examplecloud.com))(connect_data=
     (service_name=@adwc_odidb_low.adwc.examplecloud.com))(security=(ssl_server_cert_dn=
     "CN=adwc.examplecloud.com,OU=Example BMCS Example,O=Example,L=Example 
     City,ST=Example,C=Example"))   )

7. Copy the updated sqlnet.ora and tnsnames.ora files to <agent install location>/dicloud/agent/dipcagent001/conf directory.
8. Set environment variables. The following examples are of a correct setting sequence:

   • Set TNS_ADMIN environment variable to <agent Install location> /dicloud/agent/dipcagent001/conf.

   • Set  LD_LIBRARY_PATH environment variable to <agent install location>/dicloud/oci.

   • Unset ORACLE_HOME environment variable.

9. Start the DIPC agent with <agent install location>/dicloud/agent/dipcagent001/bin/startAgentInstance.sh.
10. You may encounter this error, if the DIPC agent is manually installed:

    IO Error: IO Error Received fatal alert: handshake_failure, Authentication lapse 0 ms.

    When the agent is deployed, it uses JAVA. But when you restart the agent , or install it manually you should specify the Java present in the machine, where agent is installed. Use a Java version JDK 1.8.0_161 or higher. If this Java version is below JDK 1.8.0_161, execute the following steps:

    • Download and install Java Cryptology Extension Unlimited Strength Jurisdiction Policy Files. It contains files - local_policy.jar, README.txt, and  US_export_policy.jar . Copy these files to JDK_HOME\jre\lib\security folder.  

      https://www.oracle.com/technetwork/java/javase/downloads/jce8-download-2133166.html

    • Open JDK_HOME\jre\lib\security\java.security. You can see the following entries there: 

      security.provider.1=sun.security.provider.Sun
      security.provider.2=sun.security.rsa.SunRsaSign
      security.provider.3=sun.security.ec.SunEC  
      security.provider.4=com.sun.net.ssl.internal.ssl.Provider
      security.provider.5=com.sun.crypto.provider.SunJCE 
      security.provider.6=sun.security.jgss.SunProvider
      security.provider.7=com.sun.security.sasl.Provider 
      security.provider.8=org.jcp.xml.dsig.internal.dom.XMLDSigRI 
      security.provider.9=sun.security.smartcardio.SunPCSC
      security.provider.10=sun.security.mscapi.SunMSCAPI  

    • Add the following line below the above-listed entries:

      security.provider.11=oracle.security.pki.OraclePKIProvider

    •  Restart the Agent.

Set up a Remote Agent for Big Data

When you select Big Data (OGG) in the Download Agent Installer dialog, the GoldenGate for Big Data binaries are included in your Agent package.

Oracle GoldenGate Big Data is configured the same way as the other GoldenGate Homes. You must set JAVA_HOME environment variable on the Agent’s host machine. The install directory is referred as GG_HOME. In the agent.properties file, the following properties are configured by default:

ggmonbigdata.ggPerfMetricsServerPort = <7830>

ggmonbigdata.agentGoldenGateHome = <path to gghomebigdata>

ggmonbigdata.ggRepoUdpPort = <9950>

ggmonbigdata.ggInstancePort = <7829>

You can override the default settings if you need to.

To configure Oracle GoldenGate agent for Big data:

1. After you download the Agent Installer package, extract the files.
2. Run the dicloudConfigureAgent script located in the dicloud directory.

For more information on configuring an agent, see Set Your Agent Properties

Upgrade an On-Premises Agent

You can upgrade an on-premises DI agent using certain command prompts relevant to the chosen environment.

To upgrade an on-premises agent:

1. Log in to Data Integration Platform Cloud.
2. From the left navigation pane, click Agents.
3. From the Download Installer menu, select the available agent package.
4. In the Download Agent Installer window, click OK.

   An agent package bundle for your platform is downloaded to your machine. You can unzip, configure, and start the Agent.

5. Unzip to <AgentTempUnzipLoc>
6. Stop the running/old agent by calling the stop agent script.
7. Launch a Command prompt (@ <OldAgentUnzipLoc>/gghome) and set following environment variables : 
   1. For Linux (Oracle 12c): Set LD_LIBRARY_PATH :: <OldAgentUnzipLoc>/gghome/oci
   2. For Linux (Oracle 11g): Set LD_LIBRARY_PATH :: <OldAgentUnzipLoc>/gghome/oci11g
   3. For Windows (Oracle 12c): Set Path : <OldAgentUnzipLoc>/gghome/lib12
8. Launch GGSCI by executing:
   1. <OldAgentUnzipLoc>/gghome/ggsci for Oracle 12c
   2. <OldAgentUnzipLoc>/gghome11g/ggsci for Oracle 11g
9. Execute "INFO ALL" to see the list of running GG processes
10. Stop all the Running processes by executing "STOP <ProcessName>"
11. Exit GGSCI.
12. Run the script <AgentTempUnzipLoc>/dicloud/dicloudUpgradeAgent.bat<old_agent_oracle_home>
13. Once the agent upgrade is finished - start the agent
14. Repeat steps 7 to 10.
15. Restart the processes stopped in step 12 by using the "START <processname>" command.

Example 16-1 Syntax of the Command

${AgentTempUnzipLoc}/dicloudUpgradeAgent.sh <old_agent_oracle_home>   [-debug ]
<old_agent_oracle_home>  = <old_agent_unzip_loc>/dicloud/agent/oracle
[-debug ]                = Generates debug log for this run.    [Optional]  
Example :
$./scratch/MyAgentTempUnzipLoc/dicloud/dicloudUpgradeAgent.sh /scratch/work/install/MyDIPCAgentunzipLoc/dicloud/agent/oracle