Set the Hadoop Clusters

Configure $ORACLE_HOME, $HADOOP_HOME to validate the installation directories.

  1. Copy the following required Oracle JDBC/security JARS to HDFS.
  2. Execute the following commands that need to be run on the Hadoop cluster:
    • $HADOOP_HOME/hdfs dfs -mkdir -p /spark/jars/
    • $HADOOP_HOME/bin/hdfs dfs -put $ORACLE_HOME/lib/ojdbc8.jar /spark/jars/
    • $HADOOP_HOME/bin/hdfs dfs -put $ORACLE_HOME/jlib/oraclepki.jar /spark/jars/
    • $HADOOP_HOME/bin/hdfs dfs -put $ORACLE_HOME/jlib/osdt_core.jar /spark/jars/
    • $HADOOP_HOME/bin/hdfs dfs -put $ORACLE_HOME/jlib/osdt_cert.jar /spark/jars/
  3. Verify that the jars are copied by executing the following command:

    hdfs dfs -ls /spark/jars