Configuration on the OFS MMG Instance Server

Perform the following steps to complete the configurations on the OFS MMG instance server.

  1. Create a local folder on the OFS MMG install server, for example, hive_conf_dir:
    • /scratch/ofsaaapp/spark-lib/hive_conf_dir/yarn-site.xml (suggested some edits now to make the code work)
    • /scratch/ofsaaapp/spark-lib/hive_conf_dir/mapred-site.xml
    • /scratch/ofsaaapp/spark-lib/hive_conf_dir/hdfs-site.xml
    • /scratch/ofsaaapp/spark-lib/hive_conf_dir/core-site.xml
    • /scratch/ofsaaapp/spark-lib/hive_conf_dir/hive-site.xml
    • /scratch/ofsaaapp/spark-lib/hive_conf_dir/kbank.keytab
    • /scratch/ofsaaapp/spark-lib/hive_conf_dir/krb5.conf
  2. Configure the yarn-site.xml file with the following property:

    <property>

    <name>yarn.nodemanager.keytab</name>

    <value>”path to keytab”/<keytabfile>.keytab</value>

    </property>

    <property>

    <name>yarn.resourcemanager.address</name>

    <value>”cluster IP/hostname”:8032</value>

    </property>

    <property>

    <name>yarn.resourcemanager.scheduler.address</name>

    <value>”cluster IP/hostname”:8030</value>

    </property>

    <property>

    <name>yarn.resourcemanager.resource-tracker.address</name>

    <value>”cluster IP/hostname”:8031</value>

    </property>

    Note:

    Ensure that the Hadoop cluster and the OFS MMG instance are configured to run on the same Java version.