Configuration on the OFS MMG Instance Server
Perform the following steps to complete the configurations on the OFS MMG instance server.
- Create a local folder on the OFS MMG install server, for example,
hive_conf_dir:/scratch/ofsaaapp/spark-lib/hive_conf_dir/yarn-site.xml (suggested some edits now to make the code work)/scratch/ofsaaapp/spark-lib/hive_conf_dir/mapred-site.xml/scratch/ofsaaapp/spark-lib/hive_conf_dir/hdfs-site.xml/scratch/ofsaaapp/spark-lib/hive_conf_dir/core-site.xml/scratch/ofsaaapp/spark-lib/hive_conf_dir/hive-site.xml/scratch/ofsaaapp/spark-lib/hive_conf_dir/kbank.keytab/scratch/ofsaaapp/spark-lib/hive_conf_dir/krb5.conf
- Configure the
yarn-site.xmlfile with the following property:<property><name>yarn.nodemanager.keytab</name><value>”path to keytab”/<keytabfile>.keytab</value></property><property><name>yarn.resourcemanager.address</name><value>”cluster IP/hostname”:8032</value></property><property><name>yarn.resourcemanager.scheduler.address</name><value>”cluster IP/hostname”:8030</value></property><property><name>yarn.resourcemanager.resource-tracker.address</name><value>”cluster IP/hostname”:8031</value></property>Note:
Ensure that the Hadoop cluster and the OFS MMG instance are configured to run on the same Java version.