Additional Configurations for ORAAH Executions
The following configurations are mandatory for model executions using ORAAH.
Set the following environment variables in
$R_HOME/etc/Renviron.site file:
HIVE_HOME,SPARK_HOME,HADOOP_HOMEwith the respective pathsHIVE_CONF_DIR,HADOOP_CONF_DIR,YARN_CONF_DIR,SPARK_CONF_DIRwith their respective configuration directory pathsCLASSPATHandHADOOP_CLASSPATHwith all the hadoop/hdfs/yarn/hive jars, Hadoop configuration directory (HADOOP_CONF_DIR) and spark configuration directory (SPARK_CONF_DIR)For example,
CLASSPATH=$HADOOP_CONF_DIR:$SPARK_CONF_DIR:All_hadoop_jarsSPARK_JAVA_OPTSvariable with$R_HOME/libFor example,
SPARK_JAVA_OPTS="-Djava.library.path=/usr/lib64/R/lib"- For Kerberos enabled cluster, initializing the ticket should be
done in
Renviron/Renviron.sitefile.