DP CLI permissions and logging

This topic provides brief overviews of permissions and logging.

DP CLI permissions

The DP CLI script is installed with ownership permission for the person who ran the installer. These permissions can be changed by the owner to allow anyone else to run the script.

In addition, if the DP CLI is to be run by a non-install user on a CDH or HDP system, these commands must be run to create the user-specific folder under /user/ for the non-install users who will run the DP CLI:

sudo -u hdfs hdfs dfs -mkdir /user/<user_name>

sudo -u hdfs  hdfs dfs -chown <user_name> /user/<user_name>

The reason is that the user folder will not be created automatically, like what MapR does. This is a difference between MapR and HDFS.

DP CLI logging

The DP CLI logs detailed information about its workflow into the log file defined in the log4j.properties file. This file is located in the $BDD_HOME/dataprocessing/edp_cli directory and is documented in DP logging properties file.

The implementation of the BDD Hive Table Detector is based on the DP CLI, so it uses the same logging properties as the DP CLI script. It also produces verbose outputs (on some classes) to stdout/stderr.