This section describes logging for the Data Processing component of Big Data Discovery.
DP logging overview
This topic provides an overview of the Data Processing logging files.
DP logging properties file
Data Processing has a default Log4j configuration file that sets its logging properties.
Example of DP logs during a workflow
This example gives an overview of the various DP logs that are generated when you run a workflow with the DP CLI.
Accessing YARN logs
When a client (Studio or the DP CLI) launches a Data Processing workflow, a Spark job is created to run the actual Data Processing job.
Transform Service log
The Transform Service processes transformations on data sets, and also provides previews of the effects of the transformations on the data sets.