Workflow Manager logs

The Workflow Manager Service generates five types of logs.

The Workflow Manager logs are stored in the $BDD_HOME/logs/workflowmanager directory.

The logs are:

Diagnostic log

The Workflow Manager diagnostic log contains details of the process and status of workflows. For example, a request for a new data set and the resulting of the submitted job to Spark would be: 
...
ProvisionDatasetFromHive::processEvent Start{1fb5df0e-66cd-4ce5-8ff8-5b93e2ee2df0}
jobState: JobState:{ProvisionDatasetFromHive, 1fb5df0e-66cd-4ce5-8ff8-5b93e2ee2df0, 0, 1}
state: {1} START
TRANSITION: START  -- Start -->  EXECUTE YARN APPLICATION
stateN: {2} EXECUTE YARN APPLICATION
beginTransaction: {
  state:   2
  input:   {"properties":{"$AT$":"1475169019913","$NV$":"1"}}
  output:  {"properties":{}}
} commit
beginTransaction: {
  input:   {"properties":{"$AT$":"1475169019913","$NV$":"1","$CK$":"0"}}
  output:  {"properties":{"DATABASE_NAME":"edp_cli_edp_37396cf4-fab1-40c8-bb08-d5bb09478d58",
            "COLLECTION_NAME":"edp_cli_edp_37396cf4-fab1-40c8-bb08-d5bb09478d58"}}
} commit
new spark job submission.
waiting for 120000 ms. jobId: 1fb5df0e-66cd-4ce5-8ff8-5b93e2ee2df0
...
Connecting to ResourceManager at web2.example.com/10.152.105.219:8032
Requesting a new application from cluster with 1 NodeManagers
...
Submitting application 1 to ResourceManager
Submitted application application_1475159335282_0001
Application report for application_1475159335282_0001 (state: ACCEPTED)
[[
	 client token: N/A
	 diagnostics: N/A
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: root.fcalvin
	 start time: 1475169024978
	 final status: UNDEFINED
	 tracking URL: http://web2.example.com:8088/proxy/application_1475159335282_0001/
	 user: fcalvin
]]
...
Application report for application_1475159335282_0001 (state: RUNNING)
[[
	 client token: N/A
	 diagnostics: N/A
	 ApplicationMaster host: 10.152.105.219
	 ApplicationMaster RPC port: 0
	 queue: root.fcalvin
	 start time: 1475169024978
	 final status: UNDEFINED
	 tracking URL: http://web2.example.com:8088/proxy/application_1475159335282_0001/
	 user: fcalvin
]]
...
Application report for application_1475159335282_0001 (state: FINISHED)
[[
	 client token: N/A
	 diagnostics: N/A
	 ApplicationMaster host: 10.152.105.219
	 ApplicationMaster RPC port: 0
	 queue: root.fcalviln
	 start time: 1475169024978
	 final status: SUCCEEDED
	 tracking URL: http://web2.example.com:8088/proxy/application_1475159335282_0001/A
	 user: fcalvin
]]
MdexCollectionIdentifier{
   databaseName=edp_cli_edp_37396cf4-fab1-40c8-bb08-d5bb09478d58, 
   collectionName=edp_cli_edp_37396cf4-fab1-40c8-bb08-d5bb09478d58}: 
   agent response for ingest request: Request accepted}
...
publish: IngestStartedEvent{1fb5df0e-66cd-4ce5-8ff8-5b93e2ee2df0}
...
publish: IngestCompletedEvent{1fb5df0e-66cd-4ce5-8ff8-5b93e2ee2df0}
...
notification: class Notification {[[
  workflowName: CLIDataLoad
  sourceDatabaseName: null
  sourceDatasetKey: null
  targetDatabaseName: edp_cli_edp_37396cf4-fab1-40c8-bb08-d5bb09478d58
  targetDatasetKey: edp_cli_edp_37396cf4-fab1-40c8-bb08-d5bb09478d58
  ecid: 1.0000LTqvDmK7ADkpSw4Eyc1NvKfs000000;kXjE
  status: SUCCEEDED
  startTime: 1475169014628
  timestamp: 1475169109265
  progressPercentage: 100.0
  errorMessage: null
  trackingUrl: http://web2.example.com:8088/proxy/application_1475159335282_0001
  properties: {dataSetDisplayName=WarrantyClaims, isCli=true, wm.jobId=1fb5df0e-66cd-4ce5-8ff8-5b93e2ee2df0}
}
]]

Request log

Requests to the Workflow Manager are logged in the <date>.request.log. A sample request would be: 
"POST /bdd.workflowmanager/v1/ProvisionDataSetFromHiveWorkflow HTTP/1.1" 202 48 "-" "Swagger-Codegen/1.0.0/java" 31458

In this example, the request is to start a provisioning workflow for a new data set.

The request entries are prefixed with the IP address from which the requests originated and the time stamp of the request.