4.10 Statistics for ER Job Execution

Users can capture execution time and data volume statistics for Entity Resolution jobs to be able to monitor performance and tracking support job. The start time, end time and total time is logged for each individual ER Job as well as each logical step within an ER Job. The statistics are logged into the respective job level and step level in the following tables every time when job execution is triggered with valid input parameters.

Volume statistics can be disabled by setting F_CAPTURE_COUNT_STAT= N. By default, this value is set to true in the FCC_ER_CONFIG table. For more information, see the Additional Configurations section.

The following tables capture time and volume statistics for all the ER Job execution.
  • FCC_ER_JOB_STATS: This table is present in the ER Schema and it contains start timestamp, end timestamp, total time taken and status for each ER job execution corresponding to fic_mis_date, runskey, job id and sequence id. N_JOB_ID column is an identifier for the ER Jobs. For example, if it is 1 in the N_JOB_ID column, then it indicates for ER Job 1 (Create Index and Load the Data).
  • FCC_ER_JOB_STEP_STATS: This table is present in the ER Schema and it contains start timestamp , end timestamp, total time taken and status for each step in the ER job execution corresponding to fic_mis_date, runskey , job id and sequence id.
  • FCC_ER_JOB_VOL_STATS: This table is present in the ER Schema and it contains log for data volume statistics pertaining to an ER job.
  • FCC_ER_JOB_STATS_QUERIES: This table is present in the Studio Schema and it contains the pre-seeded metadata queries that are executed to capture volume statistics during the ER job execution and the pre-seeded queries are marked with job id. The volume queries having N_STEP_ID value that are executed within the particular job step while others are executed on successful execution of the ER Job. The queries are marked against the key name (V_KEY) as an identifier for the volume query. The output of these volume queries is captured in FCC_ER_JOB_VOL_STATS against the fic_mis_date, runskey and sequence id.
  • FCC_ER_JOB_STEP_DESCRIPTION: This table is present in Studio Schema and it contains description of each of step id mentioned in the ER Statistics tables (FCC_ER_JOB_STATS, FCC_ER_JOB_STEP_STATS).