Ingestion Batch Details

The Ingestion batch runs the data pipelines, filters the data and prepares the data for further processing.

Therefore, the Ingestion batch must be run before the TMScenario batch.

This batch loads the data from the staging tables to the business tables in the specified order. The loading process receives, transforms, and loads Market, Business, and Reference data that is required for event detection.

The following table provides the tasks that are configured for the Ingestion batch. These tasks must be executed in the following order:

Table 20-15 Ingestion Batch Details

Sequence Tasks for Ingestion Batch Jobs for Ingestion Batch Pipelines for Ingestion Batch
1 StartBatch Not Applicable Not Applicable
2 ACCTTRXNINT Load Intermediate Account and Transaction Data Load Intermediate Account and Transaction Data
3 WatchList Load and Prepare Watchlists Load and Prepare Watchlists
4 Customer Load Customer Data Load Customer Data
5 CustomerAddData Load Customer Add On Data Load Customer Add On Data
6 AnticipatoryProfile Load Customer Anticipatory Profile Data Load Customer Anticipatory Profile Data
7 Account Load Account Data Load Account Data
8 AccountGroup Load Account Group Data Load Account Group Data
9 AccountAddData Load Additional Account Data Load Additional Account Data
10 AcctAnticipatoryProfile Load Account Anticipatory Profile Data Load Account Anticipatory Profile Data
11 CustMapData Load Customer Mapping Data Load Customer Mapping Data
12 SupplyInfo Derive Risk and Load Supplementary Information Derive Risk and Load Supplementary Information
13 Transaction Load Transaction and Transaction Party Data Load Transaction and Transaction Party Data
14 Transaction Derive External Entities and Risk Derive External Entities and Risk
15 TrustedPair Load Trusted Pair Data Load Trusted Pair Data
16 LoanData Load Loan Data Load Loan Data
17 InsuranceData Load Insurance Data Load Insurance Data
18 CleanAMTempTables CleanAMTempTables Not Applicable
19 EndBatch Not Applicable Not Applicable

Note:

The following pipelines are updated to support the enhanced 314(a) file format, enabling the loading of Electronic Address (Website address & IP Address) into the business tables:
  • Load Customer Add-On Data
  • Load Transaction and Transaction Party Data