Ingestion Batch Details
The Ingestion batch runs the data pipelines, filters the data and prepares the data for further processing.
Therefore, the Ingestion batch must be run before the TMScenario batch.
This batch loads the data from the staging tables to the business tables in the specified order. The loading process receives, transforms, and loads Market, Business, and Reference data that is required for event detection.
The following table provides the tasks that are configured for the Ingestion
batch. These tasks must be executed in the following order:
Table 20-15 Ingestion Batch Details
Sequence | Tasks for Ingestion Batch | Jobs for Ingestion Batch | Pipelines for Ingestion Batch |
---|---|---|---|
1 | StartBatch | Not Applicable | Not Applicable |
2 | ACCTTRXNINT | Load Intermediate Account and Transaction Data | Load Intermediate Account and Transaction Data |
3 | WatchList | Load and Prepare Watchlists | Load and Prepare Watchlists |
4 | Customer | Load Customer Data | Load Customer Data |
5 | CustomerAddData | Load Customer Add On Data | Load Customer Add On Data |
6 | AnticipatoryProfile | Load Customer Anticipatory Profile Data | Load Customer Anticipatory Profile Data |
7 | Account | Load Account Data | Load Account Data |
8 | AccountGroup | Load Account Group Data | Load Account Group Data |
9 | AccountAddData | Load Additional Account Data | Load Additional Account Data |
10 | AcctAnticipatoryProfile | Load Account Anticipatory Profile Data | Load Account Anticipatory Profile Data |
11 | CustMapData | Load Customer Mapping Data | Load Customer Mapping Data |
12 | SupplyInfo | Derive Risk and Load Supplementary Information | Derive Risk and Load Supplementary Information |
13 | Transaction | Load Transaction and Transaction Party Data | Load Transaction and Transaction Party Data |
14 | Transaction | Derive External Entities and Risk | Derive External Entities and Risk |
15 | TrustedPair | Load Trusted Pair Data | Load Trusted Pair Data |
16 | LoanData | Load Loan Data | Load Loan Data |
17 | InsuranceData | Load Insurance Data | Load Insurance Data |
18 | CleanAMTempTables | CleanAMTempTables | Not Applicable |
19 | EndBatch | Not Applicable | Not Applicable |
Note:
The following pipelines are updated to support the enhanced 314(a) file format, enabling the loading of Electronic Address (Website address & IP Address) into the business tables:- Load Customer Add-On Data
- Load Transaction and Transaction Party Data