DFCSIngestion Batch Details
The DFCSIngestion batch runs the data pipelines, filters the data and prepares the data for further processing.
Note:
This batch must be executed AFTER the StageDataLoad and StageDataQuality batches have successfully completed without errors. This batch must be run before the TMScenario batch.This batch loads the data from the staging tables to the business tables in the specified order. The loading process receives, transforms, and loads Market, Business, and Reference data that is required for event detection.
The following table provides the tasks that are configured for the
DFCSIngestion batch. These tasks must be executed in the following order:
Table 20-14 DFCSIngestion Batch Details
| Sequence | Tasks for DFCSIngestion Batch | Jobs for DFCSIngestion Batch | Pipelines for DFCSIngestion Batch |
|---|---|---|---|
| 1 | StartBatch | Not Applicable | Not Applicable |
| 2 | ACCTTRXNINT | Load Intermediate Account and Transaction Data DFCS | Load Intermediate Account and Transaction Data DFCS |
| 3 | WatchList | Load and Prepare Watchlists | Load and Prepare Watchlists |
| 4 | Customer | Load Customer Data DFCS | Load Customer Data DFCS |
| 5 | CustomerAddData | Load Customer Add On Data DFCS | Load Customer Add On Data DFCS |
| 6 | AnticipatoryProfile | Load Customer Anticipatory Profile Data DFCS | Load Customer Anticipatory Profile Data DFCS |
| 7 | Account | Load Account Data DFCS | Load Account Data DFCS |
| 8 | AccountGroup | Load Account Group Data | Load Account Group Data |
| 9 | AccountAddData | Load Additional Account Data DFCS | Load Additional Account Data DFCS |
| 10 | AcctAnticipatoryProfile | Load Account Anticipatory Profile Data DFCS | Load Account Anticipatory Profile Data DFCS |
| 11 | CustMapData | Load Customer Mapping Data DFCS | Load Customer Mapping Data DFCS |
| 12 | SupplyInfo | Derive Risk and Load Supplementary Information | Derive Risk and Load Supplementary Information |
| 13 | Transaction | Load Transaction and Transaction Party Data DFCS | Load Transaction and Transaction Party Data DFCS |
| 14 | RiskDerivation | Derive External Entities and Risk DFCS | Derive External Entities and Risk DFCS |
| 15 | TrustedPair | Load Trusted Pair Data | Load Trusted Pair Data |
| 16 | LoanData | Load Loan Data DFCS | Load Loan Data DFCS |
| 17 | InsuranceData | Load Insurance Data | Load Insurance Data |
| 18 | ConductorData | Load Conductor Data | Load Conductor Data |
| 19 | LocationData | Load Location Data | Load Location Data |
| 20 | Deal | Load Deal and Investment Advisor Data | Load Deal and Investment Advisor Data |
| 21 | ManagedAccount | Load Managed Account Data | Load Managed Account Data |
| 22 | CorporateAction | Load Corporate Action and Settlement Instruction Data | Load Corporate Action and Settlement Instruction Data |
| 23 | LoadMarketCenterData | Load Market Center Data | Load Market Center Data |
| 24 | LoadSecurityData | Load Security and Security Market Daily Data | Load Security and Security Market Daily Data |
| 25 | TradeExecutionEventStage | Load Trade Execution Event Data | Load Trade Execution Event Data |
| 26 | OrderStage | Load Order Stage Data | Load Order Stage Data |
| 27 | InsideQuote | Load Inside Quote Data | Load Inside Quote Data |
| 28 | TradeExecutionEvent | Load Execution and Trade Data | Load Execution and Trade Data |
| 29 | CleanAMTempTables | CleanAMTempTables | Not Applicable |
| 30 | EndBatch | Not Applicable | Not Applicable |
Note:
The following pipelines are updated to support the enhanced 314(a) file format, enabling the loading of Electronic Address (Website address & IP Address) into the business tables:- Load Customer Add-On Data DFCS
- Load Transaction and Transaction Party Data DFCS