DFCSIngestion Batch Details

The DFCSIngestion batch runs the data pipelines, filters the data and prepares the data for further processing.

Note:

This batch must be executed AFTER the StageDataLoad and StageDataQuality batches have successfully completed without errors. This batch must be run before the TMScenario batch.

This batch loads the data from the staging tables to the business tables in the specified order. The loading process receives, transforms, and loads Market, Business, and Reference data that is required for event detection.

The following table provides the tasks that are configured for the DFCSIngestion batch. These tasks must be executed in the following order:

Table 20-16 DFCSIngestion Batch Details

Sequence Tasks for DFCSIngestion Batch Jobs for DFCSIngestion Batch Pipelines for DFCSIngestion Batch
1 StartBatch Not Applicable Not Applicable
2 ACCTTRXNINT Load Intermediate Account and Transaction Data DFCS Load Intermediate Account and Transaction Data DFCS
3 WatchList Load and Prepare Watchlists Load and Prepare Watchlists
4 Customer Load Customer Data DFCS Load Customer Data DFCS
5 LoadCustomerAddition Load Customer Addition Load Customer Addition
6 CustomerAddData Load Customer Add On Data DFCS Load Customer Add On Data DFCS
7 AnticipatoryProfile Load Customer Anticipatory Profile Data DFCS Load Customer Anticipatory Profile Data DFCS
8 Account Load Account Data DFCS Load Account Data DFCS
9 AccountGroup Load Account Group Data Load Account Group Data
10 AccountAddData Load Additional Account Data DFCS Load Additional Account Data DFCS
11 AcctAnticipatoryProfile Load Account Anticipatory Profile Data DFCS Load Account Anticipatory Profile Data DFCS
12 CustMapData Load Customer Mapping Data DFCS Load Customer Mapping Data DFCS
13 SupplyInfo Derive Risk and Load Supplementary Information Derive Risk and Load Supplementary Information
14 Transaction Load Transaction and Transaction Party Data DFCS Load Transaction and Transaction Party Data DFCS
15 RiskDerivation Derive External Entities and Risk DFCS Derive External Entities and Risk DFCS
16 TrustedPair Load Trusted Pair Data Load Trusted Pair Data
17 LoanData Load Loan Data DFCS Load Loan Data DFCS
18 InsuranceData Load Insurance Data Load Insurance Data
19 ConductorData Load Conductor Data Load Conductor Data
20 LocationData Load Location Data Load Location Data
21 Deal Load Deal and Investment Advisor Data Load Deal and Investment Advisor Data
22 ManagedAccount Load Managed Account Data Load Managed Account Data
23 CorporateAction Load Corporate Action and Settlement Instruction Data Load Corporate Action and Settlement Instruction Data
24 LoadMarketCenterData Load Market Center Data Load Market Center Data
25 LoadSecurityData Load Security and Security Market Daily Data Load Security and Security Market Daily Data
26 TradeExecutionEventStage Load Trade Execution Event Data Load Trade Execution Event Data
27 OrderStage Load Order Stage Data Load Order Stage Data
28 InsideQuote Load Inside Quote Data Load Inside Quote Data
29 TradeExecutionEvent Load Execution and Trade Data Load Execution and Trade Data
30 CleanAMTempTables CleanAMTempTables Not Applicable
31 EndBatch Not Applicable Not Applicable

Note:

The following pipelines are updated to support the enhanced 314(a) file format, enabling the loading of Electronic Address (Website address & IP Address) into the business tables:
  • Load Customer Add-On Data DFCS
  • Load Transaction and Transaction Party Data DFCS