D.3 Behavior Detection Flat File Interface
This topic describes the Ingestion Flat File details for products within the BD Application Pack.
Files have been grouped in such a way that files in the same group can be executed in parallel to load data. However, you must execute Group 1 through Group 5 in sequence. For more information, The Staging Representation column indicates whether this file requires a Staging source.
Group 1 Interface Ingestion Flat Files
The following table describes the Group 1 Ingestion Flat File details.
Table D-4 Group 1 Interface Ingestion Flat Files
| Interface File Name | AML | Fraud | KYC | FATCA | CTR | Current Ingestion | Staging Representation |
|---|---|---|---|---|---|---|---|
| Account Phone | Yes | Yes | Yes | Yes | NA | BD Datamaps | Yes |
| Account Email Address | Yes | Yes | Yes | Yes | NA | BD Datamaps | Yes |
| Insurance Policy | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Insurance Policy Balance | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Account Customer Role | Yes | Yes | NA | Yes | Yes | BD Datamaps | Yes |
| Insurance Policy Feature | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Insurance Policy to Customer | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Loan | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Loan Daily Activity | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Online Account | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Insurance Seller | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Insurance Seller to License | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Country | Yes | Yes | NA | Yes | NA | BD Datamaps | Yes |
| Watch List | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Insurance Product | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Insurance Transaction | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Front Office Transaction | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Market Index Daily | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Issuer | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Organization | NA | NA | NA | NA | Yes | BD Datamaps | Yes |
| Market Index | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Service Team Member | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Service Team | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| CTR Transaction | Yes | Yes | NA | NA | Yes | runDP/ runDL | No |
| Account Realized Profit and Loss | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Letter of Intent | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Collateral Value- Currency | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Collateral Value- Product | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Commission Product | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Compliant Registration | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Complaint Type Rating | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Employee to Insurance Policy | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Investment Guideline | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Investment Guideline to Account | NA | NA | NA | NA | NA | runDP/ runDL | No |
| System Logon Type | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Registered Representative Complaint | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Energy And Commodity Instrument | NA | NA | NA | NA | NA | runDP/ runDL | No |
Group 2 Interface Ingestion Flat Files
The following table describes the Group 2 Ingestion Flat File details.
Table D-5 Group 2 Interface Ingestion Flat Files
| Interface File Name | AML | Fraud | KYC | FATCA | CTR | Current Ingestion | Staging Representation |
|---|---|---|---|---|---|---|---|
| Account to Peer Group | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Account Group | Yes | Yes | NA | NA | NA | BD | Yes |
| Peer Group | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Security Firm Daily | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Security | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Market Index Member Security | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Security Market State Change | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Matched Entity | Yes | Yes | NA | NA | NA | runDP/ runDL | No |
| Trusted Pair | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Firm Account Position Pair | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Natural Gas Flow | NA | NA | NA | NA | NA | runDP/ runDL | No |
Group 3 Interface Ingestion Flat Files
The following table describes the Group 3 Ingestion Flat File details.
Table D-6 Group 3 Interface Ingestion Flat Files
| Interface File Name | AML | Fraud | KYC | FATCA | CTR | Current Ingestion | Staging Representation |
|---|---|---|---|---|---|---|---|
| Account | Yes | Yes | Yes | Yes | Yes | BD Datamaps | Yes |
| Customer | Yes | Yes | Yes | Yes | Yes | BD Datamaps | Yes |
| Watch List Entry | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Loan Product | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Employee | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Front Office Transaction Party | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Organization Relationship | NA | NA | NA | NA | Yes | BD Datamaps | Yes |
| Restriction List | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Account Supplemental Attribute | NA | NA | Yes | NA | NA | runDP/ runDL | No |
| Customer Supplemental Attribute | NA | NA | Yes | NA | NA | runDP/ runDL | No |
| Market Trading Session | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account GroupAddress | Yes | Yes | NA | NA | NA | runDP/ runDL | No |
| Account Group Investment Objective | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Group IOS Member | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Group Member Experience | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Loan Origination Action | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Mail Handling Instruction Activity | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Banker To Officer | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Reference Table Detail | NA | NA | NA | NA | NA | runDP/ runDL | No |
| General Usage List | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Loan Origination Product | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Organization To Mortgage Type | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Securities License | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Service Vendor | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Energy and Commodity Trade | NA | NA | NA | NA | NA | runDP/ runDL | No |
Group 4 Interface Ingestion Flat Files
The following table describes the Group 4 Ingestion Flat File details.
Table D-7 Group 4 Interface Ingestion Flat Files
| Interface File Name | AML | Fraud | KYC | FATCA | CTR | Current Ingestion | Staging Representation |
|---|---|---|---|---|---|---|---|
| Market News Event | NA | NA | NA | NA | NA | BD Datamaps | No |
| Managed Account | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Account To Customer | Yes | Yes | Yes | Yes | Yes | BD Datamaps | Yes |
| Branch CTR Transaction | NA | NA | NA | NA | Yes | BD Datamaps | Yes |
| Branch CTR Conductor | NA | NA | NA | NA | Yes | BD Datamaps | Yes |
| Branch CTR Summary | NA | NA | NA | NA | Yes | BD Datamaps | Yes |
| Account Group Member | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Account To Correspondent | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Account Balance | Yes | Yes | Yes | Yes | NA | BD Datamaps | Yes |
| Account Address | Yes | Yes | Yes | Yes | NA | BD Datamaps | Yes |
| Customer Identification Document | Yes | Yes | Yes | Yes | NA | BD Datamaps | Yes |
| Customer To Markets Served | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Customer To Products Offered | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Customer To Customer Relationship | Yes | Yes | Yes | Yes | NA | BD Datamaps | Yes |
| Anticipatory Profile | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Customer Phone | Yes | Yes | Yes | Yes | Yes | BD Datamaps | Yes |
| Customer Email Address | Yes | Yes | Yes | Yes | Yes | BD Datamaps | Yes |
| Customer Country | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Customer Address | Yes | Yes | Yes | Yes | Yes | BD Datamaps | Yes |
| Online Account to Account | Yes | Yes | Yes | NA | NA | BD Datamaps | Yes |
| Controlling Customer | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Employee To Account | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Account Position | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Security Trading Restriction | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Employee Trading Restriction | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Employee Phone | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Employee Email Address | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Employee Address | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Outside Business Activity | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Private Security Transaction | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Security Group Member | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Security Investment Rating | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Structured Deal | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Account Profit and Loss | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Account Position Pair | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Account Investment Objective | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Mutual Fund Breakpoint | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Account Feature | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Access Events | NA | Yes | NA | NA | NA | runDP/ runDL | No |
| Customer Balance | NA | Yes | NA | NA | NA | runDP/ runDL | No |
| Front Office Transaction Remittance Document | Yes | Yes | NA | NA | NA | runDP/ runDL | No |
| Related Front Office Transaction Information | Yes | Yes | NA | NA | NA | runDP/ runDL | No |
| Account To Organization | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Firm Account Position | NA | NA | NA | NA | NA | runDP/ runDL | No |
| External Investment Account Position | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Employee To Organization | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Security Select List Entry | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Fees | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Profile Stage | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Qualification Agreement | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Representative Position | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Asset Allocation | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Scheduled Event | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Identifier Change History | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Position Profile And Loss | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Uncovered Option Account Position | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Account Collateral | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Mail Handling Instruction | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Mutual Fund Family Letter of Intent | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Employee Disciplinary Action | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Employee Exam History | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Employee Firm Transfer History | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Employee Securities License State Registration | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Employee Supervision List | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Employee To Manager History | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Employee To Securities License | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Employment History | NA | NA | NA | NA | NA | runDP/ runDL | No |
| System Logon | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Plan of Solicitation | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Mutual Fund Family Configuration | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Energy And Commodity Market Daily | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Energy And Commodity Firm Daily | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Energy And Commodity Reported Market Sale | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Energy And Commodity Market Trading Session | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Energy And Commodity Market Center | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Energy And Commodity Location | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Energy Flow Mode | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Energy and Commodity Instrument Position | NA | NA | NA | NA | NA | runDP/ runDL | No |
Group 5 Interface Ingestion Flat Files
The following table describes the Group 5 Ingestion Flat File details.
Table D-8 Group 5 Interface Ingestion Flat Files
| Interface File Name | AML | Fraud | KYC | FATCA | CTR | Current Ingestion | Staging Representation |
|---|---|---|---|---|---|---|---|
| Borrower | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Back Office Transaction | Yes | Yes | NA | NA | NA | BD Datamaps | Yes |
| Account Restriction | NA | NA | Yes | NA | NA | BD Datamaps | Yes |
| Investment Advisor | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Investment Guideline Override | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Settlement Instruction | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Loan Origination Document Print Log | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Change Log | Yes | Yes | Yes | Yes | NA | runDP/ runDL | No |
| Options Violation | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Loan Origination Condition | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Loan Origination Fee Detail | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Loan Origination Note | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Loan Origination To Service | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Investment Guideline Override | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Loan Origination Condition Type | NA | NA | NA | NA | NA | runDP/ runDL | No |
| System Logon To System Logon Type | NA | NA | NA | NA | NA | runDP/ runDL | No |
| System Logon To Organization | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Registered Representative Account Commission | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Registered Representative Account Commission Prior Year | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Registered Representative Commission Monthly Profile | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Registered Representative Commission Product | NA | NA | NA | NA | NA | runDP/ runDL | No |
| Currency Transaction | NA | NA | NA | NA | Yes | BD Datamaps | Yes |
Group 6 Interface Ingestion Flat Files
The following table describes the Group 6 Ingestion Flat File details.
Table D-9 Group 6 Interface Ingestion Flat Files
| Interface File Name | AML | Fraud | KYC | FATCA | CTR | Current Ingestion | Staging Representation |
|---|---|---|---|---|---|---|---|
| Inside Quote | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| Market Center Quote | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| ReportedMarketSale | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| InsideQuote_Derived | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| MarketCenterQuote_De rived | NA | NA | NA | NA | NA | BD Datamaps | Yes |
| ReportedMarketSale_D erived | NA | NA | NA | NA | NA | BD Datamaps | Yes |
Note:
The AccountAverageNetWorth file is an exceptional case, and is only intended to be run once before any other files have been loaded. The average net worth amount in the account profile table is built up over time as transactions are ingested. This file allows this value to be set as a starting point before any transactions have been ingested. After transactions are ingested, this file should no longer be used.Note:
The following derived datamaps must be run after running the corresponding BD scripts.- CurrencyTransaction_ExemptFlagUpd
- SecurityInvestmentRating_PrevInvestmentUpd