5.1 DQ Checks

Data Quality Framework consists of a scalable rule-based engine that uses a single-pass integration process to standardize, match, and duplicate information across global data. This framework within the Infrastructure system facilitates you to define rules and execute them to query, validate, and correct the transformed data existing in an Information Domain.

Data Catalog Contents include Data Quality Check Rules and DQ Groups (logical grouping of DQ rules). These Rules are defined at the Business Term and Entity Level, and seeded as a part of the Data Catalog Content.

For instructions on how to create/edit/delete DQ rule, please refer to FRC Data Platform user guide.

The following is a list of pre-configured Data Quality rules included in the offering:

In the banking domain, data quality is essential for ensuring the integrity, accuracy, and reliability of financial information that supports decision-making, compliance, and operational efficiency. To maintain high standards of data quality, various validation rules are applied to the data. These rules help identify and prevent errors, inconsistencies, and incomplete data entries that could lead to incorrect business processes or regulatory violations. Common data quality rules used in banking include custom checks, list of values, referential integrity checks, range checks, and more. Below is an overview of these rules, along with examples specific to the banking domain, which highlight their importance in managing data effectively across banking systems.

Data Quality Rules	Definition	Example	Objective
Custom Check	A custom check is a rule based on business-specific or unique conditions that don’t fall under standard data quality rule categories.	A customer's AccountBalance must not be negative if the account type is 'Savings'.	To apply business-specific logic that isn't captured by standard validation rules.
List of Values or Code Check	This rule ensures that a field contains a value from a predefined list of valid values, such as bank codes, account types, or country codes.	The AccountType must be one of the following: 'Checking', 'Savings', 'Credit".	To ensure only valid and standardized data entries are used in the system.
Referential Integrity Check	Ensures that relationships between different tables or data entities are correct, typically by checking foreign keys against primary keys.	The LoanID in the PaymentHistory table must exist in the LoanAccount table.	To prevent orphaned records and ensure that linked data entities are consistent across the system.
Column Reference or Specific Value Check	Ensures that the value in one column is consistent with values in another column or a related data set.	If the AccountStatus is 'Closed', then the AccountBalance must be zero.	To ensure that business logic between columns is followed correctly.
Generic Check	A general validation check applied across various data sets, such as length checks or format checks, that doesn’t belong to a specific category.	The IBAN number should be 22 characters long and contain only alphanumeric characters.	To apply basic checks that are common across different data sets.
NULL Value Check	Verifies that required fields are not missing, meaning they are not NULL.	The CustomerName field must not be NULL for all active customer records.	To ensure that essential customer or transaction information is always captured.
Range Check	Verifies that data values fall within a valid range, which is commonly used for numeric fields or dates in banking systems.	The CreditScore must be between 300 and 850.	To ensure that data, such as credit scores or loan amounts, falls within realistic and acceptable ranges.
BLANK Value Check	Ensures that fields do not contain blank or empty string values, which may represent missing or incomplete data.	The LoanAmount field must not be blank or contain only spaces in a loan application.	To prevent incomplete data from being entered into critical banking systems, ensuring full and valid records.

These banking-specific examples help ensure that critical financial data is correct, consistent, and adheres to industry standards for data integrity and compliance.

In DFCS the following number of rules are bundled /autogenerated in each category.

Table 5-1 Number of Tules that are bundled

Check Type	No of Rules
Custom Check	801
List of Values or Code Check	3266
Referential Integrity Check	7610
Column Reference or Specific Value Check	338
Generic Check	262
NULL Value Check	279
Range Check	11
BLANK Value Check	6

Following are the distribution of rules for each entity.

Table 5-2 Distribution of Rules for each Entity

Data Quality Entity	No of Rules
Account	11
Account Account Relationship	7
Account Address	7
Account Address Map	12
Account Alternate Currency Values	4
Account Anticipatory Profile	6
Account Balances	7
Account Cash Flows	16
Account Credit Quality Status Details	5
Account Credit Score Details	9
Account Customer Relationship Change	7
Account Deviation	5
Account Deviations Details	5
Account Effective Interest Rates	4
Account Email Map	7
Account Feature Map	13
Account Group Details	4
Account Group Master	5
Account Group Member	9
Account Hierarchy	1
Account Index Value History	6
Account Investment Objective	4
Account Lendable Percent	5
Account Management	5
Account Manager Relationship	11
Account Mitigant Map	17
Account Peer Group	4
Account Phone Map	6
Account Placed Collateral Map	7
Account Position	17
Account Position Pair	10
Account Purpose	5
Account Rate Tiers	13
Account Rating Details	16
Account Recovery Cashflows	8
Account Recovery Details	10
Account Restriction	5
Account Segment Month On Book	4
Account Status	5
Account Write Off Details	10
Accounting Entries	104
Accounting Entries Batch	5
Accounting Entries Error	5
Accounting Entries Header	18
Accounting Head	1
Accounting Head Details	6
Acquired Firm	5
Acquisition Channel	6
Additional Insurance For High Balance	5
Address	6
Address Purpose Type	5
Annuity Contracts	241
Annuity Transactions	69
Application Decision Event	5
Application Details	114
Application Document	8
Application Document Map	10
Application Event Decision	8
Application Group	5
Application Group Details	20
Application Group Event Decision	8
Application Party Role Map	10
Application Purpose Master	5
Application Reject Reasons	5
Application Status	5
Application Type	5
Applications	5
Applications Deviations	5
Applications Document Print Log	7
Assets Sold	45
Assumed Policy	5
Assumed Policy Hierarchy	1
Attrition	5
Authorization Decision Reasons	5
Automatic Teller Machine Transactions	29
Available Intraday Liquidity Source	5
Balance Type	5
Bank Cards	3
Bank Instrument Type Master	5
Bank Positions	9
Bankruptcy Type	5
Behaviour Pattern Non Replicating Portfolio	6
Benchmark Capital Conservation Ratio	4
Benchmark Counter Cyclical Buffer	5
Benchmark Details	5
Bill Contract Transactions	48
Bill Contracts	244
Bill Plan	5
Blocked Deposit Details	5
Borrowings	248
Borrowings Transactions	57
Branch	7
Branch Hierarchy	1
Branch Transactions	29
Broker Deposits	9
Business Class	5
Business Segment	5
Business Segment Hierarchy	1
Business Unit	5
Business Unit Hierarchy	1
Campaign	5
Campaign Channel	5
Campaign Status	5
Campaign Summary	10
Campaign Type	5
Campaign Wave	5
Capital Investments Positions	8
Capital Requirement Type	5
Card Account Mapping	6
Card Type	5
Cards	310
Cards Payments Transactions	71
Cards Settlement Transactions	48
Casa	352
Casa Transaction	70
Cash Flow Type	5
Cash Flow Type Hierarchy	1
Catastrophe Events	7
Cause Master	4
Cedent Asset Classification	5
Central Authority	5
Channel Hierarchy	1
Channel Session	5
Cheapest To Deliver Mappings	3
Claim	7
Claim Hierarchy	1
Cohort Composition	6
Collateral Debt Swap Spreads	4
Collateral Purpose	5
Collaterals Posted	86
Collection Officer	5
Collections	20
Collector Contacts	9
Commitment Contract Transactions	33
Commitment Contracts	171
Commodities Transactions	40
Commodity	5
Commodity Contracts	44
Commodity Future Curves	4
Commodity Grade	5
Commodity Group	5
Commodity Location Details	4
Common Chart Of Accounts	5
Compensation Details	8
Compensation Type	6
Consent Purpose	5
Consolidation Approach	5
Constituted Form	5
Contact Method	5
Contract Unwind Trigger	5
Controlling Customer	5
Corporate Actions	7
Correlated Currency Mapping	6
Correspondent Account Transactions	59
Correspondent Accounts	151
Correspondent- Markets Served	3
Correspondent- Products Served	4
Country	8
Countrywise Risk Summary	8
Credit Card Balance Category	5
Credit Card Balance Summary	14
Credit Center	5
Credit Default Swap Index Composition	8
Credit Default Swap Index Name	5
Credit Derivative Fee Cash Flows	7
Credit Derivatives	163
Credit Derivatives Transactions	52
Credit Facility	16
Credit Facility Details	67
Credit Facility Purpose	5
Credit Facility Type	5
Credit Guarantee Scheme	5
Credit Line Mitigant Map	6
Credit Line Status	5
Credit Loss Reason	5
Credit Officer	5
Credit Participation	7
Credit Participation Contract	12
Credit Participation Details	65
Credit Participation Tranche	10
Credit Participation Tranche Details	9
Credit Participation Tranche Member Map	9
Credit Quality Details	9
Credit Quality Type	5
Credit Rating	5
Credit Reason	5
Credit Score Model	5
Currency Exchange Rates	12
Currency Rate Version	6
Custodial Accounts	47
Custodian Account Transactions	28
Customer Alternate Currency Values	4
Customer Anticipatory Profile	6
Customer Attrition Plans	8
Customer Country Relation	5
Customer Education	5
Customer Employment Type Master	5
Customer Feature Map	9
Customer Product Score	6
Customer Service Enrollment	8
Data Source	6
Days Past Due Transition Matrix	5
Deal	5
Dealer	5
Dealer Group	5
Decision Status	5
Deductible	5
Depository Receipt Issue Mapping	3
Derivative Underlying	31
Deviation Reasons	5
Distance To Default	5
Dividend Payout Type	5
Dividend Protection Detail	4
Document Sub Type	5
Document Submission Status	5
Document Type	5
Documentary Collection Contract Acceptance	9
Documentary Collection Contract Acknowledgement	7
Documentary Collection Contract Event	22
Documentary Collection Discrepancy Detail	7
Documentary Collection Shipment Detail	7
Downgrade Trigger	4
Economic Indicators	7
Economic Zone	6
Email Address Purpose Type	5
Embedded Options Schedule	11
Employee	7
Employee Expenses Details	7
Employee Hierarchy	1
Employee Phone	5
Employee Service Account	5
Employee Trading Restriction	9
Encumbrance Sources	5
Entity Allocation Factor	4
Entity Influence	5
Entity Measure Summary	5
Entity Org Exchange Map	5
Entity Parent Details	6
Equity Arbitrage Strategy Mapping	3
Equity Indices	6
Equity Other Asset Losses	6
Expected Account Cashflows	8
Expense Type	5
Exposure Seniority	5
Exposure Underlying Type	5
External Operational Risk Loss	13
External Reporting Group	3
External Scaling Factor	4
External Underlying Account Rating Details Table	13
Facility Rating Details	12
Financial Spread Map	4
Financial Statement Forecast	9
Financial Variable	5
Financial Year Master	5
Fixed Assets	15
Fixed Assets Details	33
Fixed Assets Type	5
Forborne Status	5
Forecast Aggregate Cash Flows	11
Forecast And Plan Data	15
Forecast Balances	8
Forecast Download Net Exposure	8
Forecast Economic Indicator	3
Forecast Exchange Rate	4
Forecast Interest Rate Code	3
Forecast Liquidity Balances	10
Forecast Scenario	5
Forecasted General Ledger Data	20
Forecasted Party Share Holding Percentage	8
Forecasted Securitization Underlying Collections	7
Foreign Currency Utilization Details	5
Foreign Exchange Contracts	186
Foreign Exchange Rates	10
Forex Account Transactions	53
Forward Accumulated Fx Targets	4
Forward Exchange Rates	4
Forwards Contracts	182
Forwards Transactions	23
Fraud Reasons	5
Front Office Transaction Party	8
Fund	8
Fund Details	9
Fund Equity Investments	6
Fund Type	5
Fund Underlying Composition	9
Funds Composition	5
Futures Contracts	259
Futures Transactions	51
General Ledger Account	11
General Ledger Combination	5
General Ledger Data	33
General Ledger Hierarchy	1
Guarantor Type	5
Hedge	6
Hedge Portfolio Set	5
Hedge Portfolio Set Account Map	11
Hedge Status	5
Hedge Type	5
Hedged Instrument Map	7
Hedging Instrument Map	7
Hedging Strategy	5
High Run Off Category	4
Home Ownership	5
Household	5
Ijarah Accounts	39
Ijarah Transactions	30
Index	9
Index Composition	11
Industry	5
Inflation Index Name	5
Inflation Index Rate	6
Inflation Rates	9
Institution Primary Function	5
Instrument Contract	61
Instrument Contract Details Table	7
Instrument Group Member	4
Instrument Lendable Percent	5
Instrument Probability Of Default Details	8
Instrument Rating Details	13
Instrument Schedule	6
Instrument Trading Restriction	5
Instruments Contracts Hierarchy	1
Insurance Coverage	6
Insurance Coverage Hierarchy	1
Insurance Loss Modeling Component	5
Insurance Loss Simulation Risk Category	5
Insurance Underwriting Issue Sub Type	5
Insurance Underwriting Issue Type	5
Interbank Transactions	36
Interest Rate Curve	7
Interest Rate Curve Rates	8
Interest Rate Curve Volume Surface Rate History	7
Interest Rate Index	3
Interest Rate Parameters	5
Interest Rate Volatility Rate History	9
Internal Allocation Factor	5
Internal Loss Correlation Matrix	7
Internal Operational Risk Loss	23
Internal Scenario Correlation Matrix	7
Internal Scenario Severity Details	8
Intraday Payment Transaction	11
Investment Transactions	60
Investments	405
Issue Details	15
Issuer	7
Issuer Mitigant Map	11
Issuer Type	3
Istisna Accounts	39
Istisna Transactions	31
Lease Purpose	5
Leases Contracts	295
Leases Transactions	67
Ledger	6
Ledger Hierarchy	1
Legal Entity	20
Legal Entity Consolidation Map	5
Legal Entity Details	15
Legal Entity Gaap Map	6
Legal Entity Group	5
Legal Entity Hierarchy	1
Legal Entity Rating Details	6
Legal Proceeding Status	5
Letter Of Credit Contracts	171
Letter Of Credit Transactions	44
Life Events Staging	4
Line Of Business	6
Line Of Business Allocation Factor	5
Line Of Business Hierarchy	1
Litigation	5
Litigation Details	8
Loan Contracts	568
Loan Contracts Transactions	66
Loan Purpose	5
Loan Recourse Type	5
Loan Waiver Scheme	5
Loans Serviced	136
Loans Serviced Customer Relationship	5
Loans Serviced Mitigant Map	5
Location	8
Location Hierarchy	1
Loss Event	5
Loss Mitigation Program	5
Loss Share Agreement	5
Macro Economic Variable Details	14
Macro Economic Variables	5
Margins Kept With Central Counterparty	7
Marital Status	5
Market Cell	5
Market Centre Information	5
Market Instrument Contract	6
Market News Event	6
Market Risk Asset	5
Market Risk Portfolio Actual Profit And Loss Value	5
Market Variable Details	4
Market Variables	5
Marketing Program	5
Merchant	5
Merchant Cards	127
Merchant Cards Transactions	45
Merchant Category	5
Migration Reasons	5
Mitigant	9
Mitigant Charge Details	5
Mitigant Security Interest Type Table	5
Mitigant Sub Type	5
Mitigant Types	6
Mitigants	148
Mitigants Counter Guarantee Details Table	7
Mitigants Counter Guarantee Mapping Table	4
Mnemonic Transactions	5
Mortgage Servicing Rights	5
Mudarabah Transactions	31
Mudarbah Accounts	40
Murabahah Accounts	40
Murabahah Transactions	31
Musharakah Transactions	31
Musharkah Accounts	41
Mutual Fund Breakpoint	4
Net Exposures	12
Nettable Liabilities	10
Netting Agreement	11
Non Contractual Obligation	14
Non Performing Category	5
Obligor Details	5
Offer Master	6
Online Account	5
Online Account To Account Map	7
Operating Economic Zone	5
Operation Risk External Loss Threshold	3
Operation Risk Internal Loss Threshold	5
Operational Risk Loss Scenario Bucket Data	4
Operational Risk Reserve Schedules	10
Opportunity Activity Type	5
Opportunity Win Loss Reason Master	5
Option Contracts	280
Option Contracts Transactions	51
Options Conversion Detail	8
Org Unit	5
Organization Unit Hierarchy	1
Other Assets	26
Other Liabilities	18
Other Services	60
Other Services Transactions	41
Over Draft Accounts	380
Over Draft Accounts Transactions	64
Ownership Category	5
Participation Type	5
Partner	5
Partner Expense	5
Party	33
Party Account Role Map	17
Party Address Map	12
Party Asset Details	5
Party Central Authority Mapping	8
Party Consent	6
Party Details	12
Party Email Map	4
Party Expense Details	7
Party Financial Institution Identification Details	4
Party Financials	16
Party Hierarchy	1
Party Identification Document	16
Party Income Details	6
Party Operating Economic Zone	5
Party Other Names	8
Party Party Account Relationship	12
Party Phone Map	6
Party Probability Of Default Details	6
Party Product Type Summary	7
Party Rating Details	14
Party Relationship Type	5
Party Role	5
Party Role Map	9
Party Shareholding Percent	8
Party To Party Relationship	13
Party Type	5
Payment Mechanism Master	1
Payment Schedule	6
Payment Settlement Accounts	13
Payment Settlement System	5
Payment Type	5
Peer Group Master	1
Peer Information	4
Peer Product Details	6
Phone Purpose Type	5
Placed Collateral	5
Placed Collateral Source Details	8
Point Of Sale Transactions	29
Policy	9
Policy Hierarchy	1
Policy Vehicle Rating Details	6
Pool Class	5
Pool Identification	5
Portfolio	6
Portfolio Data	4
Portfolio Hierarchy	1
Portfolio Type	5
Position Type	5
Premium Offset Method	5
Premium Offset Method Hierarchy	1
Premium Payment Type	5
Premium Suspense Reason	5
Premium Suspense Reason Hierarchy	1
Prepaid Cards	45
Prepaid Cards Transactions	28
Prepayment Parameters	9
Prepayment Rates	3
Prepayment Reason	5
Probability Of Default Model	5
Probability Of Default Term Structure	8
Probability Of Default Term Structure Details	5
Process Line Of Business Location Map	6
Process Master	2
Producer	6
Producer Hierarchy	1
Product	6
Product Bundle Master	1
Product Category	5
Product Feature	5
Product Hierarchy	1
Product Rate Matrix Table	5
Product Riders	6
Product Type	5
Profession	5
Profession Sub Type	5
Program	5
Project	5
Project Hierarchy	1
Property Type	5
Prospect	10
Prospect Targeting Method	5
Provision Matrix	4
Purchase Category	5
Quote Declination Type	5
Quote Source	5
Quote Source Method	5
Quote Status	5
Quote Submission Method	5
Quote Type	5
Rate Plan	5
Rating Risk Parameter Data	4
Rating Transition Matrix	5
Recoveries	17
Recovery Agent	5
Recovery Type	5
Reg Entity Class Details	8
Region	5
Rejection Reason	5
Repo Contracts	260
Repo Transactions	43
Report Type	5
Reported Market Sale	4
Reporting Line Mapper	4
Repurchase Reasons	5
Request Type	5
Reserve Type	5
Response Type	5
Restriction List	4
Restriction Type Master	1
Retention Offer Type	5
Risk Adjusted Pricing Details	6
Risk Position Mapping	7
Run-Off Measure	5
Salam Accounts	39
Salam Transactions	31
Sales Representative	5
Sales Representative Compensation	6
Sales Stages	5
Scenario Covariance Data	3
Securitization Activity	7
Securitization Facility Type	5
Securitization Inception Data	7
Securitization Pool	4
Securitization Pool Type	5
Securitization Program	7
Securitization Status	5
Securitization Type	5
Security Tranche Credit Enhancement Map	8
Service Charge	5
Service Plans	11
Service Representative	5
Service Requests	11
Service Slippage Reason	5
Service Team	5
Service Team Member	5
Serviced Account Credit Score Details	9
Share Holding Details	11
Shareholder	5
Shareholding Percent	6
Simulation Bucket Type	5
Sma Score Rule Staging For Influencer Score	3
Social Media	5
Social Media Post	4
Sovereign Rating Details	11
Special Term	5
Special Terms Covenants	7
Staging For Lifetime Value Of Product By Customer Segment	4
Staging For Summary Of Social Media Analytics	7
Staging Of Sma Event Types	1
Staging Table For Customer Offers Types	1
Staging Table For Source Platforms For Social Media Analytics	1
Staging Table Of Score Types	1
Standard Accounting Head Details	10
Standard Allocation Factor	5
Standard Product Mapper	4
Standard Scenario Severity Details	8
Stock Or Index	6
Stock Ticker	5
Sukuk Accounts	47
Sukuk Transactions	31
Survey	5
Survey Response	8
Swap Account Transactions	57
Swaps Contracts	243
System Logon	3
Telebanking Transactions	28
Term Deposit Contracts	261
Term Deposits Transactions	60
Term Structure	8
Term Structure Details	5
Terminal	6
Terminal Type	5
Time To Peak Exposure	11
Trade Finance Contract Amendment Status Stage	7
Trade Finance Contract Event Acknowledgement Stage	8
Trade Finance Document	9
Trade Finance Goods	1
Trade Finance Goods Alternate Currency Values	6
Trade Finance Goods Category Table	3
Trade Finance Goods Or Services	7
Trade Finance Goods Subtype	1
Trade Finance Goods Type	1
Trade Finance To Account	5
Trading Account	71
Trading Account Transactions	53
Trading Desk	5
Transaction	6
Transaction Alternate Currency Values	4
Transaction Channel	5
Transaction Failure Reason	5
Transaction Header	13
Transaction Purpose	5
Transition Matrix	5
Transition Matrix Master	3
Treatment	5
Trusts	100
Trusts Transactions	54
Underlying Details	6
Underlying Type	5
Underwriter	5
Underwriting Details	12
Underwriting Positions	5
Undrawn Limit	35
Unit Of Measure Allocation Factor	4
Unit Of Measure Covariance Data	3
Unit Of Measure Distribution Parameters	5
Unit Of Measure Modeling Parameters	5
Valuation Method	5
Vehicle	6
Vehicle Body Type	5
Vehicle Lease Type	5
Vehicle Purpose	5
Vehicle Rating	5
Vehicle Type	5
Vehicle Tyre Type	5
Vendor	5
Vintage	5
Watch List	5
Watchlist Member Entry	7
Web Log Analytics Event	6
Weblog Analytics Page	5
Weight Change Response Type	5
Write-Off Reasons	5