Entity Resolution

9.2 Entity Resolution

Compliance Studio allows firms to get unified views of both customers and external entities by consolidating duplicate representations of any customer or external entity into one consolidated Global party ID.

OFS Compliance Studio Entity Resolution is a configurable process that allows data to be matched and merged to create contextual links in the global graph or resolve relational party records to a global party record as part of ingestion. OFS Compliance Studio has pre-built configurations supporting matching (or linking) in the FCGM and resolving entities in CSA for data being loaded into Financial Services Data Foundation (FSDF).

Comparison for Delta Processing

The first time Entity Resolution runs, it operates on the full data set. This means the initial run will take longer than subsequent runs after the initial processing where deltas are calculated (regardless of whether full or delta data is populated in the input tables) so that matching happens only on new and changed records for improved performance.

Candidate Selection

Scoring on all pairs of records is not performant, so the Entity Resolution process first finds candidates with similar attributes and only scores on those pairs of records. Candidate Selection can either be run using Oracle OpenSearch or in the database using Oracle Text.

Matching

Matching rules are used to compare entities to identify pairs that refer to the same entity. It creates a probable link between entities by comparing the attributes of the entities.

For example, de-duplicating customers, resolving derived entities, or linking customers or derived entities to external data such as Panama papers or sanctions lists with different rules and thresholds.

For more information on scoring methods, see the OFS Compliance Studio Matching Guide.

For more information on how to create the Matching Rules, see the Creating Match/Merge Ruleset section.

Grouping

It is used to Group (entity Ids or Customer Ids) entities based on similarity links between them using matching rules and applying the merge rules on similarities. Once it is grouped, the system assigns the global party id to each Group.

Note:

Grouping is an automatic process. Grouping will be based on the match edges without any configuration.

Merge Rules

Merging rules are used to group multiple entities or customers into a single global party based on the merge ruleset.

For more information on how to create the Merging Rules, see the Creating Match/Merge Ruleset section.

Persisting

Records identified for merging will be collapsed into a single global party record, and a mapping from this global party record to the original party records will be created. Ongoing changes to the original party records may impact the global parties. For more details, see Persisting the Data section in the OFS Compliance Studio Administration and Configuration Guide.

Data Survival

When party records are identified for merging, a single output party record is created for the main or parent Dataset. Entity Resolution provides a mechanism to select the best view of the data from across the multiple-party records using attribute-by-attribute selection functions like Most Common or Maximum. It also provides a mechanism for transforming the child records stored in related tables, such as an address, email, or document ids.

Merge and Split Global Parties

Entity Resolution provides a mechanism to manually merge,split, create, and rearrange the entities for Global parties. Whenever there is a manual action (merge, split, create, rearrange) to the entities of a global party, the same data survival logic will be applied. See Using Merge and Split Global Entities section on how to perform the actions.

Note:

When the records are not matched and not merged, they pass straight through and have a one-to-one mapping with the global party.
Where Entity has been resolved/unresolved, data origin is set to EntRes for all the records.
The Data Survival job cannot override the manual actions to a global party in batch mode.

For more information on configuring the rules for attribute survival, see the Data Survival Rules section.

For further details on the end-to-end Entity Resolution Process, see the Entity Resolution section in the OFS Compliance Studio Administration and Configuration Guide.