test

Loading the Initial Data Set for a Sun Master Index

Data Preparation, Matching, and Loading Procedure Overview

The IBML Tool was designed to build on the features provided by the Data Cleanser and Data Profiler tools that are also generated from a master index application. These tools help you analyze the quality of your data and fix any data integrity issues prior to matching the data using the Bulk Matcher. The Data Cleanser generates a file from your legacy data that can be read by the Bulk Matcher. Together, the Data Profiler, Data Cleanser, and IBML Tools provide a complete solution for analyzing, cleansing, matching, and finally loading your legacy data into a master index database, no matter the quality of the original data set.

    The following steps outline the procedure to follow to prepare, match, and load legacy data.

  1. Make sure the master index application is configured and generated and the database is created.

  2. Extract the data to either a Data Integrator staging database or a flat file.

  3. Begin queuing any transactions that occur from the time you extract the data until the database is loaded and ready to go live.

  4. Run the Data Profiler and Data Cleanser against the extracted data. This applies cleansing rules to the data and produces a file that can be read by the Bulk Matcher. This step is optional. See Analyzing and Cleansing Data for Sun Master Index.

  5. Extract a representative sampling of the data.

  6. Configure the Initial Bulk Match and Load Tool properties.

  7. Using the Bulk Matcher, perform a match analysis against the sampling, analyze the reports, and modify the match configuration if necessary. This is an iterative process for fine-tuning the matching logic to suit your data.

  8. Perform match processing against the complete data set. The result of this step is a set of files containing cleansed and linked data that can be loaded directly into the database.

  9. Load the data into the database using the SQL*Loader Bulk Loader or the Data Integrator Bulk Loader.

  10. Open the queue to allow transactions into the master index application.