Batch Data Cleansing and Data Matching

Batch processing provides a means to cleanse and match a large number of records at one time. You can run batch jobs as stand-alone tasks or schedule batch tasks to run on a recurring basis.

After the Data Quality Manager server component (DQMgr) is enabled and you have restarted the Siebel Server, you can start your data quality tasks.

You can start and monitor tasks for the Data Quality Manager server component in one of the following ways:

• Using the Siebel Server Manager command-line interface, the srvrmgr program.

• Running Data Quality Manager component jobs from the Administration - Server Management screen, Jobs view in the application.

You can specify a data quality rule in the batch job parameters. This is a convenient way of consolidating and reusing batch job parameters and also of overriding vendor parameters. For more information, see Data Quality Rules.

For more information about using the Siebel Server Manager and administering component jobs, see Siebel System Administration Guide. In particular, read the chapters about the Siebel Enterprise Server architecture, using the Siebel Server Manager GUI, and using the Siebel Server Manager command-line interface.

You must run batch mode key generation on all existing records before you run real-time data matching. The Universal Connector requires generated keys in the key tables first before you can run real-time data matching. The key generation is done within the deduplication task (which is the reason for running deduplication on all existing records first).

Caution: If you write custom Siebel CRM scripting on business components used for data matching (such as Account, Contact, List Mgmt Prospective Contact, and so on), the modifications to the fields by the script execute in the background and might not trigger logic that activates user interface features. For example, the scripting might not trigger UI features such as windows that show potential matching records.