Batch Data Cleansing Algorithm

The algorithm is as follows:

  1. Load the vendor library.

  2. Call sdq_init_connector.

  3. Call sdq_set_global_parameter.

  4. Call sdq_init_session.

  5. Call sdq_set_parameter (RECORD_TYPE – Account/Business Address/Contact/List Mgmt Prospective Contact, BATCH_DATAFLOW_NAME).

  6. Call sdq_get_dedup_keys. This function calls a third party vendor to generate the dedup keys for driver record. The keys are then used to query for candidate records to send to third party vendor in the dedup call which follows.

  7. Call sdq_datacleanse. This function is called for each record in the result set of the query. It sends the driver record as XML and the output from the function has the cleansed driver record.

  8. After cleansing each record, save the record into the Siebel repository.

  9. Call sdq_close_session while logging out of current session.

  10. Call sdq_close_connector.