Characteristic Data Extracts

Characteristic data extracts are performed through the use of audit algorithms, data synchronization business objects, and related batch processes.

Batch processes are used to create initial load extracts for Account, Person, Premise, Service Agreement, and Service Point characteristic data. The initial load includes the historical data in the system (either all or a subset, depending on how the batch process is configured). Following the initial load, data synchronization requests are created when characteristic data is added or changed.

Maintenance Object Audit Algorithms

Detecting changes in characteristic data can be identified by the Characteristic Change Data Capture (C1MOCHARCDC) audit algorithm on the following maintenance objects:

  • Account
  • Person
  • Premise
  • Service Agreement
  • Service Point - CCB
  • Service Point- MDM

Detecting changes in characteristic type data can be identified by the Characteristic Type Change Data Capture (C1CHARTYPCDC) audit algorithm on the Characteristic Type (CHAR TYPE) maintenance object.

Business Objects and Algorithms

The maintenance object audit algorithms create data synchronization requests based on the Sync Request BO defined in the audit algorithm parameters:

Audit Algorithm Data Synchronization Request Business Object
Characteristic Change Data Capture (C1MOCHARCDC) Characteristic Data Sync for DataConnect (C1-ExternalRepoPlusCharDatSync)
Characteristic Type Change Data Capture (C1CHARTYPCDC) Characteristic Type Sync for DataConnect (C1-ExternalRepoPlusCharTypSync)

Extraction of characteristic data, including account, person, premise, service agreement, and service point information, is supported by the following data synchronization business objects.

  • Characteristic Data Sync for DataConnect (C1-ExternalRepoPlusCharDatSync): used to extract characteristics data for accounts, persons, premises, service agreements, and service points. The specific maintenance objects for which characteristics data is extracted is defined in the Characteristic Entities Included in DataConnect Extract (C1-DataConnectIncludedCharEnty) extendable lookup. This lookup maps characteristic entities and maintenance objects to mappings business objects that define the characteristic data to be extracted.
  • Characteristic Type Sync for DataConnect (C1-ExternalRepoPlusCharTypSync): used to extract data for characteristic types.

The Characteristic Data Sync for DataConnect (C1-ExternalRepoPlusCharDatSync) business object uses the following Enter algorithm on the Pending state to take initial data snapshots:

  • Capture Characteristic Data's Initial Snapshot (C1CAPMOCHARI)

The Characteristic Type Sync for DataConnect (C1-ExternalRepoPlusCharTypSync) business object uses the following Pre-Processing algorithms to take initial data snapshots, and define the batch control used to extract data and export to a flat file:

  • Capture Characteristic Type Data's Initial Snapshot (C1CAPCHTYI)

The Sync Request Monitor batch control (F1-SYNRQ) monitors synchronization requests in the Pending state and executes Monitor algorithms that check for other pending related synchronization requests, and, if none, transitions them to the Determine if Sync Needed state.

Enter algorithms on the Determine If Sync Needed states verify if a synchronization is needed by capturing the final snapshot of the data and comparing it against the initial snapshot. If changes are detected, the final snapshots of the data are stamped on the synchronization requests for export.

  • Capture Characteristic Data's Final Snapshot (C1CAPMOCHARF)

  • Capture Characteristic Type Data's Final Snapshot (C1CAPCHTYF)

The Prepare Tab-delimited Extract Data (C1-PRTBDEXDT) algorithm on the Send Request state prepares and formats the data for extraction, and creates a general process record for the synchronization request (based on the batch control defined by the pre-processing algorithm).

Batch Controls

The characteristic data extraction process uses a set of batch processes to create data synchronization requests and extract files.

The following batch processes are used to create initial synchronization requests:

  • Account Characteristic Data Initial Load for DataConnect (C1-CHACI): This batch process creates initial sync request records for Account Characteristics.
  • Person Characteristic Data Initial Load for DataConnect (C1-CHPEI): This batch process creates initial sync request records for Person Characteristics.
  • Premise Characteristic Data Initial Load for DataConnect (C1-CHPRI): This batch process creates initial sync request records for Premise Characteristics.
  • SA Characteristic Data Initial Load for DataConnect (C1-CHSAI): This batch process creates initial sync request records for Service Agreement Characteristics.
  • SP - CCB Characteristic Data Initial Load for DataConnect (C1-CHSPI): This batch process creates initial sync request records for SP - CCB Characteristics.
  • SP - MDM Characteristic Data Initial Load for DataConnect (X1-CHSPI): This batch process creates initial sync request records for SP - MDM Characteristics.
  • Characteristic Type Data Initial Load for DataConnect (C1-CHTIL): This batch process creates initial Characteristic Type Data sync request records for the specified CHAR TYPE maintenance object

The following batch processes are used to create extract files from synchronization requests:

  • Account Characteristic Data Extract for DataConnect (C1-ACCHX): This batch process creates Account flat file(s).
  • Person Characteristic Data Extract for DataConnect (C1-PECHX): This batch process creates Person flat file(s).
  • Premise Characteristic Data Extract for DataConnect (C1-PRCHX): This batch process creates Premise flat file(s).
  • SA Characteristic Data Extract for DataConnect (C1-SACHX): This batch process creates service agreement flat file(s).
  • SP - CCB Characteristic Data Extract for DataConnect (C1-SPCHX): This batch process creates CCB service point flat file(s).
  • SP - MDM Characteristic Data Extract for DataConnect (X1-SPCHX): This batch process creates MDM service point flat file(s).
  • Characteristic Type Data Extract for DataConnect (C1-CHTYX): This batch process creates characteristic type flat file(s). This batch control is defined as values for the Batch Process for Extract algorithm parameter on the Pre-Processing algorithm on the Characteristic Type Sync for DataConnect (C1-ExternalRepoPlusCharTypSync) business objects (see above).

Use the Batch Control portal for more information about these batch controls. The extract batch controls contain parameters that can be used to specify details (including path and file name for this file.) for a delimited flat file containing extracted data.

Setting Up and Executing Characteristic Data Extracts

Setting up master data extracts involves the following steps:

  1. Add audit algorithms on the Account, Characteristic Type, Person, Premise, Service Agreement, Service Point - CCB, and Service Point - MDM maintenance objects.
    1. Add the Characteristic Change Data Capture (C1MOCHARCDC) algorithm as an audit algorithm on the Account, Characteristic Type, Person, Premise, Service Agreement, Service Point - CCB, and Service Point - MDM maintenance objects.
    2. Add the Characteristic Type Change Data Capture (C1CHARTYPCDC) algorithm as an audit algorithm on the Characteristic Type maintenance object.
  2. Add Sync Request BO options on the Account, Person, Characteristic Type, Premise, Service Agreement, Service Point - CCB, and Service Point - MDM maintenance objects
    1. Add the Characteristic Data Sync for DataConnect (C1-ExternalRepoPlusCharDatSync) business object as Sync Request BO options on the Account, Person, Premise, Service Agreement, Service Point - CCB, and Service Point - MDM maintenance objects.
    2. Add the Characteristic Type Sync for DataConnect (C1-ExternalRepoPlusCharTypSync) business object as a Sync Request BO option on the Characteristic Type maintenance object.
  3. Execute initial load batch processes related to accounts, persons, premises, service agreements, and service points.
  4. Once the initial load synchronization has been executed, changes to accounts, characteristic types, persons, premises, service agreements, and service points will trigger the creation of new synchronization requests and resulting extraction files.
  5. Execute the sync request monitor process.
  6. Execute the extract batch processes related to accounts, characteristic types, persons, premises, service agreements, and service points.