Importing Customer-Related Data from a Customer Information System

Customer-related data includes contacts, metered service points, and metered services, and is usually imported into Digital Asset Management / Digital Asset Cloud Service from a customer information system such as Oracle Utilities Customer to Meter or Oracle Utilities Customer Cloud Service. Data to be imported is sent to a tab-delimited flat file, which is uploaded into the system via batch processing which creates inbound data synchronization (sync) requests. These sync requests are processed and validated by a monitor batch process, and then a separate batch process creates master data records from each.

Import Process Overview

This section provide an overview of the import process and outlines the various system objects used for each type of data (contacts, metered service points, and metered services). The overall process is as follows:

  1. Data to be imported is exported from the CIS into a tab-delimited values file.

  2. An "Upload" batch process is used to create inbound sync requests  in the Pending state based on object-specific initial synchronization business objects. A separate inbound sync request is created for each row in the import file.

  3. The inbound sync requests are processed using the Sync Request Monitor (F1-SYNRQ) batch process. 

  4. An "Initial Sync Request - Load" batch process is used to create individual master data records from each inbound sync request.

Initial Load vs. Incremental Uploads

Customer data can be uploaded in one of two modes: Initial Load or Incremental. The upload mode is defined by the Initial Load Sync Flag value in the upload file. 

Initial Load uploads are used when setting up the system to import contact, metered service point, and metered service data from a customer information system such as Oracle Utilities Customer to Meter or Oracle Utilities Customer Cloud Service.

Incremental uploads are used to update customer data in Digital Asset Management / Digital Asset Cloud Service as customer data changes in the customer information system. Incremental uploads do NOT use "Import Sync Request - Load" batch processes. Records are added or updated automatically once validated.

Upload Batch Processes

Import files are uploaded using object-specific "Upload" batch processes. See Import Process Object Summary below for the specific "Upload" batch process used for each type of customer data. These should be run as needed for the initial import, as well as subsequent incremental updates. 

These processes use the following parameters:

  • File Name: The name of the file to upload. File names can use wildcards (Required) 

  • Flat Path: The file location where the upload file is located. This can be a file location on a local server or a location in Object Storage. See Referencing URIs in the Framework Administrative User Guide for more information. (Required) 

  • Processed File Extension: The text appended to the file name after the file has been processed.  Default is "PROCESSED".

  • Error On No Files Found: Indicates whether or not an error is issued if no files are found matching the given name in the given path.  Valid values are "true" (default) and "false".

  • External System: The external system that created the upload file (Required)

Use the Batch Control portal to learn more about these and other parameters used by these batch processes.

Inbound Sync Request Business Objects

Inbound sync requests are created by the "Upload" batch processes, and are based on "Initial Sync Request" business objects. See Import Process Object Summary below for the specific "Initial Sync Request" business objects used for each type of customer data.

The table below outlines the stages of the inbound sync request lifecycle.  Use the Business Object portal to learn more about these business objects and the details of each lifecycle state.

State

Notes

Pending

Inbound sync requests begin in this state.

The Sync Request Monitor (F1-SYNRQ) batch process is used to transition sync requests in this state to the Transform/Validate state.

Transform/Validate

In this state the data is validated and transformed as needed for import.

In this state values defined by lookups are derived from the data in the upload file via extendable lookups.

Sync requests move from this state to either the Validated or Add/Update states, depending on the type of upload. See Initial Load vs. Incremental Uploads  for more information.

Validation Error

Sync requests enter this state if an error occurs during validation in the Transform/Validate step.

If a sync request needs to be updated manually, it can be put into this state via the Correct action in the Record Actions section.

Validated

Initial Load sync requests enter this state following validation in the Transform/Validate step. 

If corrections need to be made, users can use the Correct action in the Record Actions section to transition the record to the Validation Error state.

Add/Update

Incremental sync requests enter this state following validation in the Transform/Validate step, and records are either added or updated as appropriate.

Loaded

Initial Load sync requests enter this state when a record has been successfully loaded,

Synchronized

Incremental sync requests enter this state when a record has been successfully added or updated.

Discarded 

The sync request enters this state if the sync request is discarded from either the Validated or Validation Error state,

Initial Sync Request Load Batch Processes

Master data records are created from inbound sync requests using "Initial Sync Request - Load" batch processes. See below for the specific "Initial Sync Request - Load" batch processes used for each type of customer data. These should be run as needed for the initial import, as well as subsequent incremental updates.

Use the Batch Control portal to view the parameters used by these batch processes.

Import Process Object Summary

The table below lists the batch controls and business objects used by each type of customer data.

Import Order

Object Type

Upload Batch Process

Inbound Sync Request Business Object

Initial Sync Request Load Batch Process

1

Contact

Contact File Upload (X1-COUPL)

Contact Initial Sync Request (X1-DASyncReqContact)

Initial Sync Request - Load Contacts (X1-SILCO)

2

Metered Service Point

Metered Service Point File Upload (X1-MSPUP)

Metered Service Point Sync Request BO (X1-SyncReqMeteredSP)

Initial Sync Request - Load Metered SP (X1-SLMSP)

3

Metered Service

Metered Service File Upload (X1-MSUPL)

Metered Service Inbound Sync Request (X1-DASyncReqMeteredService)

Initial Sync Request - Load Metered Service (X1-SILMS)

Note: Customer data must be imported in the order listed above.