Measurement Data Migration

Migrating data from the Measurement table (D1_MSRMT) requires a special treatment because of the extremely large volume of data being migrated.

For cloud service implementations, the recommendation is to directly upload the legacy measurements into the production Measurement table using the Cloud Service Foundation tool. This is because the data conversion process will be much faster compares to staging the legacy data and running conversion jobs.

Implementations may opt to use the Oracle Utilities Application Framework conversion tool to stage measurement and then mass insert the staged data into production measurement table.

Caveats with this approach:

• It will be a slower process compared to directly loading the data.

• Insertion batch controls are not provided with MDM, however, implementation should be able to create custom batch controls based on templates provided with the OUAF.

On-premises implementations can also directly upload the legacy measurements to the production measurement table. The only difference is that the Cloud Service Foundation tool is not available, so the implementation will have to use SQL loader. Alternatively, they may opt for measurement staging approach using the OUAF conversion tool.

SQL Loader offers various performance improvement measures and supports default field values, date time caching, multiple record types (delimited, fixed length, binary)

The product supports the ability to create 100% custom control file for specific table.

Required Configuration for Measurement Upload

The following sections outline configuration tasks required for upload of measurement data.

Download Control File

The file for legacy measurement contains the legacy register or channel (measuring components) that need to be resolved before mass loading the data into the production database.

This process uses a specific control file to optimize the upload performance. This control file will be responsible for resolving or deriving the production measuring component key for the corresponding legacy key upon insertion to the production table.

This control file is called D1_MSRMT_CTL.ctl, and can be found in the Data Upload Sample Data Files zip file available in the Supporting Cloud Service Guides section on the Oracle Utilities Customer Cloud Service or Oracle Utilities Meter Solution Cloud Service documentation website.

Create Managed Content for the Control File

1. Select Admin, then System, then Managed Content, then Add.

2. Enter a code for the control file in the Managed Content field.

3. Select "XML" from the Managed Content Type drop-down list.

4. Enter a name for the control file in the Description field.

5. Click the Schema tab, and paste the D1_MSRMT_CTL.ctl control file text into the Editor area.

6. Click Save.

Create the Conversion Task Type for the Measurement Table (D1_MSRMT)

1. Select Admin, then Conversion Support, then Conversion Task Type, then Add.

2. Select "Conversion Instructions - General" from the Service Task Type drop-down list and click OK.

3. Enter a code and Description for the conversion task type.

4. Select "Conversion Artifacts - Table" from the Related Transaction BO drop-down list.

5. Select the managed content created from the previous step from the Override Control File drop-down list in the Conversion Artifacts Instructions section.

6. Click Save.

Refer to the Oracle Utilities Cloud Service Foundation Administrative User Guide for more information about Conversion Task Types.

Setup the Conversion Data Upload Master Configuration

1. Select Admin, then General, then Master Configuration.

2. Select and broadcast 'Conversion Data Upload Configuration' from the list

3. Click Edit.

4. Add an entry in the Override Instructions - Table section for the Measurement table (D1_MSRMT) and specify the Conversion Task Type created from the previous step.

5. Click Save.

Refer to the Oracle Utilities Cloud Service Foundation Administrative User Guide for more information about Conversion Data Upload Configuration master configuration.

Generate Conversion Artifacts for the Measurement Table (D1_MSRMT)

1. Select Admin, then Conversion Support, then Generate Conversion Artifacts.

2. Enter or search for D1_MSRMT in the Table field.

3. Click Generate.

4. A warning appears, click OK and then click Continue when prompted.

Refer to the Oracle Utilities Cloud Service Foundation Administrative User Guide for more information about using the Conversion Artifact Generator.

Run Conversion Batch Processing for the Measurement Table (D1_MSRMT)

1. Upload the file containing legacy data to an Object Storage location. This location should be defined as a value for the File Storage Configuration (F1-FileStorage) extendable lookup.

2. Run the Conversion - Load Data using SQL Loader batch process (K1-CNVLD) using the following parameters:

• Input File Storage: The Object Storage location (defined as a value for the File Storage Configuration (F1- FileStorage) extendable lookup) that contains the file to be uploaded.

• Table: D1_MSRMT

• Other parameters as appropriate.

Refer to the Oracle Utilities Cloud Service Foundation Administrative User Guide for more information about running conversion batch controls with files in Object Storage locations.