Set Up and Access AMI Data in Object Storage

You can extract AMI usage data from your connected Customer Cloud Service or Meter Solution Cloud Service and export it to your Oracle Cloud Infrastructure (OCI) object storage. From there, Oracle Energy and Water will copy it and transform it to iceberg table format, a high performance open-source format for large datasets. Oracle Energy and Water will then deliver the iceberg-formatted data as parquet files back to your object storage, where you can access it directly to support custom data science use cases. For example, data scientists at your organization can use the data to create feature sets and machine learning models, or run analyses in support of your business goals.

The iceberg table format is an open-source table format for large-scale analytics. It is designed for efficient data storage and querying by separating data into small metadata files and larger data files. For more information, see https://iceberg.apache.org/docs/latest/.

Run a Specialized Data Export Job

Run a specialized data export job to extract AMI data from your connected source application and copy it to your OCI object storage.

1. Configure your OCI object storage following the guidance at External File Storage. The steps apply to Customer Cloud Service and Meter Solution Cloud Service.
2. Follow the steps in the Customer Cloud Service user guide to configure the Specialized Data Export for measurement data:
   • Specialized Data Export
   • Measurement Data Export

   Note:

   Make sure you set up incremental data export.

Provide Oracle Energy and Water Access to Your Object Storage

After your AMI data has been copied to your object storage, Oracle Energy and Water will need access so the data can be copied and transformed to iceberg table format. If you have not already provided this access, see Provide Oracle Energy and Water with Access to Object Storage in the Administrator Guide for steps.

Access Your Transformed AMI Data

After Oracle Energy and Water has copied and transformed your AMI data to iceberg format, it will be delivered to your OCI object storage in the following directory: /AMI_PUBLISHER.

The columns in the files follow a standard structure. See Measurement Data Export, under the File Format section, for details about the columns and the data they contain.