Set Up and Access AMI Data in Object Storage
Oracle Utilities Data Intelligence comes with an AMI Publisher feature that allows you to extract AMI usage data from your connected Customer Cloud Service or Meter Solution Cloud Service and publish it to your Oracle Cloud Infrastructure (OCI) object storage. From there, Oracle Utilities Data Intelligence will copy it and transform it to iceberg table format, a high performance open-source format for large datasets. Oracle Utilities Data Intelligence will then deliver the iceberg-formatted data as parquet files back to your object storage, where you can access it directly to support custom data science use cases. For example, data scientists at your organization can use the data to create feature sets and machine learning models, or run analyses in support of your business goals.
You must configure and run a Run a Specialized Data Export Job job to publish new AMI data to your object storage. When the job is run, Oracle Utilities Data Intelligence will provide an initial load of 13 months of historical data. The job will start by loading the most recent day, and work its way back to the oldest day by day. During this period, the data will be available to query once the first day has arrived, and subsequent days will be available for querying as they flow in. If new data becomes available from the source system while initial load is still running, the new data will be prioritized and loaded once available. The initial load will then continue backfilling until finished.
About V Model Data
In addition to AMI data, the AMI Publisher also delivers V model data from your connected source application. V model data refers to data objects that form the core of the system: Person, Account, Premise, Service Agreement, and Service Point. These objects hold demographic, geographic, and financial information about your customers and properties. When V model data is combined with AMI usage data, you can gain deeper insights into your customers and your business operations. See Understanding the V for more information about this data.
Run a Specialized Data Export Job
Provide Oracle Utilities Access to Your Object Storage
After your AMI data has been copied to your object storage, Oracle Utilities will need access so the data can be copied and transformed to iceberg table format. If you have not already provided this access, see Provide Oracle Energy and Water with Access to Object Storage in the Administrator Guide for steps.
Access Your Transformed AMI Data
After Oracle Utilities has copied and transformed your AMI data to iceberg format, it will be delivered to your OCI object storage in the following directory: /AMI_PUBLISHER. If applicable, there will be partitions organized under each table prefix.
The list below is an example of the directories which may appear under /AMI_PUBLISHER. This list is not exhaustive.
- /AMI_PUBLISHER
- /CISADM
- /data
- /CI_TIME_ZONE
- /D1_ACTIVITY
- /D1_ACTIVITY_TYPE
- ...
- /D1_MSRMT
- /YEAR=2025
- /MONTH=1
- /DAY=1
- /MONTH=1
- /YEAR=2025
- /D1_MEASR_COMP/
- ...
- /data
- /CISADM
The data provided is based on the core data objects from your connected cloud service: Person, Account, Premise, Service Agreement, and Service Point. For more information about this data, see Understanding the V.
Explore AMI Publisher Data with Sample Notebooks
It is recommended that you use OCI Data Science notebooks as a way to explore your data and develop solutions to data-oriented problems before turning them into production services. For guidance on how to configure a data science notebook, see Manually Configuring a Data Science Tenancy in the OCI cloud documentation.
Oracle Utilities provides sample notebooks to help you explore and use AMI Publisher data delivered to your OCI object storage. These samples show common ways to connect to the AMI Publisher Iceberg tables, inspect available data, run starter queries, aggregate measurement data, join measurement data with related master data, and use the data as input for analytics or machine learning workflows.
https://github.com/oracle-samples/oudi-samples/
The samples are intended for use in OCI Data Science notebooks. Download or clone the sample files from the Oracle Utilities AMI Publisher samples repository. You can then upload the notebooks and helper file to the same OCI Data Science notebook folder. Each notebook includes inline explanations and setup steps alongside the code.
The sample code is provided as a starting point for data exploration and custom analysis. Review and adapt the notebooks for your organization's data, tenancy configuration, object storage location, and business requirements.
AMI Publisher Data Tables Reference
AMI Publisher delivers transformed AMI data to object storage using Apache Iceberg tables. The published data includes measurement data, aggregated measurement data, master data, and reference data that can be used to join measurement records with related customer, account, premise, service agreement, and service point information. The available tables are grouped into the following categories:
| Table Category | Description |
|---|---|
| Measurement tables | Tables that contain the core AMI measurement data. The primary measurement table is now named measurement. This table replaces the earlier D1 measurement naming and has been transformed from the previous structure.
|
| Pass-through measurement tables | Tables that contain measurement data that is not processed through MDM. The table currently referred to as D1 measurement non-MDM is expected to be renamed to measurements pass through.
|
| Aggregated measurement tables | Tables that contain aggregated measurement values, such as daily, hourly, or monthly aggregations where available. These tables may include estimated values. |
| Master data tables | Tables that contain related master data, such as customer account, premise, service agreement, service point, and supporting entities. These tables make up most of the published table set. |
| Master data reference table | A lookup or joining table that consolidates foreign keys from the master data tables. Use this table to join measurement data to related master data without having to manually navigate the full set of master data tables. The final table name is TBD. |
Customer Cloud Service Table Reference
The following table lists the AMI Publisher tables available for Oracle Utilities Customer Cloud Service, grouped by category and described at a high level to help identify the type of data each table provides.
| Table Name | Category | Description |
|---|---|---|
| MEASUREMENT | Measurement | Contains AMI measurement data. |
| MEASUREMENT_PASS_THROUGH | Pass-through measurement | Contains measurement data not processed through MDM/MSCS. |
| MEASUREMENT_HOURLY | Aggregated measurement | Contains hourly aggregated measurement values. |
| MEASUREMENT_DAILY | Aggregated measurement | Contains daily aggregated measurement values. |
| CI_TIME_ZONE | Master data | Contains time zone records. |
| D1_ACTIVITY | Master data | Contains activity records. |
| D1_ACTIVITY_TYPE | Master data | Contains activity type records. |
| D1_DVC_CFG | Master data | Contains Device Configuration records. |
| D1_DVC_CFG_CHAR | Master data | Contains characteristics related to Device Configuration records. |
| D1_DVC_EVT | Master data | Contains Device Event records. |
| D1_DVC_EVT_TYPE | Master data | Contains Device Event Type records. |
| D1_DVC_TYPE | Master data | Contains Device Type records. |
| D1_DVC_TYPE_CHAR | Master data | Contains characteristics related to Device Type records. |
| D1_DVC_TYPE_L | Master data | Contains localized text for Device Type records. |
| D1_FACILITY | Master data | Contains Facility records. |
| D1_FACILITY_CHAR | Master data | Contains characteristics related to Facility records. |
| D1_FACILITY_IDENTIFIER | Master data | Contains identifiers related to Facility records. |
| D1_FACILITY_L | Master data | Contains localized text for Facility records. |
| D1_FACILITY_SP | Master data | Contains records defining relationships between Facility and Service Point records. |
| D1_INSTALL_EVT | Master data | Contains Install Event records. |
| D1_INSTALL_EVT_CHAR | Master data | Contains characteristics related to Install Event records. |
| D1_MEASR_COMP | Master data | Contains Measuring Component records. |
| D1_MEASR_COMP_CHAR | Master data | Contains characteristics related to Measuring Component records. |
| D1_MEASR_COMP_IDENTIFIER | Master data | Contains identifiers related to Measuring Component records. |
| D1_MEASR_COMP_TYPE | Master data | Contains Measuring Component Type records. |
| MEASUREMENT_COMPONENT_MASTER_REFERENCES | Master data reference | Contains reference data for joining measurement data with related master data. |
| D1_MC_TYPE_VALUE_IDENTIFIER | Master data | Contains Value Identifiers related to Measuring Component Type records. |
| D1_NW_LOC | Master data | Contains Network Location records. |
| D1_NW_NODE | Master data | Contains Network Node records. |
| D1_SP | Master data | Contains Service Point records. |
| D1_SPR | Master data | Contains Service Provider records. |
| D1_SPR_CHAR | Master data | Contains characteristics related to Service Provider records. |
| D1_SPR_L | Master data | Contains localized text for Service Provider records. |
| D1_SP_CHAR | Master data | Contains characteristics related to Service Point records. |
| D1_SP_EQPMNT | Master data | Contains equipment related to Service Point records. |
| D1_SP_FACILITY | Master data | Contains relationships between Service Point and Facility records. |
| D1_SP_IDENTIFIER | Master data | Contains identifiers related to Service Point records. |
| D1_SP_TYPE | Master data | Contains Service Point Type records. |
| D1_SP_TYPE_CHAR | Master data | Contains characteristics related to Service Point Type records. |
| D1_SP_TYPE_L | Master data | Contains localized text for Service Point Type records. |
| D1_US | Master data | Contains Usage Subscription records. |
| D1_US_SP | Master data | Contains relationships between Usage Subscription and Service Point records. |
| D1_US_CHAR | Master data | Contains characteristics related to Usage Subscription records. |
| F1_INSTALLATION | Master data | Contains Installation Options data. |
| F1_MST_CONFIG | Master data | Contains Master Configuration records. |
| C1_PER_CONTDET | Master data | Contains Person Contact records. |
| CI_ACCT | Master data | Contains Account records. |
| CI_ACCT_CHAR | Master data | Contains characteristics related to Account records. |
| CI_ACCT_PER | Master data | Contains relationship between Account and Person records. |
| CI_CIS_DIVISION | Master data | Contains CIS Division records. |
| CI_CIS_DIVISION_L | Master data | Contains localized text for CIS Division records. |
| CI_CUST_CL | Master data | Contains Customer Class records. |
| CI_CUST_CL_L | Master data | Contains localized text for Customer Class records. |
| CI_ENRL | Master data | Contains Enrollment records. |
| CI_LANDLORD | Master data | Contains Landlord records. |
| CI_PER | Master data | Contains Person records. |
| CI_PER_CHAR | Master data | Contains characteristics related to Person records. |
| CI_PER_NAME | Master data | Contains Person Name records. |
| CI_PREM | Master data | Contains Premise records. |
| CI_PREM_CHAR | Master data | Contains characteristics related to Premise records. |
| CI_PREM_GEO | Master data | Contains Premise Geographic Location records. |
| CI_RC | Master data | Contains Rate Component records. |
| CI_RC_CHAR | Master data | Contains characteristics related to Rate Component records. |
| CI_RC_L | Master data | Contains localized text for Rate Component records. |
| CI_RS | Master data | Contains Rate Schedule records. |
| CI_RS_L | Master data | Contains localized text for Rate Schedule records. |
| CI_SA | Master data | Contains Service Agreement records. |
| CI_SA_CHAR | Master data | Contains characteristics related to Service Agreement records. |
| CI_SA_REL | Master data | Contains relationships between Service Agreement records. |
| CI_SA_RS_HIST | Master data | Contains Service Agreement Rate Schedule History records. |
| CI_SA_SP | Master data | Contains relationships between Service Agreement and Service Point records. |
| CI_SA_SP_CHAR | Master data | Contains characteristics related to relationships between Service Agreement and Service Point records. |
| CI_SA_TYPE | Master data | Contains Service Agreement Type records. |
| CI_SA_TYPE_CHAR | Master data | Contains characteristics related to Service Agreement Type records. |
| CI_SA_TYPE_L | Master data | Contains localized text for Service Agreement Type records. |
| CI_SP | Master data | Contains Service Point records. |
| CI_SP_CHAR | Master data | Contains characteristics related to Service Point records. |
Meter Solution Cloud Service Table Reference
The following table lists the AMI Publisher tables available for Oracle Utilities Meter Solution Cloud Service, grouped by category and described at a high level to help identify the type of data each table provides.
| Table Name | Category | Description |
|---|---|---|
| MEASUREMENT | Measurement | Contains AMI measurement data. |
| MEASUREMENT_PASS_THROUGH | Pass-through measurement | Contains measurement data not processed through MDM/MSCS. |
| MEASUREMENT_HOURLY | Aggregated measurement | Contains hourly aggregated measurement values. |
| MEASUREMENT_DAILY | Aggregated measurement | Contains daily aggregated measurement values. |
| CI_TIME_ZONE | Master data | Contains time zone records. |
| D1_ACTIVITY | Master data | Contains activity records. |
| D1_ACTIVITY_TYPE | Master data | Contains activity type records. |
| D1_DVC_CFG | Master data | Contains Device Configuration records. |
| D1_DVC_CFG_CHAR | Master data | Contains characteristics related to Device Configuration records. |
| D1_DVC_EVT | Master data | Contains Device Event records. |
| D1_DVC_EVT_TYPE | Master data | Contains Device Event Type records. |
| D1_DVC_TYPE | Master data | Contains Device Type records. |
| D1_DVC_TYPE_CHAR | Master data | Contains characteristics related to Device Type records. |
| D1_DVC_TYPE_L | Master data | Contains localized text for Device Type records. |
| D1_FACILITY | Master data | Contains Facility records. |
| D1_FACILITY_CHAR | Master data | Contains characteristics related to Facility records. |
| D1_FACILITY_IDENTIFIER | Master data | Contains identifiers related to Facility records. |
| D1_FACILITY_L | Master data | Contains localized text for Facility records. |
| D1_FACILITY_SP | Master data | Contains records defining relationships between Facility and Service Point records. |
| D1_INSTALL_EVT | Master data | Contains Install Event records. |
| D1_INSTALL_EVT_CHAR | Master data | Contains characteristics related to Install Event records. |
| D1_MEASR_COMP | Master data | Contains Measuring Component records. |
| D1_MEASR_COMP_CHAR | Master data | Contains characteristics related to Measuring Component records. |
| D1_MEASR_COMP_IDENTIFIER | Master data | Contains identifiers related to Measuring Component records. |
| D1_MEASR_COMP_TYPE | Master data | Contains Measuring Component Type records. |
| MEASUREMENT_COMPONENT_MASTER_REFERENCES | Master data reference | Contains reference data for joining measurement data with related master data. |
| D1_MC_TYPE_VALUE_IDENTIFIER | Master data | Contains Value Identifiers related to Measuring Component Type records. |
| D1_NW_LOC | Master data | Contains Network Location records. |
| D1_NW_NODE | Master data | Contains Network Node records. |
| D1_SP | Master data | Contains Service Point records. |
| D1_SPR | Master data | Contains Service Provider records. |
| D1_SPR_CHAR | Master data | Contains characteristics related to Service Provider records. |
| D1_SPR_L | Master data | Contains localized text for Service Provider records. |
| D1_SP_CHAR | Master data | Contains characteristics related to Service Point records. |
| D1_SP_EQPMNT | Master data | Contains equipment related to Service Point records. |
| D1_SP_FACILITY | Master data | Contains relationships between Service Point and Facility records. |
| D1_SP_IDENTIFIER | Master data | Contains identifiers related to Service Point records. |
| D1_SP_TYPE | Master data | Contains Service Point Type records. |
| D1_SP_TYPE_CHAR | Master data | Contains characteristics related to Service Point Type records. |
| D1_SP_TYPE_L | Master data | Contains localized text for Service Point Type records. |
| D1_US | Master data | Contains Usage Subscription records. |
| D1_US_SP | Master data | Contains relationships between Usage Subscription and Service Point records. |
| D1_US_CHAR | Master data | Contains characteristics related to Usage Subscription records. |
| F1_INSTALLATION | Master data | Contains Installation Options data. |
| F1_MST_CONFIG | Master data | Contains Master Configuration records. |
| D1_US_RS_CLASS | Master data | Contains Usage Subscription Rate Schedule Class records. |
Your Data Responsibilities
It is recommended that you not perform any actions on the AMI data other than reading it. You can copy the data to another location for further modification, but any changes or custom solutions built on top of this data are your sole responsibility. Keep in mind the scenarios below.
| Customer Action | AMI Publisher Response or Impact |
|---|---|
| Deletes data from the table | The AMI Publisher will attempt to recover deleted data. Large deletions may cause job failure and require technical support. |
| Adds data to the table independently | The AMI Publisher will not interact with customer-added data. |
| Updates data in the table independently | Updates will remain unless the source system provides new updates, in which case the AMI Publisher will overwrite it with the latest value. |
| Deletes the table entirely | The AMI Publisher may try to rebuild the table, but large data volumes can cause job failure. |
| Deletes the object storage bucket | The AMI Publisher job will fail. |
| Deletes the user or changes user permissions | The AMI Publisher job will fail. |
| Needs to reload the entire table | Full table reload is possible, but a support ticket must be opened. |
| Needs regular backups of delivered data | Not required unless customer has advanced or specific needs, such as protection against rare regional outages. |
| Builds custom solutions or modifies data in another copy | All customer-built solutions or data modifications are solely the customer’s responsibility. |