Enable a Full Refresh or Realtime or Near-Realtime Sync of Microsoft Dynamics 365 Data to Oracle Analytics Cloud

You can process full refresh/initial load and incremental workloads such as foundational and transactional data from Microsoft Dynamics 365 to Oracle Autonomous Data Warehouse (ADW) by using Oracle Cloud Infrastructure (OCI) Integration services. Making data available in Oracle ADW facilitates data-driven decision-making by supporting data analysis, reporting, dash-boarding, and analytics capabilities using analytics platforms such as Oracle Analytics Cloud, Tableau, MicroStrategy and so on.

This reference architecture is also a multicloud architecture that shows how organizations can integrate data from Azure to OCI.

Architecture

You can implement the use case defined in this reference architecture by using a combination of OCI Integration services such as OCI Data Integration (DI) and Oracle Integration. OCI DI addresses all of your initial or full refresh workloads while Oracle Integration addresses all of your incremental and real-time/near real-time workloads synchronization with its enterprise-grade connectivity capabilities.

This architecture shows a typical multicloud deployment with MS Dynamics 365 and Blob storage on Microsoft Azure and Oracle ADW, OCI Integrations and Oracle Analytics cloud on Oracle Cloud Infrastructure (OCI).

The following diagram illustrates this reference architecture.


Description of enable-refresh-ms-365.png follows
Description of the illustration enable-refresh-ms-365.png

enable-refresh-ms-365-oracle.zip

In this architecture, the following occurs:
  1. Microsoft Dynamics 365 generates full refresh and incremental data files to Azure Blob storage for the corresponding foundational and transactional workloads. Full refresh or initial load files are generated initially or when needed whereas incremental data files are published on regular intervals.
  2. OCI Integration services, such as OCI DI securely connect and retrieve full refresh data files while Oracle Integration, at regular intervals, retrieves incremental data files from Azure Blob storage.
  3. OCI Integration services process these data files to Oracle ADW fact and dimension tables after completing required mappings and transformations, and with any intermediate application orchestrations completed for enrichment.
  4. The appropriate procedures and processes are executed in Oracle ADW so that the required data is available for data analysis in Oracle Analytics Cloud.
  5. Oracle Analytics Cloud empowers business analysts and consumers with modern, AI-powered, self-service analytics capabilities for data preparation, visualization, enterprise reporting, augmented analysis, and natural language processing.
The architecture has the following components:
  • Analytics

    Oracle Analytics Cloud is a scalable and secure public cloud service that empowers business analysts with modern, AI-powered, self-service analytics capabilities for data preparation, visualization, enterprise reporting, augmented analysis, and natural language processing and generation. With Oracle Analytics Cloud, you also get flexible service management capabilities, including fast setup, easy scaling and patching, and automated lifecycle management.

  • Autonomous Data Warehouse

    Oracle Autonomous Data Warehouse is a self-driving, self-securing, self-repairing database service that is optimized for data warehousing workloads. You do not need to configure or manage any hardware, or install any software. Oracle Cloud Infrastructure handles creating the database, as well as backing up, patching, upgrading, and tuning the database.

  • Oracle Cloud Infrastructure Data Integration

    OCI Data Integration is a fully managed, serverless, cloud-native service that extracts, loads, transforms, cleanses, and reshapes data from a variety of data sources into target Oracle Cloud Infrastructure services, such as Autonomous Data Warehouse and Oracle Cloud Infrastructure Object Storage. ETL (extract transform load) leverages fully-managed scale-out processing on Spark, and ELT (extract load transform) leverages full SQL push-down capabilities of the Autonomous Data Warehouse in order to minimize data movement and to improve the time to value for newly ingested data. Users design data integration processes using an intuitive, codeless user interface that optimizes integration flows to generate the most efficient engine and orchestration, automatically allocating and scaling the execution environment. Oracle Cloud Infrastructure Data Integration provides interactive exploration and data preparation and helps data engineers protect against schema drift by defining rules to handle schema changes.

  • Integration

    Oracle Integration is a fully managed service that allows you to integrate your applications, automate processes, gain insight into your business processes, and create visual applications.

Explore More

Learn more about enabling a full refresh or real/near-real time sync of Microsoft Dynamics 365 data to OAC.

Review these additional resources:

Acknowledgments

Author: Pavan Rajalbandi