Learn About Migrating Data to a High Performance Database in the Cloud Using File Storage
Oracle Data Pump is a fast, easy, off-line database migration tool that supports enterprise fleet-scale migrations. Oracle Data Pump enables you to change the database structure during migration, supports in-flight upgrades, and provides broad support for data migration between different platforms, and databases with different character sets. Oracle Cloud Infrastructure File Storage provides flexible, scalable capacity for your storage requirements.
Before You Begin
Architecture
This architecture shows the components used with Oracle Data Pump when migrating data from on-premises to an Oracle Database Exadata Cloud Service with Oracle Cloud Infrastructure File Storage service.
Description of the illustration migrate-datapump-fss.png
This architecture supports the following components:
- Databases
The source database is Oracle Database 19c and the target database is Oracle Database Exadata Cloud Service. You can provision the target from the Console, or you can download Terraform code. Terraform code is designed to help you deploy a VCN, a 4 OCPU compute instance in a private subnet, and an Oracle Exadata Cloud Service (Quarter Rack) database system in an Oracle Cloud region. There will be a private subnet attached to the Exadata database system for client traffic and another one for backup traffic. Terraform code includes input variables, which you can use to tune the architecture to suit the networking requirements of your containerized workloads, the size and number of node pools required, your fault-tolerance constraints, and so on.
- File storage
The Oracle Cloud Infrastructure File Storage service provides a durable, scalable, secure, enterprise-grade network file system. You can connect to a File Storage service file system from any Exadata DB system instance in a VCN. You can also access a file system from outside the VCN by using Oracle Cloud Infrastructure FastConnect and IPSec VPN.
- Object storage
Object storage provides quick access to large amounts of structured and unstructured data of any content type, including database backups, analytic data, and rich content such as images and videos. Use standard storage for "hot" storage that you need to access quickly, immediately, and frequently. Use archive storage for "cold" storage that you retain for long periods of time and seldom or rarely access.
- Region
An Oracle Cloud Infrastructure region is a localized geographic area that contains one or more data centers, called availability domains. Regions are independent of other regions, and vast distances can separate them (across countries or even continents).
- Availability domain
Availability domains are standalone, independent data centers within a region. The physical resources in each availability domain are isolated from the resources in the other availability domains, which provides fault tolerance. Availability domains don’t share infrastructure such as power or cooling, or the internal availability domain network. So, a failure at one availability domain is unlikely to affect the other availability domains in the region.
- VPN Connect
VPN Connect provides site-to-site IPSec VPN connectivity between your on-premises network and VCNs in Oracle Cloud Infrastructure. The IPSec protocol suite encrypts IP traffic before the packets are transferred from the source to the destination and decrypts the traffic when it arrives.
- FastConnect
Oracle Cloud Infrastructure FastConnect provides an easy way to create a dedicated, private connection between your data center and Oracle Cloud Infrastructure. FastConnect provides higher-bandwidth options and a more reliable networking experience when compared with internet-based connections.
- Dynamic routing gateway (DRG)
The DRG is a virtual router that provides a path for private network traffic between a VCN and a network outside the region, such as a VCN in another Oracle Cloud Infrastructure region, an on-premises network, or a network in another cloud provider.
- SQL*Net and SSH connectivity
Oracle Data Pump requires SQL*Net and SSH access to the source and target databases, as well as access through port 1521 (default DB port). The source and target databases must have SSH access to port 22 and SQL*Net access to port 1521 and to each other.
- Service gateway
The service gateway provides access from a VCN to other services, such as Oracle Cloud Infrastructure Object Storage. The traffic from the VCN to the Oracle service travels over the Oracle network fabric and never traverses the internet.
- Security list
For each subnet, you can create security rules that specify the source, destination, and type of traffic that must be allowed in and out of the subnet.
- Route table
Virtual route tables contain rules to route traffic from subnets to destinations outside a VCN, typically through gateways.
About the Network Setup for Exadata DB Systems
When you work with Oracle Cloud Infrastructure, one of the first steps is to set up a virtual cloud network (VCN) for your cloud resources. Oracle Database Exadata Cloud Service requires a VCN in the region where the DB system will reside.
- A VCN in the region where you want the DB system.
- At least two subnets in the VCN, a Client subnet and a Backup subnet
See Exadata DB Systems for best practices and network setup for Exadata DB systems.
About Oracle Cloud Infrastructure File Storage Service
If you’re looking for shared storage for services in Oracle Cloud Infrastructure, then consider using Oracle Cloud Infrastructure File Storage.
Oracle Cloud Infrastructure File Storage is a persistent, shared file system in Oracle Cloud. It provides a durable, scalable, distributed, enterprise-grade network file system. The service supports Network File System version 3.0 (NFSv3) and Network Lock Manager (NLM) for file locking functionality.
Large compute clusters of thousands of instances can use Oracle Cloud Infrastructure File Storage service for high-performance shared storage. Storage provisioning is fully managed and automatic. Storage scales seamlessly from kilobytes to exabytes without upfront provisioning. You have redundant storage for resilient data protection.
By default, the service uses AES-128 encryption to encrypt all file systems. Encryption happens at the file level. Data and metadata are encrypted at rest rather than while in transit. You can’t turn off encryption.
Oracle Cloud Infrastructure File Storage service is fully managed and is offered across all availability domains in each Oracle Cloud Infrastructure region. You can connect to an Oracle Cloud Infrastructure File Storage system from any bare metal instance, virtual machine instance, Oracle Database Exadata Cloud Service, or container instance in your virtual cloud network (VCN). You can also access a file system from outside the VCN by using Oracle Cloud Infrastructure FastConnect and an Internet Protocol security (IPSec) virtual private network (VPN).
About Required Services and Roles
This solution requires the following services, products, and roles:
- Oracle Database Exadata Cloud Service
- Oracle Cloud Infrastructure Compute
- Oracle Cloud Infrastructure File Storage
- Oracle Cloud Infrastructure Object Storage
- Oracle Instant Client version 18.3.0.0.0 or above for your version of
Oracle Database and your operating system platform to support new
impdpcloud command option. If there is an existing Oracle Database 18.3 or higher installed, you can use the Oracle Instant Client version that's installed with the database.- Basic Package: All files required to run Oracle Cloud Infrastructure, Oracle C++ Call Interface (OCCI), and Java Database Connectivity (JDBC) Oracle Call Interface (OCI) applications
- SQL*Plus Package: The SQL*Plus command line tool for SQL and PL/SQL queries
- Tools Package: Includes Data Pump, SQL*Loader and Workload Replay Client
These are the roles needed for each service.
| Service Name: Role | Required to... |
|---|---|
| Oracle Cloud Infrastructure: Admin, or a policy that grants permission to manage the Compute, Exadata, networking, and storage | Create the target Exadata DB System and set up resources in Oracle Cloud. |
| Oracle Cloud Infrastructure File Storage: Admin, or a policy that grants permission to manage the file storage resources | Create storage for the data from the on-premises database. |
| Oracle Database: root | Access the database using SSH. |
| Oracle Data Pump software: non-root user | Install the Data Pump software. |
See Learn how to get Oracle Cloud services for Oracle Solutions to get the cloud services you need.