Backup and recovery refers to the strategies and procedures involved in guarding against hardware failures and data loss, and reconstructing data should a loss occur.
This chapter contains the following topics:
An Oracle Fusion Middleware environment can consist of different components and configurations. A typical Oracle Fusion Middleware environment contains an Oracle WebLogic Server domain with Java component such as Oracle SOA Suite and an Oracle WebLogic Server domain with Identity Management components. It can also include one or more Oracle instances.
The installations of an Oracle Fusion Middleware environment are interdependent in that they contain configuration information, applications, and data that are kept in synchronization. For example, when you perform a configuration change, you might update configuration files in the installation. When you deploy an application, you might deploy it to all Managed Servers in a domain or cluster.
It is, therefore, important to consider your entire Oracle Fusion Middleware environment when performing backup and recovery. You should back up your entire Oracle Fusion Middleware environment at once, then periodically. If a loss occurs, you can restore your environment to a consistent state.
To back up your Oracle Fusion Middleware environment, you can use:
File copy utilities such as copy, xcopy, or jar.
For example, for online backups on Windows, use copy; for offline backups on Windows, use copy, xcopy, or jar. Do not use Winzip because it does not work with long filenames or extension.
For example, for Linux and UNIX, use tar.
Make sure that the tool you are using preserves the permissions of the files.
Oracle Recovery Manager (RMAN) to back up database-based metadata repositories.
Oracle WebLogic Server Pack and Unpack Utility
The pack command creates a template archive (.jar) file that contains a snapshot of either an entire Oracle WebLogic Server domain or a subset of a domain. You can use a template that contains a subset of a domain to create an Oracle WebLogic Server domain directory hierarchy on a remote computer.
Alternatively, you can use a template that contains an entire domain to create the the domain on a remote computer.
A full offline backup means that you must shut down the environment before backing up the files. When you perform an offline backup, the Administration Server, all Managed Servers in the Oracle WebLogic Server domain, and all system components in the Oracle instances should be shut down.
Back up the environment offline immediately after installation and after applying any patches or upgrades.
An online backup means that you do not shut down the environment before backing up the files. To avoid an inconsistent backup, do not make any configuration changes until the backup is completed. To ensure that no changes are made in the Oracle WebLogic Server domain, lock the WebLogic Server configuration, as described in Section 2.1.2.2.
You can perform backups on your full Oracle Fusion Middleware environment, or on the run-time artifacts, those files that change frequently.
To perform a full backup, you should back up the static files and directories, as well as run-time artifacts.
Static files and directories are those that do not change frequently. These include:
The Middleware home, MW_HOME. A Middleware home consists of an Oracle home and a WL_HOME (the Oracle WebLogic Server product directories.) It can also contain the user_projects directories and an Oracle instance, which are not static files.
OraInventory
OraInst.loc and oratab files, which are located in the following directory:
/etc
The beahomelist file, which is located at:
(UNIX) user_home/bea/beahomelist
(Windows) C:\bea\beahomelist
On Windows, the following registry key:
HKEY_LOCAL_MACHINE\\Software\oracle
In addition, for system components, such as Oracle Web Cache, you must back up the following Windows Registry key:
HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services
Run-time artifacts are those files that change frequently. Back up these files when you perform a full backup and on a regular basis. Run-time artifacts include:
Domain directories of the Administration Server and the Managed Servers (by default, a domain directory resides in MW_HOME, but it can be configured by the user to point to a different location)
In most cases, you do not need to back up Managed Server domain directories separately because the Administration Server contains information about all of the Managed Servers in its domain.
All Oracle instance homes, which reside, by default, in the MW_HOME but can be configured to be in a different location
Application artifacts, such as .ear or .war files
You do not need to backup application artifacts in a Managed Server domain because they can be pulled from the Administration Server during Managed Server startup.
Database artifacts such as the MDS repository
Any database-based metadata repositories used by Oracle Fusion Middleware. You use Oracle Recovery Manager (RMAN) to back up an Oracle database.
Persistent stores, such as JMS Providers and transaction logs, which reside, by default in the user_projects directory, but can be configured in a different location.
This section outlines the recommended strategy for performing backups. Using this strategy ensures that you will be able to perform the recovery procedures in this book.
Perform a full offline backup: This involves backing up the entities described in Section 8.1.1.1. Perform an offline full backup at the following times:
Immediately after you install Oracle Fusion Middleware.
Immediately after an operating system software upgrade.
Perform an online backup of run-time artifacts: This involves backing up the run-time artifacts described in Section 8.1.1.1. Backing up the run-time artifacts enables you to restore your environment to a consistent state as of the time of your most recent configuration and metadata backup. To avoid an inconsistent backup, do not make any configuration changes until backup completes. Perform an online backup of run-time artifacts at the following times:
On a regular basis. Oracle recommends that you back up run-time artifacts nightly.
Prior to making configuration changes to a component or cluster.
After making configuration changes to a component or cluster.
Prior to deploying a custom Java EE application to a Managed Server or cluster.
After a major change to the deployment architecture, such as creating servers or clusters.
Perform an offline backup of static files and directories: This involves backing up the static files and directories described in Section 8.1.1.1. Perform an offline backup of static files and directories at the following times:
After patching your Oracle Fusion Middleware environment. This backup serves as the basis for subsequent online backups.
After upgrading your Oracle Fusion Middleware environment. This backup serves as the basis for subsequent online backups.
To avoid an inconsistent backup, do not make any configuration changes until the backup is completed. To ensure that no changes are made in the Oracle WebLogic Server domain, lock the Oracle WebLogic Server configuration, as described in Section 2.1.2.2.
Recovery strategies enable you to recover from critical failures that involve actual data loss. Depending on the type of loss, they can involve recovering any combination of the following types of files:
Oracle software files
Configuration files
Metadata Repository files
Oracle system files
Windows Registry key
Application artifacts
You can recover your Oracle Fusion Middleware environment while Oracle Fusion Middleware is offline.
To recover your Oracle Fusion Middleware environment, you can use:
File copy utilities such as copy, xcopy or tar.
When you restore the files, use your preferred tool to extract the compressed files.
For example, for online recovery on Windows, use copy; for offline recovery on Windows, use copy, xcopy, or jar. Do not use Winzip because it does not work with long filenames or extension.
For example, for Linux and UNIX, use tar.
Oracle Recovery Manager (RMAN) to recover database-based metadata repositories.
You can recover your Oracle Fusion Middleware environment in part or in full. You can recover the following:
An Oracle WebLogic Server domain
The Oracle WebLogic Server Administration Server
A Managed Server
The Middleware home
An Oracle instance
A component, such as Oracle HTTP Server or Oracle Web Cache
A cluster
Deployed applications
Note the following key points about recovery:
Your Oracle Fusion Middleware environment must be offline while you are performing recovery.
Rename important existing files and directories before you begin restoring the files from backup so that you do not unintentionally override necessary files.
Although, in some cases, it may appear that only one or two files are lost or corrupted, you should restore the directory structure for the entire element, such as an Oracle instance or a component, rather than just restoring one or two files. In this way, you are more likely to guarantee a successful recovery.
Recover the database to the most current state, using point-in-time recovery (if the database is configured in Archive Log Mode). This is typically a time right before the database failure occurred.
The following sections describe how to perform different types of backups:
To perform a full offline backup, you copy the directories that contain Oracle Fusion Middleware files.
Archive and compress the source Middleware home, using your preferred tool for archiving. Make sure that the tool you are using preserves the permissions of the files.
For example, for online backups on Windows, use copy; for offline backups on Windows, use copy, xcopy, or jar.
For example, for Linux and UNIX, use tar.
The following example shows how to archive and compress the source on Linux:
cd Source_Middleware_Home
tar cf - * | gzip > Middleware_Home.tar.gz
The tar utility may issue warnings if the sticky bit is set on some files. You can safely ignore these warnings.
Do not use the jar utility to archive and compress the file system. This avoids warnings or errors from the zip tool about zipping open files (for example, the ORACLE_HOME/jdk files).
To perform a full online backup:
To avoid an inconsistent backup, do not make any configuration changes until the backup is completed. To ensure that no changes are made in the Oracle WebLogic Server domain, lock the WebLogic Server configuration, as described in Section 2.1.2.2.
Back up the Middleware home (MW_HOME) on all hosts. For example:
tar -cf mw_home_backup_033009.tar MW_HOME/*
If the domain is not located within the Middleware home, back up the Administration Server domain separately. This backs up Java components such as Oracle SOA Suite and Oracle WebCenter.
For example:
tar -cf domain_home_backup_033009.tar MW_HOME/user_projects/domains/domain_name/*
In most cases, you do not need to backup the Managed Server directories separately, because the Administration Server domain contains information about the Managed Servers in its domain. The recommended recovery procedures for Managed Servers call for restoring the Middleware home and using the pack and unpack utilities.
If the Oracle instance home is not located within the Middleware home, back up the Oracle instance home. The Oracle instance home contains configuration information about system components, such as Oracle HTTP Server or Oracle Internet Directory. (See Section 2.1.3.2 for a list of system components.)
For example:
tar -cf instance_home_backup_033009.tar ORACLE_INSTANCE/*
If a Managed Server is not located within the domain, back up the Managed Server directory. For example:
tar -cf mg1_home_backup_033009.tar MW_HOME/user_projects/domains/domain_name/servers/server_name/*
Backup the OraInventory directory. For example:
tar -cf Inven_home_backup_033009 /scratch/oracle/OraInventory
Back up OraInst.loc and oratab files, which is located in the following directory:
/etc
Backup the database repositories using the Oracle Recovery Manager (RMAN). For detailed steps, see the Oracle Database Backup and Recovery User's Guide, which is available at:
http://www.oracle.com/technology/documentation/database.html
On Windows, export the following registry key:
HKEY_LOCAL_MACHINE\Software\oracle
In addition, for system components, such as Oracle Web Cache, export the following Windows Registry key:
HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services
To export a key, use the following command:
regedit /E FileName Key
For example:
regedit /E C:\oracleregistry.reg HKEY_LOCAL_MACHINE/oracle
You can also use the Registry Editor to export the key. See the Registry Editor Help for more information.
Create a record of your Oracle Fusion Middleware environment. See Section 8.4.
You should perform a backup of run-time artifacts on a regular basis and at the times described in Section 8.1.1.2.
To back up run-time artifacts:
To avoid an inconsistent backup, do not make any configuration changes until the backup is completed. To ensure that no changes are made in the Oracle WebLogic Server domain, lock the WebLogic Server configuration, as described in Section 2.1.2.2.
Back up the Oracle WebLogic Server domain directories. This backs up Java components such as Oracle SOA Suite and Oracle WebCenter. For example:
tar -cf domain_home_backup_033009.tar MW_HOME/user_projects/domains/domain_name/*
Back up the Oracle instance home. This backs up the system components, such as Oracle HTTP Server. For example:
tar -cf instance_home_backup_033009.tar ORACLE_INSTANCE/*
Backup the database repositories using the Oracle Recovery Manager (RMAN). For detailed steps, see the Oracle Database Backup and Recovery User's Guide, which is available at:
http://www.oracle.com/technology/documentation/database.html
Create a record of your Oracle Fusion Middleware environment. See Section 8.4.
This section describes recovery strategies for outages that involve actual data loss or corruption, or media failure where the disk cannot be restored. This type of failure requires some type of data restoration before the Oracle Fusion Middleware environment can be restarted and continue with normal processing. It contains the following topics:
You can recover a Middleware home that was corrupted or from which files were deleted.
To recover a Middleware home:
Stop all relevant processes. That is, stop all processes that are running from that Middleware home.
For example, stop the Oracle WebLogic Server processes and the Node Manager processes. To stop the Administration Server, use the following WLST command:
DOMAIN_HOME/bin/stopWeblogic.sh username password admin_url
Recover the Middleware home directory from backup. For example, on Linux:
cd MW_HOME
(UNIX) tar -xf mw_home_backup_033009.tar
(Windows) jar xtf mw_home_backup_033009.jar
Start all relevant processes. That is, start all processes that run in that Middleware home. For example, to start the Administration Server:
DOMAIN_HOME/bin/startWebLogic.sh -Dweblogic.management.username=username -Dweblogic.management.password=password -Dweblogic.system.StoreBootIdentity=true
You can recover an Oracle WebLogic Server domain that was corrupted or deleted from the file system
Caution:
Performing a domain-level recovery can impact other aspects of a running system and all of the configuration changes performed after the backup was taken will be lost.To recover an Oracle WebLogic Server domain that was corrupted or deleted from the file system:
Stop all relevant processes. That is, stop all processes that are related to the domain. For example, stop the Administration Server and Managed Servers. You can use the Oracle WebLogic Server Administration Console, WLST, or the following command:
MW_HOME/user_projects/domains/domain_name/bin/stopWeblogic.sh username password admin_url
Recover the domain directory from backup.
cd MW_HOME/user_projects/domains/domain_name (UNIX) tar -xf domain_backup_033009.tar (Windows) jar xtf domain_backup_033009.jar
Start all relevant processes. That is, start all processes that are related to the domain. For example, start the Administration Server:
MW_HOME/user_projects/domains/domain_name/bin/startWebLogic.sh -Dweblogic.management.username=weblogic -Dweblogic.management.password=password -Dweblogic.system.StoreBootIdentity=true
If the Administration Server configuration has been lost because of file deletion or file system corruption, the Administration Server console will continue to function if it was already started when the problem occurred. The Administration Server directory will be regenerated automatically, except for security information. As a result, whenever you start the Administration Server, it prompts for a user name and password. To prevent this, you can recover the configuration.
Caution:
Performing a domain-level recovery can impact other aspects of a running system and all of the configuration changes performed after the backup was taken will be lost.To recover the Administration Server configuration:
Stop all processes, including the Administration Server, Managed Servers, and Node Manager if they are started. You can use the Oracle WebLogic Server Administration Console, WLST, or a script. For example, to stop the Administration Server on Linux, use the following command:
MW_HOME/user_projects/domains/domain_name/bin/stopWeblogic.sh username password admin_url
Recover the Administration Server configuration by recovering the domain home backup to a temporary location. Then, restore the config directory to the following location:
MW_HOME/user_projects/domains/domain_name/config
Start the Administration Server. You can use the Oracle WebLogic Server Administration Console, WLST, or the following command:
MW_HOME/user_projects/domains/domain_name/bin/startWebLogic.sh -Dweblogic.management.username=weblogic -Dweblogic.management.password=password -Dweblogic.system.StoreBootIdentity=true
Verify that the Administration Server starts properly and is accessible.
On the next configuration change, the configuration from the Administration Server is pushed to the Managed Servers. On each Managed Server restart, the configuration is pulled from the Administration Server.
In this scenario, the Managed Server does not operate properly or cannot be started because the configuration has been deleted or corrupted or the configuration was mistakenly changed and you cannot ascertain what was changed.
To recover a Managed Server when it cannot be started:
If the Administration Server is not reachable, recover the Administration Server, as described in Section 8.3.3.
If the Managed Server fails to start or if the file system is lost, take the following steps:
Recover the Middleware home from the backup, if required.
tar -xf mw_home_backup_033009.tar
Create a domain template jar file for the Administration Server, using the pack utility. For example:
pack.sh -domain=/scratch/Oracle/Middleware/user_projects/domains/domain_name
-template=/scratch/temp.jar -template_name=test_install
-template_author=myname -log=/scratch/logs/my.log -managed=true
Specifying the -managed=true option packs up only the Managed Servers. If you want to pack the entire domain, omit this option.
Unpack the domain template jar file, using the unpack utility:
unpack.sh -template=/scratch/aime1/ms.jar
-domain=/scratch/Oracle/Middleware/user_projects/domains/domain_name
-log=/scratch/logs/new.log -log_priority=info
Make sure that the application artifacts are accessible from the Managed Server host. That is, if the application artifacts are not on the same server as the Managed Server, they must be in a location accessible by the Managed Server.
Note:
For stage mode applications, the Administration Server takes care of pushing the bits to the stage directories in the Managed Server.
For no-stage and external-stage applications, make sure that application files are available in the stage directories of the Managed Server.
See Oracle Fusion Middleware Deploying Applications to Oracle WebLogic Server for information about stage, no-stage, and external-stage mode applications.
Start the Managed Server. You can use the Oracle WebLogic Server Administration Console, WLST, or the following command:
MW_HOME/user_projects/domains/domain_name/bin/startManagedWebLogic.sh managed_server_name admin_url username password
The Managed Server connects to the Administration Server and updates its configuration changes.
The following topics describe how to recover an Oracle instance:
Recovering After Oracle Instance Home Deleted from File System
Recovering After Oracle Instance Home Deleted from Oracle Fusion Middleware
You can recover an Oracle instance home after it was corrupted or erroneously deleted from the file system.
To recover an Oracle instance home that was corrupted or deleted from the file system:
Stop all relevant processes. That is, stop all processes that are related to that Oracle instance.
opmnctl stopall
Recover the Oracle instance home directory from a backup file. For example:
cd ORACLE_INSTANCE
(UNIX) tar -xf Instance_home_backup_033009.tar
(Windows) jar xtf Instance_home_backup_033009.jar
Start all relevant processes. That is, start all processes that are related to that Oracle instance:
opmnctl startall
You can recover an Oracle instance home after it was erroneously deleted from Oracle Fusion Middleware.
To recover an Oracle instance home that was deleted from your Oracle Fusion Middleware environment:
Recover the Oracle instance home directory from a backup file. For example, on Linux:
cd ORACLE_INSTANCE
tar -xf Instance_home_backup_033009.tar
Register the Oracle instance, along with all of its components, with the Administration Server, using the opmnctl registerInstance command. For example:
opmnctl registerInstance -adminHost admin_server_host -adminPort admin_server_port -adminUsername username -adminPassword password -oracleInstance ORACLE_INSTANCE_dir -oracleHome ORACLE_HOME_dir -instanceName Instance_name -wlserverHome Middleware_Home
The following topics describe how to recover a component:
You can restore a component's files if they are deleted or corrupted or if the component cannot be started or is not functioning properly because the component's configuration was changed and committed. You may not be able to ascertain what change is causing the problem and you want to revert to an earlier version.
To recover a component, the steps you take depend on the type of component:
For Java components, such as Oracle SOA Suite, you recover the Managed Server, as described in Section 8.3.4.
For system components, such as Oracle HTTP Server or Oracle Web Cache:
Stop the component. For example, to stop Oracle HTTP Server:
opmnctl stopproc ias-component=HTTP_Server
For information on stopping components, see Section 3.4.4.
Recover the component-specific files from backup. See the Oracle Fusion Middleware Administrator's Guide for a list of the directories and files needed for each component. For example, to recover Oracle HTTP Server files, you recover the following directories:
ORACLE_INSTANCE/config/OHS/component_name ORACLE_INSTANCE/diagnostics/logs/OHS/component_name ORACLE_INSTANCE/tmp/OHS/component_name
Start the component. For example, to start Oracle HTTP Server:
opmnctl startproc ias-component=HTTP_Server
For information on starting components, see Section 3.4.4.
You can recover components in a cluster that cannot be started or are not functioning properly because the configuration was changed and committed at the cluster level. You may not be able to ascertain what change is causing the problem and you want to revert to an earlier version.
Caution:
Performing a domain-level recovery can impact other aspects of a running system and all of the configuration changes performed after the backup was taken will be lost.To recover the components:
Stop all processes, such as the Managed Servers and the Administration Server. You can use the Oracle WebLogic Server Administration Console, WLST or a script. For example, to stop the Administration Server on Linux, use the following command:
MW_HOME/user_projects/domains/domain_name/bin/stopWeblogic.sh username password admin_url
Recover the Administration Server configuration by recovering the domain home backup to a temporary location. Then, restore the config directory to the following location:
MW_HOME/user_projects/domains/domain_name/config
Start the Administration Server. You can use the Oracle WebLogic Server Administration Console, WLST, or the following command:
MW_HOME/user_projects/domains/domain_name/bin/startWebLogic.sh -Dweblogic.management.username=weblogic -Dweblogic.management.password=password -Dweblogic.system.StoreBootIdentity=true
Start the cluster. You can use the Oracle WebLogic Server Administration Console or WLST. For example, to use the WLST start command:
start('clusterName', 'Cluster')
The latest configuration is pulled from the Administration Server to every member of the cluster.
In the event you need to restore and recover your Oracle Fusion Middleware environment, it is important to have all the necessary information at your disposal. This is especially true in the event of a hardware loss that requires you to reconstruct all or part of your Oracle Fusion Middleware environment on a new disk or host.
You should maintain an up-to-date record of your Oracle Fusion Middleware environment that includes the information listed in this section. You should keep this information both in hardcopy and electronic form. The electronic form should be stored on a host or e-mail system that is completely separate from your Oracle Fusion Middleware environment.
Your Oracle Fusion Middleware hardware and software configuration record should include:
The following information for each host in your environment:
Host name
Virtual host name (if any)
Domain name
IP address
Hardware platform
Operating system release level and patch information
The following information for each Oracle Fusion Middleware installation in your environment:
Installation type (for example, Oracle SOA Suite)
Host on which the installation resides
User name, userid number, group name, groupid number, environment profile, and type of shell for the operating system user that owns the Oracle home (/etc/passwd and /etc/group entries)
Directory structure, mount points, and full path for the Middleware home, Oracle home, Oracle WebLogic Server domain home (if it does not reside in the user_projects directory in the Middleware home), and the Oracle instance home
Amount of disk space used by the installation
Port numbers used by the installation
The following information for the Metadata Repository:
Host name
Database version and patch level
Base language
Character set
Global database name
SID
For more information about backing up and recovering Oracle Fusion Middleware, see the following topics in the Oracle Fusion Middleware Administrator's Guide:
"Introducing Backup and Recovery," which provides more in-depth information about backup and recovery strategies
"Backup Strategies and Procedures," which provides additional information about backing up your environment
"Recovery Strategies and Procedures," which provides additional information about selective recovery of WebLogic Servers, Oracle instances, components, and applications. It also explains how to recover in the case of loss of host.