Oracle® Hierarchical Storage Manager and StorageTek QFS Software File System Recovery Guide Release 6.0 E42065-03 |
|
Previous |
Next |
Whenever you are faced with recovering from a significant file-system failure or potential data loss, your first steps should stabilize the affected systems, minimize chances for further losses, and preserve diagnostic information, where possible. This chapter outlines the actions that you need to take:
When you have to restore an archiving file system or significant numbers of lost files, you should first stop the archiving and recycling processes for the file system. You want to stabilize and isolate the archive until you have assessed the situation and, ideally, restored everything to normal. Otherwise, ongoing archiving and recycling operations can, in some situations, make matters worse. Archiving and staging processes may propagate corrupted files. Recycling processes may delete the only remaining copies of valid data.
So, whenever possible, take the precautions listed below:
Once recovery operations are complete, you can reverse the changes below and restore normal file system behavior.
Log in to the file-system metadata server as root
.
root@solaris:~#
Open the /etc/opt/SUNWsamfs/archiver.cmd
file in a text editor, and scroll down to the first fs
(file-system) directive.
In the example, we use the vi
editor:
root@solaris:~#vi
/etc/opt/SUNWsamfs/archiver.cmd
# Configuration file for Oracle HSM archiving file systems #----------------------------------------------------------------------- # General Directives archivemeta = off examine = noscan #----------------------------------------------------------------------- # Archive Set Assignments fs = samqfs1 logfile = /var/adm/samqfs1.archive.log all . 1 -norelease 15m 2 -norelease 15m fs = samqfs2 logfile = /var/adm/samqfs2.archive.log all . ...
If you need to stop archiving on all file systems, insert a wait
directive just before the first fs
directive in the archiver.cmd
. Save the archiver.cmd
file, and close the editor.
In the example, we insert the wait
directive just before the directive for the samqfs1
file system, where it will apply to all file systems configured for archiving:
root@solaris:~# vi /etc/opt/SUNWsamfs/archiver.cmd ... #----------------------------------------------------------------------- # Archive Set Assignmentswait
fs = samqfs1 logfile = /var/adm/samqfs1.archive.log all . 1 -norelease 15m 2 -norelease 15m 3 -norelease 15m fs = samqfs2 ...:wq
root@solaris:~#
If you need to stop archiving on only one file system, insert a wait
directive just after the fs
directive for that file system. Save the archiver.cmd
file, and close the editor.
In the example, we stop archiving activity on the samqfs1
file system:
root@solaris:~# vi /etc/opt/SUNWsamfs/archiver.cmd ... #----------------------------------------------------------------------- # Archive Set Assignments fs = samqfs1wait
logfile = /var/adm/samqfs1.archive.log all . 1 -norelease 15m 2 -norelease 15m 3 -norelease 15m fs = samqfs2 ...:wq
root@solaris:~#
Next, Stop Recycling.
Log in to the file-system metadata server as root
.
root@solaris:~#
Open the /etc/opt/SUNWsamfs/recycler.cmd
file in a text editor.
In the example, we use the vi
editor:
root@solaris:~#vi
/etc/opt/SUNWsamfs/recycler.cmd
# Configuration file for Oracle HSM archiving file systems #----------------------------------------------------------------------- logfile = /var/adm/recycler.log no_recycle tp VOL[0-9][2-9][0-9] library1 -hwm 95 -mingain 60
Add the -ignore
parameter to each recycling directive in the recycler.cmd
file. Then save the file, and close the editor.
The recycler.cmd
file does not contain recycling directives unless you have configured recycling by library, rather than by archive sets. But check it now.
In the example, we have one recycling directive for tape library library1
:
root@solaris:~# vi /etc/opt/SUNWsamfs/recycler.cmd # Configuration file for Oracle HSM archiving file systems #----------------------------------------------------------------------- logfile = /var/adm/recycler.log no_recycle tp VOL[0-9][2-9][0-9] library1 -hwm 95 -mingain 60-ignore
:wq
root@solaris:~#
If you are recovering from loss or damage to one more archiving file systems, Back Up Unarchived Files before proceeding.
If you are recovering from a server problem or from loss or damage to file systems, Save the Oracle HSM Configuration before proceeding.
If you need to restore directories and files, decide whether you need to Save the Oracle HSM Configuration or go directly to Chapter 5, "Recovering Lost and Damaged Files".
Unarchived files may remain in the disk cache of a damaged archiving file system. No copies of these files exist in the archive. So, if you can, back them up to a recovery point file now. Proceed as follows:
Log in to the file-system metadata server as root
.
root@solaris:~#
Select a safe storage location for the recovery point.
In the example, we create a subdirectory, unarchived/
, under a directory that we created for recovery points during initial configuration. The /zfs
file system has no devices in common with /samqfs1
, the file system that we are recovering:
root@solaris:~#mkdir
/zfs1/samqfs_recovery/
unarchived/
root@solaris:~#
Change to the file system's root directory.
In the example, we change to the mount-point directory /samqfs1
:
root@solaris:~#cd
/samqfs1
root@solaris:~#
Backup any unarchived files that remain in the disk cache. Use the command samfsdump
-u
-f
recovery-point
, where recovery-point
is the path and file name of the output file.
The -u
option causes the samfsdump
command to back up any data files that have not been archived. In the example, we save the recovery point file 20150325
to the remote directory /zfs1/samqfs_recovery/
unarchived/
:
root@solaris:~#samfsdump
-u
-f
/zfs1/samqfs_recovery/
unarchived/
20150325
root@solaris:~#
If you are recovering from a server problem or from loss or damage to file systems, Save the Oracle HSM Configuration before proceeding.
If you need to restore directories and files, decide whether you need to Save the Oracle HSM Configuration or go directly to Chapter 5, "Recovering Lost and Damaged Files".
Even when you have safely stored backup copies of all configuration files and scripts needed for restoring the Oracle HSM software and file-system, it pays to preserve the current state of a failed system, if you can. Surviving configuration files and scripts may contain changes that were implemented since the complete configuration was last backed up. This can mean the difference between restoring the system to its almost its exact pre-failure state and merely getting close. Log and trace files contain information that helps restore files and clarifies the causes of failures. For this reason, you should preserve whatever remains, before you do anything else.
If possible, log in to the file-system metadata server as root
.
root@solaris:~#
Run the samexplorer
command, create a SAMreport, and save the report in the directory that holds your backup configuration information. Use the command samexplorer
path
/
hostname
.
YYYY
MM
DD
.
hh
mm
z
.
tar.gz
, where path
is the path to the chosen directory, hostname
is the name of the Oracle HSM file system host, and YYYY
MM
DD
.
hh
mm
z
is a date and time stamp.
The default file name is /tmp/SAMreport.
hostname
.
YYYY
MM
DD
.
hh
mm
z
.tar.gz
. In the example, we already have a directory for saving SAMreports, /zfs1/sam_config/
. So we create the report in this directory (note that the command below is entered as a single line—the line break is escaped by the backslash character):
root@solaris:~#samexplorer
\/zfs1/sam_config/explorer/
server1
.20150325.1659MST.tar.gz
Report name: /zfs1/sam_config/explorer/samhost1.20150325.1659MST.tar.gz Lines per file: 1000 Output format: tar.gz (default) Use -u for unarchived/uncompressed. Please wait............................................. Please wait............................................. Please wait...................................... The following files should now be ftp'ed to your support provider as ftp type binary. /zfs1/sam_config/explorer/samhost1.20150325.1659MST.tar.gz
Copy as many of the Oracle HSM configuration files as you can to an independent file system. These include the following:
/etc/opt/SUNWsamfs/ mcf archiver.cmd defaults.conf diskvols.conf hosts.family-set-name
hosts.family-set-name
.local preview.cmd recycler.cmd releaser.cmd rft.cmd samfs.cmd stager.cmd inquiry.conf samremote # SAM-Remote server configuration file family-set-name # SAM-Remote client configuration file network-attached-library # Parameters file scripts/* # Back up all locally modified files /var/opt/SUNWsamfs/
Back up all surviving library catalogs, including the historian catalog. For each catalog, use the command dump_cat
-V
catalog-file
, where catalog-file
is the path and name of the catalog file. Redirect the output to dump-file
, in a new location.
We will use the output of the dump_cat
file to rebuild the catalogs on a replacement system, using the command build_cat
. In the example, we dump the catalog data for library1
to the file library1cat.dump
in a directory on the independent NFS-mounted file system zfs1
(note that the command below is entered as a single line—the line break is escaped by the backslash character):
root@solaris:~#dump_cat
-V
/var/opt/SUNWsamfs/catalog/library1cat
>
\/zfs1/sam_config/20150325/catalogs/
library1cat.dump
Copy system configuration files that were modified during Oracle HSM installation and configuration to an independent file system. These may include:
/etc/ syslog.conf system vfstab /kernel/drv/ sgen.conf samst.conf samrd.conf sd.conf ssd.conf st.conf /usr/kernel/drv/dst.conf
Copy any custom shell scripts and crontab
entries that you created as part of the Oracle HSM configuration to an independent file system.
For example, if you created a crontab
entry to manage creation of recovery points, you would save a copy now.
Create a readme
file that records the revision level of the currently installed software. Include Oracle Oracle HSM, Solaris, and Solaris Cluster (if applicable). Save the file on an independent file system with the other recovery information.
If possible, save copies of downloaded Oracle Oracle HSM, Solaris, and Solaris Cluster packages on an independent file system.
If you have the packages readily available, you can restore the software quickly, should it become necessary.
If you are recovering from the loss of a Oracle HSM server host, go to Chapter 3, "Restoring the Oracle HSM Configuration".
If you need to restore one or more Oracle HSM file systems, go to Chapter 4, "Recovering File Systems".
If you need to restore directories and files, go to Chapter 5, "Recovering Lost and Damaged Files".