This section describes concepts for the key Oracle ACFS components and contains the following topics:
About Oracle ACFS
Oracle ACFS is designed as a general-purpose, standalone server and clusterwide file system that delivers support for all customer files. Users and applications can access and manage Oracle ACFS using native operating system file system application programming interfaces (APIs) and command-line interface (CLI) tools. Users can also manage Oracle ACFS with Oracle ASM Configuration Assistant (ASMCA).
Oracle ACFS supports large files with 64-bit file and file system data structure sizes leading to exabyte capable file and file system capacities on 64 bit platforms. Variable extent-based storage allocation and high-performance directories contribute to fast performance and shared disk configurations that provide direct storage paths to Oracle ACFS file data from each cluster member. File system integrity and fast recovery is achieved with Oracle ACFS metadata checksums and journaling. Oracle ACFS is designed as a multi-node, shared file system model that delivers coherent, cached, direct storage paths to Oracle ACFS file data from each cluster member.
Oracle ACFS files systems are typically configured for clusterwide access. File systems, files, and directories are visible and accessible from all cluster members and can be referenced by users and applications using the same path names from any cluster member. This design enables simplified application deployments across cluster members and facilitates both multiple instance cluster applications and high availability (HA) failover of unmodified standalone server applications.
Oracle ACFS presents single system file access semantics across cluster configurations. Applications and users on all cluster members are always presented with the same view of shared Oracle ACFS file data, supported by the Oracle ACFS clusterwide user and metadata cache coherency mechanism.
About the Oracle ACFS Mount Model and Namespace
Oracle ACFS is designed as a hierarchical file system containing files and subdirectories organized into a tree-structured namespace with files at the leaves. The namespace design is a single-file system naming model for both standalone server and cluster configurations. This design enables each cluster member to present shared files to cluster applications using the same path names, simplifying multi-node application and user access, and overall file system administration. The Oracle ACFS mount model also accommodates node local mounts and cluster node subset mounts in cluster configurations to accommodate additional customer requirements.
It is best practice for Oracle ACFS file systems to be Oracle Clusterware managed with Oracle Clusterware resources to ensure they are properly handled during Oracle Grid Infrastructure startup and shutdown.
You can explicitly use the
mount command. However, if the resource has been created, then the file system may already be mounted.
About Oracle ACFS and Database Data Files
The best practice for data files in Oracle ACFS is to use a clusterwide resource for the Oracle ACFS File system that stores the data files.
If the data files are added after the database installation is complete, you must modify the database dependencies to list the new Oracle ACFS file system. Failure to do so results in errors with application reliability. To specify the file systems in the dependency list, use the SRVCTL database object command to modify the Oracle ACFS paths used by the resource.
Oracle ACFS in Oracle Grid Infrastructure 18c cluster and standalone (Oracle Restart) configurations supports all database files for Oracle Database releases 18.104.22.168 or higher. Oracle ACFS can be configured for use with the database particularly to leverage Oracle ACFS snapshots for database testing and development. To support database files in cluster configurations, the
COMPATIBLE.ADVM attribute must be set to
12.1 or higher for the disk group that contains the Oracle ACFS file system. In an Oracle Restart configuration, the
COMPATIBLE.ADVM attribute must be set to
22.214.171.124 or higher to support all database files.
Support for database data files on Oracle Exadata (Linux) begins with Oracle Grid 12c Release 1 (126.96.36.199). However, Oracle ACFS does not currently have the ability to push database operations directly into storage.
Oracle ACFS on Oracle Grid Infrastructure 188.8.131.52 additionally supports all database files for Oracle Database 10g Release 2 (10.2.0.4 and 10.2.0.5) on Oracle Exadata (Linux) storage. For database file support with Oracle Database 10g Release 2 (10.2.0.4 and 10.2.0.5) on Oracle Exadata storage, the following conditions must be met:
When creating an Oracle Database with DBCA, you must set the
REMOTE_LISTENERinitialization parameter to
:1521otherwise DBCA fails during the create process.
You must modify all the start and stop dependencies of the database instance resources to ensure that the resources start when starting Oracle Clusterware.
The following list provides important information about using Oracle ACFS with database files:
Oracle ACFS support includes all file types supported by Oracle ASM.
When storing database data files on Oracle ACFS, you must set the
FILESYSTEMIO_OPTIONSinitialization parameter to
setall; other settings are not supported. To achieve optimal performance with database data files, set
ADVMcompatibility attributes to
12.1or higher for the disk group that contains the Oracle ADVM volume intended to hold the data files. For volumes created before 184.108.40.206, set the stripe columns to
1, or set the stripe columns to
8and the stripe width to
MB. Volumes created while running 220.127.116.11 or higher already default to the high performance configuration (stripe columns =
8and stripe width =
To obtain optimal database performance with snapshots, the snapshots must be created after the
ADVMcompatibility attribute is set to
Use a 4 K or larger database block size and tablespace block size with Oracle ACFS for best performance.
For best performance when using Oracle Exadata, use a 4 K metadata file system.
Oracle ACFS does not support databases with 2 K block sizes.
Do not export Oracle ACFS file systems containing database files through NFS to access them from a DNFS client. This configuration is not supported.
If a data file is configured to automatically extend, then the size of the increments should be large enough to ensure that the extend operation occurs infrequently. Frequent automatic extends have a negative performance impact.
Running a workload in a snapshot reduces resources for the primary workload running on the base files because the storage is shared between the base file system and the snapshots. To run test scenarios in Oracle ACFS snapshots without impacting the primary workload, copy the file system and then run test workloads on snapshots created in the copied file system.
Oracle ACFS does not support encryption or replication with Oracle Database data files, tablespace files, control files, redo logs, archive logs, RMAN backups, Data Pump dumpsets or flashback files. To encrypt database data files on Oracle ACFS, Oracle recommends Oracle Advanced Security. Oracle Advanced Security provides Transparent Data Encryption (TDE) to encrypt data files for entire tablespaces. Oracle Data Guard and Oracle GoldenGate provide other replication options for database files on Oracle ACFS.
Databases that share storage with snapshots or with the base of the file system can become fragmented under active online transaction processing (OLTP) workloads. This fragmentation can cause the location of the data in the volume to be discontiguous for sequential scans. Oracle ACFS automatically defragments these files in the background. Fragmentation is reported through the
filecommands, and it can also be viewed with the
filecommands also enable on-demand defragmentation of a file in the event the automatic defragmentation does not occur quickly enough.
Creating Oracle ACFS Resources for information about Oracle ACFS resources
volcreate for information about creating a volume
mkfs for information about setting the metadata block size with
Oracle ACFS Command-Line Utilities for information about
Oracle Database Reference for information about the
Oracle Automatic Storage Management Administrator's Guide for a list of file types supported by Oracle ASM
Oracle Clusterware Administration and Deployment Guide for information about resource dependencies
Oracle Database Advanced Security Guide for information about Transparent Data Encryption (TDE)
Oracle Data Guard Concepts and Administration for information about other replication options for database files on Oracle ACFS
- https://www.oracle.com/middleware/technologies/goldengate.html for Oracle GoldenGate documentation about other replication options for database files on Oracle ACFS
About Oracle ACFS and Oracle Database Homes
An Oracle ACFS file system can be configured as an Oracle Database home.
When installing a database in a cluster, a shared Oracle ACFS file system can be used for the database home. You can use an Oracle ACFS file system for an Oracle Database home with Oracle 11g Release 2 (11.2) or later.
When installing Oracle Software, there must be a separate Oracle base (
ORACLE_BASE) associated with each operating system user. For example, there should be a separate Oracle base for a grid user and a database user.
You can locate the Oracle Database base (
ORACLE_BASE for database) directory and home (
ORACLE_HOME for database) directory on an Oracle ACFS file system. The Oracle Database base (
ORACLE_BASE for database) directory should not be the Oracle Grid Infrastructure base (
ORACLE_BASE for grid) directory or should not be located under the Oracle Grid Infrastructure base directory (
ORACLE_BASE for grid).
The Oracle Grid Infrastructure base (
ORACLE_BASE for grid) directory and home (
ORACLE_HOME for grid) directory cannot be located on the Oracle ACFS file system because the Oracle ACFS file system cannot be created until Oracle Grid Infrastructure is installed.
One or more Oracle Database homes on Oracle ACFS can be created under the same mount point with each home using a separate Oracle ACFS file system.
After the installation of Oracle Grid Infrastructure Software and before the installation of the Oracle Database software with Oracle Universal Installer (OUI), you can create an Oracle ACFS file system to be configured for use as an Oracle Database home.
You can also use the Oracle ASM Configuration Assistant (ASMCA) or Oracle ACFS commands to create the file system.
When an Oracle ACFS file system contains an Oracle Database home or Oracle Database uses the file system for any file storage, the file system must have an Oracle ACFS file system resource. If you have not used Oracle ASM Configuration Assistant to setup the mount point, then you must use Server Control Utility (SRVCTL) commands to set up Oracle Database dependencies.
In an Oracle Grid Infrastructure clusterware configuration, a clusterwide Oracle ACFS resource is required when using Oracle ACFS for the database home. To enable the database owner to act on the resource, the owner must be specified as a permitted user when creating the resource. You can specify the database owner with the
-u option of the
registry command. Root privilege is required when adding the resource in Linux or Unix environments.
After the Oracle ACFS file system and resources are created, the Oracle ACFS-based database home mount point location can be selected as the Oracle Database home location by browsing to and then choosing the directory during the Oracle Universal Installer (OUI) Database Software installation.
You can use the
filesystem command to manually mount the Oracle ACFS file system.
When additional Oracle ACFS file systems are added to an Oracle Database after creation, they must be specified in the Oracle Database Resource Dependency list. Failure to do so results in errors with application reliability. To specify the file systems in the dependency list, use the SRVCTL database object command to modify the Oracle ACFS paths used by the resource.
Oracle ACFS file systems can be also configured for use as a home for applications. However, Oracle ACFS file systems cannot be used for an Oracle base directory or an Oracle Grid Infrastructure home that contains the software for Oracle Clusterware, Oracle ASM, Oracle ACFS, and Oracle ADVM components.
To reduce contention on an Oracle ACFS file system in an Oracle RAC environment where the Oracle Database home is shared on Oracle ACFS, Oracle Database auditing operating system files should be configured as node specific. For a node-specific setup, you must ensure that the
AUDIT_FILE_DEST initialization parameter in the configuration file of each database instance points to a unique location rather than one location for all the database instances.
For example, if you have a database with the Oracle name set to
TEST and you want to ensure that the location of
AUDIT_FILE_DEST initialization parameter for each database instance, such as
TEST2, points to a node specific location for that instance, you can run the following SQL statement:
SQL> ALTER SYSTEM SET AUDIT_FILE_DEST='$ORACLE_BASE/admin/adump/TEST/@' SCOPE=SPFILE SID='*';
In the previous example,
@ expands to the
ORACLE_SID of each instance. If
ORACLE_BASE has been set to
/acfsmounts in this example, then that value could have been used in place of the
Managing Oracle ACFS with Command-Line Tools for information about using Oracle ACFS commands to create a file system
Creating an Oracle ACFS File System for Database Use for information about using ASMCA
Creating Oracle ACFS Resources for additional information Oracle ACFS resources
Oracle Clusterware Administration and Deployment Guide and Oracle Real Application Clusters Administration and Deployment Guide for information about SRVCTL commands
Oracle Database Installation Guide for your environment for information about the installation of Oracle Database software and storage options and about Optimal Flexible Architecture (OFA) recommendations for Oracle base and home directories
Oracle Grid Infrastructure Installation Guide for your environment for information about the installation of Oracle Grid Infrastructure software and storage options
Oracle Database Administrator's Guide for information about using Oracle Managed files
Oracle Database Reference for information about the
About Oracle ASM Dynamic Volume Manager
The Oracle ASM Dynamic Volume Manager (Oracle ADVM) provides volume management services and a standard disk device driver interface to clients. File systems and other disk-based applications send I/O requests to Oracle ADVM volume devices as they would to other storage devices on a vendor operating system.
For more information about Oracle ADVM, refer to Overview of Oracle ASM Dynamic Volume Manager.
About the Oracle ACFS Driver Model
An Oracle ACFS file system is installed as a dynamically loadable vendor operating system (OS) file system driver and tool set that is developed for each supported operating system platform. The driver is implemented as a Virtual File System (VFS) and processes all file and directory operations directed to a specific file system.
Errors encountered by the drivers are written to the native operating system console and system event loggers. Refer to Understanding Oracle ACFS I/O Failure Console Messages.
About the Oracle ACFS Mount Registry
The Oracle ACFS mount registry supports Oracle Grid Infrastructure cluster configurations, but does not support Oracle Restart configurations.
File systems that are to be mounted persistently (across restarts) can be registered with the Oracle ACFS mount registry. In cluster configurations, registered Oracle ACFS file systems are automatically mounted by the mount registry, similar to a clusterwide mount table. However, in Oracle Restart configurations the automatic mounting of registered Oracle ACFS file systems is not supported.
By default, an Oracle ACFS file system that is inserted into the Oracle ACFS mount registry is automatically mounted on all cluster members, including cluster members that are added after the registry addition. However, the Oracle ACFS mount registry also accommodates standalone and multi-node (subset of cluster nodes) file system registrations. The mount registry actions for each cluster member mount only registered file systems that have been designated for mounting on that member.
The Oracle ACFS mount registry is implemented using Oracle Clusterware resources, specifically the Oracle ACFS resource. The Oracle ACFS resource actions are designed to automatically mount a file system only one time for each Oracle Grid Infrastructure initialization to avoid potential conflicts with administrative actions to dismount a given file system.
Oracle ACFS and Oracle Restart for more information about Oracle ACFS and Oracle Restart
acfsutil registry for information about registering an Oracle ACFS file system using the
Oracle Clusterware Resources and Oracle ACFS Administration for more information about the implementation of the mount registry and Oracle ACFS resources
Oracle Clusterware Administration and Deployment Guide and Oracle Real Application Clusters Administration and Deployment Guide for information about SRVCTL commands, including the
Oracle Clusterware Administration and Deployment Guide for information about Oracle Clusterware resources
About Oracle ACFS Snapshots
An Oracle ACFS snapshot is an online, read-only or read-write, point in time copy of an Oracle ACFS file system.
The snapshot copy is space-efficient and uses Copy-On-Write functionality. Before an Oracle ACFS file extent is modified or deleted, its current value is copied to the snapshot to maintain the point-in-time view of the file system.
Oracle ACFS snapshots are immediately available for use after they are created. The snapshots are created in the
.ACFS/snaps/ directory of the file system. They are always online while the file system is mounted. Consequently, an Oracle ACFS snapshot can support the online recovery of files inadvertently modified or deleted from a file system. An Oracle ACFS snapshot can also be used as the source of a file system backup, as it can be created on demand to deliver a current, consistent, online view of an active file system.
Up to 1023 read-only, read-write, or combination of read-only and read-write snapshot views are supported for each file system, enabling flexible online file recovery solutions spanning multiple views to be employed. On 64-bit systems, Oracle ACFS supports 1023 snapshots. The total number of snapshots can be any combination of read-only and read-write snapshots. To support the creation of more than 63 snapshots, the disk group compatibility attribute for
ADVM must be set to
18.104.22.168 or greater. Also, the following conditions must be met to create more than 63 snapshots.
All snapshots of the file system that were created with
COMPATIBLE.ADVMset to less than
22.214.171.124must be deleted.
All snapshots of the file system that were created after setting
126.96.36.199or greater while older snapshots existed must be deleted.
Oracle ACFS read-write snapshots enable fast creation of an snapshot image that can be both read and written without impacting the state of the Oracle ACFS file system hosting the snapshot images. You can use read-write snapshots for:
Testing of new versions of application software on production file data reflected in the read-write snapshot image without modifying the original production file system
Running test scenarios on a real data set without modifying the original production file system
To use Oracle ACFS read-write snapshots, the disk group compatibility attribute for
ADVM must be set to
188.8.131.52.0 or higher. If you create a read-write snapshot on an existing Oracle ACFS file system from a version earlier than
184.108.40.206.0, then the file system is updated to the
220.127.116.11.0 or higher format. After a file system has been updated to a higher version, an Oracle ACFS file system cannot be reverted to an earlier version, and accordingly cannot be mounted on an earlier Oracle Grid Infrastructure version.
You can create a snapshot from an existing snapshot in the same Oracle ACFS file system. In addition, you can convert a snapshot between read-only and read-write formats. To create from an existing snapshot or convert a snapshot, the disk group compatibility attribute for
ADVM must be set to
12.1 or higher. In addition, creation from an existing snapshot is not permitted if there are:
Any snapshots present in the file system that were created with the
ADVMcompatibility set to less than 12.1
Any snapshots of the file system that were created after
ADVMcompatibility was set to
12.1but while 11.2 snapshots existed
Oracle ACFS snapshot storage is maintained within the file system, eliminating the management of separate storage pools for file systems and snapshots. Oracle ACFS file systems can be dynamically resized to accommodate additional file and snapshot storage requirements.
You cannot modify encryption metadata in read-write snapshots except for enabling or disabling encryption. If a file is not encrypted in the snapshot, that file cannot be encrypted by encrypting the corresponding file in the active file system.
Files in a read-write snapshot can be encrypted, decrypted, or rekeyed if the operation target is a path specified for a file or directory of the read-write snapshot. However, if an encryption, decryption, or rekey operation is specified at the file system level, then the operation does not process files and directories of snapshots in the
All Oracle ACFS snapshot operations are serialized clusterwide in the kernel. For example, if a snapshot create operation is initiated at the same time as a snapshot delete operation, then both operations would complete, but they would not run in parallel inside of the kernel. One operation would complete before the other was started.
duplicate commands can be invoked manually to enable a target file system or writable snapshot to track the evolution of a source file system or snapshot with minimal overhead. Oracle ACFS updates the target after each apply operation to indicate its current contents, and checks before starting the next apply operation to ensure that the starting point of the incoming snapshot duplication stream matches the endpoint of the last-applied stream. The target remains writable by any and all applications even when it is in use by
apply . Oracle ACFS determines any updates to the target by a process other than the apply process, and if such an update occurs, invalidates the internal metadata that track the target contents. This prevents further apply operations to the target, and avoids the possibility of a future apply operation yielding unexpected results.
The use of the
duplicate commands interacts with Oracle ACFS replication operations. A target file system in use by
apply cannot be specified for use as a file system for replication. And a file system in use by replication cannot be specified as the target for
To run the
duplicate commands, the disk group compatibility attribute for
ADVM must be set to at least
acfsutil snap commands are available to manage duplicate snapshots and remaster an Oracle ADVM volume with an existing snapshot.
Oracle ACFS snapshots are administered with the
rename() system calls fail if an attempt is made to link or rename a file in the Oracle ACFS file system and a file in any associated read-write snapshot, or vice versa. Any tools which use the
rename() system calls, such as
mv, also fail in the same scenario.
acfsutil fshare create for information about creating a shared file (fshare) that functions as a file based snapshot
acfsutil snap create for additional information on the target used with the
Oracle ACFS Replication for information about Oracle ACFS replication
Oracle ACFS Encryption for information about Oracle ACFS encryption
Oracle ACFS Command-Line Tools for Snapshots for information about the
About Oracle ACFS and Backup and Restore
Oracle ACFS runs on operating system platforms as a native file system technology supporting native operating system file system application programming interfaces (APIs). Consequently, backup applications that access files using the native operating system file system interfaces are able to access and backup Oracle ACFS file systems and other native operating system file systems. Oracle ACFS snapshots can be dynamically created and used to present a consistent, on-line view of an active file system to a backup application.
Backup applications that use interfaces other than the standard operating system interfaces (read or write) are not supported with Oracle ACFS.
When Oracle ACFS is used with Oracle Recovery Manager (RMAN) backups or restore, you should tune RMAN to improve performance because the default values may not be ideal for Oracle ACFS file systems. For example, you can adjust RMAN parameters to match the buffer size with the volume stripe width or Oracle ASM AU size. Also, you can adjust the number of buffers to match the number of devices in the Oracle ASM disk group.
Oracle ACFS Tagging for information about using common operating system utilities to preserve Extend Attributes for tagging definitions
Oracle Automatic Storage Management Administrator's Guide for information about
md_restorefor backing up and restoring Oracle ACFS metadata
My Oracle Support (
https://support.oracle.com) for articles about tuning RMAN tuning, such as RMAN Performance Tuning Using Buffer Memory Parameters (Doc ID 1072545.1) and RMAN Performance Troubleshooting (Doc ID 1326686.1)
About Oracle ACFS Integration with Oracle ASM
Oracle ACFS is always configured with Oracle ASM storage and interfaces with Oracle ASM storage through a traditional device file. This device file is presented by Oracle ADVM and is constructed using a dynamic volume file. The Oracle ADVM volume device file is created automatically following the creation of an Oracle ADVM volume. An Oracle ACFS file system is then bound to the Oracle ADVM device file during the file system creation.
After an Oracle ACFS is configured and mounted, the file system inherits the Oracle ASM storage management features associated with an Oracle ADVM volume, including dynamic balanced distribution, mirroring and striping, and dynamic resizing.
The Oracle ACFS driver establishes communication with the Oracle ASM instance to receive Oracle ASM status information including Oracle ASM instance and disk group state transitions. However, I/O does not go through Oracle ASM nor through the Oracle ASM proxy, but rather goes directly to the underlying Oracle ASM storage.
For information about Oracle ACFS and Oracle ASM operations, refer to Oracle ACFS and Dismount or Shutdown Operations.