3 Oracle Extended Clusters
You can extend an Oracle RAC cluster across two, or more, geographically separate sites, each equipped with its own storage.
Note:
Starting with Oracle Grid Infrastructure 23ai, Domain Services Clusters (DSC), which is part of the Oracle Cluster Domain architecture, are desupported.
Oracle Cluster Domains consist of a Domain Services Cluster (DSC) and Member Clusters. Member Clusters were deprecated in Oracle Grid Infrastructure 19c. The DSC continues to be available to provide services to production clusters. However, with most of those services no longer requiring the DSC for hosting, installation of DSCs are desupported in Oracle Database 23ai. Oracle recommends that you use any cluster or system of your choice for services previously hosted on the DSC, if applicable. Oracle will continue to support the DSC for hosting shared services, until each service can be used on alternative systems.
About Oracle Extended Clusters
An Oracle Extended Cluster consists of nodes that are located in multiple locations called sites. In the event that one of the sites fails, the other site acts as an active standby.
Both Oracle ASM and the Oracle Database stack, in general, are designed to use enterprise-class shared storage in a data center. Fibre Channel technology, however, enables you to distribute compute and storage resources across two or more data centers, and connect them through ethernet cables and Fibre Channel, for compute and storage needs, respectively.
While you can configure Oracle Extended Clusters when you install Oracle Grid Infrastructure, you can also do so post installation using the ConvertToExtended
script. You manage your Oracle Extended Cluster using CRSCTL.
Configuring Oracle Extended Clusters
This procedure is only supported for clusters that have been installed with or upgraded to Oracle Grid Infrastructure 12c release 2 (12.2), or later, which are typically configured with one site (default site).
Note:
This procedure requires that all nodes in the cluster be accessible. There will also be a cluster outage during which time database access is disrupted.ConvertToExtended
script you can create multiple data sites and associate a node with each data site. All Oracle Flex ASM storage remains associated with the default cluster site because there is no mechanism to convert an existing disk group to an extended disk group. After you convert your cluster to an Oracle Extended Cluster, the voting file membership remains flat, and not hierarchical.
$ crsctl get cluster extended
CRS-6579: The cluster is 'NOT EXTENDED'
$ crsctl query cluster site -all
Site 'crsclus' identified by '7b7b3bef4c1f5ff9ff8765bceb45433a' in state 'ENABLED',
and contains nodes 'node1,node2,node3,node4', and disks ''.
The preceding example identifies a cluster called crsclus
that has four nodes—node1
, node2
, node3
, and node4
—and a disk group—datadg
. The cluster has one site configured.
cssd
, and crsd
from considering the cluster mode is not extended, and other components to consider that it is extended. The advantage to keeping the Grid Plug and Play daemon (gpnpd
) online is that the profile gets updated on the remote nodes. When you next start the Oracle Clusterware stack, the cluster mode will be extended.# crsctl stop cluster -all
-
Extend the cluster to the specific node, as follows:
$ rootcrs.sh -converttoextended -site site_name
-
Ensure that CSS is not running on any remote nodes.
-
Look up new sites and the site GUIDs using the previous checkpoint information.
-
Add sites to the local configuration, as follows:
$ crsctl add crs site site_name -guid site_guid -local
-
Update the to-site mapping in the local configuration for this node, as follows:
$ crsctl modify cluster site site_name -n local_host -local
-
Stop and then start the Oracle High Availability Services stack, as follows:
# crsctl stop crs # crsctl start crs
$ crsctl get cluster extended
CRS-XXXX: The cluster is 'EXTENDED'
$ crsctl query cluster site -all
Site 'crsclus' identified by '7b7b3bef4c1f5ff9ff8765bceb45433a' is 'ONLINE', and
contains nodes '', and disks ''.
Site 'ny' identified by '888b3bef4c1f5ff9ff8765bceb45433a' is 'ONLINE', and \
contains nodes 'node1,node2', and disks ''.
Site 'nj' identified by '999b3bef4c1f5ff9ff8765bceb45433a' is 'ONLINE', and \
contains nodes 'node3,node4', and disks ''.
The output in the preceding command examples is similar to what CRSCTL displays when you run the commands.