JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Oracle Solaris Cluster Geographic Edition System Administration Guide     Oracle Solaris Cluster 4.1
search filter icon
search icon

Document Information


1.  Introduction to Administering the Geographic Edition Software

2.  Before You Begin

3.  Administering the Geographic Edition Infrastructure

4.  Administering Access and Security

5.  Administering Cluster Partnerships

6.  Administering Heartbeats

Introduction to Heartbeats

Creating a Heartbeat

How to Create a Heartbeat

Creating a Heartbeat Plug-in

How to Create Heartbeat Plug-in

Modifying a Heartbeat Plug-in Property

How to Modify the Properties of a Heartbeat Plug-in

Deleting Heartbeats and Heartbeat Plug-ins

How to Delete a Heartbeat

How to Delete a Plug-in From a Heartbeat

Displaying Heartbeat Configuration Information

How to Display Heartbeat Configuration Information

Tuning the Heartbeat Properties

How to Modify the Heartbeat Properties

Creating a Heartbeat That Uses a Custom Heartbeat Plug-in

Creating a Custom Heartbeat Plug-in

How to Add a Custom Heartbeat Plug-in to an Existing Default Heartbeat

How to Create a Custom Heartbeat Plug-in and Add It to a Custom Heartbeat

Configuring Heartbeat-Loss Notification

Introduction to Configuring Heartbeat-Loss Notification

Configuring the Heartbeat-Loss Notification Properties

Creating an Action Shell Script for Heartbeat-Loss

7.  Administering Protection Groups

8.  Monitoring and Validating the Geographic Edition Software

9.  Customizing Switchover and Takeover Actions

10.  Script-Based Plug-Ins

A.  Standard Geographic Edition Properties

B.  Legal Names and Values of Geographic Edition Entities

C.  Disaster Recovery Administration Example

D.  Takeover Postconditions

E.  Troubleshooting Geographic Edition Software

F.  Deployment Example: Replicating Data With MySQL

G.  Error Return Codes for Script-Based Plug-Ins


Configuring Heartbeat-Loss Notification

This section contains the following information:

Introduction to Configuring Heartbeat-Loss Notification

You can configure the Geographic Edition software to send email notification and to run an action script when a heartbeat is lost. You configure heartbeat-loss notification by using the optional Notification_emailaddrs and Notification_actioncmd properties.

Heartbeat-loss notification occurs if the heartbeat still fails after the interval you configure with the Query_interval property of the heartbeat. The heartbeat monitor sends out a heartbeat request to the responder on the logical host every Query_interval period. If no response is received within the Query_interval, an internal count is incremented. If the recount reaches the number that is specified in the heartbeat.retries property, the heartbeat is deemed to have failed.

For example, you can use the default Query_interval of 120 seconds and the default heartbeat.retries of 3. The heartbeat-lost event will be sent a maximum of 10 minutes after the last heartbeat response from the partner cluster.

120sec (delay since last query) + 3*120sec (wait for normal response) 
+ 120 sec (wait for retry response)

Delays can occur between the generation of the heartbeat-loss event and the triggering of the heartbeat-loss notification.

Note - A heartbeat-loss event does not necessarily indicate that the remote cluster has crashed.

The following sections describe how to configure the heartbeat-loss notification properties and how to create a custom action script that the Geographic Edition software runs after a heartbeat-loss event.

Configuring the Heartbeat-Loss Notification Properties

You can configure heartbeat-loss notification by using two partnership properties, Notification_emailaddrs and Notification_actioncmd. You specify these properties by using the geops command.

You can specify these properties on the default heartbeat during partnership creation. For more information, see How to Create a Partnership. You can also modify these properties by using the procedure that is described in How to Modify the Heartbeat Properties.

If you want to be notified of heartbeat loss by email, set the Notification_emailaddrs property. You can specify a list of email addresses, separated by commas. If you want to use email notification, the cluster nodes must be configured as email clients. For more information about configuring mail services, see Chapter 2, Mail Services (Tasks), in Managing sendmail Services in Oracle Solaris 11.1.

If you want to run a command in response to heartbeat loss, set the Notification_actioncmd property.

Example 6-10 Configuring Heartbeat-Loss Notification for an Existing Partnership

This example specifies a notification email address and a custom notification script for the partnership, paris-newyork-ps.

phys-paris-1# geops set-prop \
-p, \
-p Notification_actioncmd=/opt/ paris-newyork-ps

Creating an Action Shell Script for Heartbeat-Loss

You can create an action shell script that runs when the local cluster detects a heartbeat-loss in the partner cluster. The script runs with root permissions. The file must have root ownership and execution permissions, but the script should not have write permissions.

If you have configured the Notification_actioncmd property, the action command runs with arguments that provide information about the event in the following command line:

# customactioncommandpath -c localclustername -r remoteclustername -e 1 \
-n nodename -t time

Specifies a path to the action command you have created.

-c localclustername

Specifies the name of the local cluster.

-p remoteclustername

Specifies the name of the remote partner cluster.


Specifies that HBLOST=1, which indicates that a heartbeat-loss event has occurred. The Geographic Edition software only supports heartbeat-loss notification, so -e 1 is the only value that can be passed to the action shell script.


Specifies the name of the cluster node that sent the heartbeat-loss event notification.

-t timestamp

Specifies the time of the heartbeat-loss event as the number of milliseconds since January 1, 1970, 00:00:00 GMT.


Caution - You can use this script to perform an automatic takeover on the secondary cluster. However, such an automated action is risky. If the heartbeat-loss notification is caused by a total loss of all heartbeat connectivity on both the primary and secondary clusters, such an automated action could lead to a situation where two primary clusters exist.

Example 6-11 How a Notification Action Script Parses the Command-Line Information Provided by the Geographic Edition Software

This example displays the event information that is provided in the command-line being parsed in a notification action shell script.


set -- `getopt abo: $*`
if [ $? != 0]
      echo $USAGE
      exit 2

for i in $*

      case $i in
      -p)      PARTNER_CLUSTER=$1; shift;;
      -e)      HB_EVENT=$2; shift;;
      -c)      LOCAL_CLUSTER=$3; shift;;
      -n)      EVENT_NODE=$4; shift;;