The Role of tm.watchd

tm.watchd is the cluster watcher daemon. It runs on the master node and monitors the states of cluster resources and jobs and, as necessary:

• Marks individual nodes as online or offline by periodically executing remote procedure calls (RPCs) to all of the nodes.

• Clears stale resource database (rdb) locks.

• If the -Yk option has been enabled, aborts jobs that have processes on nodes determined to be down. This option is disabled by default.