JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Oracle Solaris Cluster Error Messages Guide     Oracle Solaris Cluster
search filter icon
search icon

Document Information

Preface

1.  Introduction

2.  Error Messages

Message IDs 100000-199999

Message IDs 200000-299999

Message IDs 300000-399999

Message IDs 400000-499999

Message IDs 500000-599999

Message IDs 600000-699999

Message IDs 700000-799999

Message IDs 800000-899999

Message IDs 900000-999999

Message IDs 300000–399999

This section contains message IDs 300000–399999.

300397 resource %s property changed.

Description: This is a notification from the rgmd that a resource's property has been edited by the cluster administrator. This message can be used by system monitoring tools.

Solution: This is an informational message; no user action is needed.

300512 Failed to stop DNS; exiting UNSUCCESFUL

Description: The STOP method was unable to stop the application by sending it a SIGKILL.

Solution: Examine the /var/adm/messages to determine why the resource failed to stop. If problem persists, contact your Oracle service representative.

300537 scvxvmlg error - lstat(%s) failed with errno %d

Description: The program responsible for maintaining the VxVM namespace was unable to access the global device namespace. If configuration changes were recently made to VxVM diskgroups or volumes, this node may be unaware of those changes. Recently created volumes may be unaccessible from this node.

Solution: Verify that the /global/.devices/node@N (N = this node's node number) is mounted globally and is accessible. If no configuration changes have been recently made to VxVM diskgroups or volumes and all volumes continue to be accessible from this node, then no further action is required. If changes have been made, the device namespace on this node can be updated to reflect those changes by executing '/usr/cluster/lib/dcs/scvxvmlg'. If the problem persists, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

300538 set_scproxy_resource - Oracle Grid Infrastructure resource %s has PLACEMENT=%s which is incorrect, PLACEMENT=restricted is required.

Description: The Oracle Grid Infrastructure resource sun.<resource> PLACEMENT attribute value is incorrect.

Solution: You must set the PLACEMENT attribute of the Oracle Grid Infrastructure resource, sun.<resource>, equal to restricted. Note that <resource> represents the Oracle Solaris Cluster SUNW.ScalDeviceGroup resource name. Refer to the Oracle Solaris Cluster documentation for information on how to do this.

300705 Failed to look up the service group.

Description: Failed to look up the internal data structure during connection establishment.

Solution: The connection involved might be disconnected. If it happens repeatedly contact your authorized Oracle service provider to determine whether a workaround or patch is available.

300721 Error: The resource group "%s" nodelist "%s" is not the same as the existing RAC framework resource group "%s" nodelist "%s".

Description: VUCMM framework resources must be created in a resource group that has the same nodelist as an existing RAC framework when either a SVM or CVM resource is present in both frameworks.

Solution: Resolve the nodelist discrepancy and re-try the operation. Refer to the Oracle Solaris Cluster documentation for procedures to configure a resource group.

300777 reservation warning(%s) - Unable to open device %s, errno %d, will retry in %d seconds

Description: The device fencing program has encountered errors while trying to access a device. The failed operation will be retried

Solution: This is an informational message, no user action is needed.

301092 file specified in ENVIRONMENT_FILE parameter %s does not exist.

Description: The 'Environment_File' property was set when configuring the resource. The file specified by the 'Environment_File' property may not exist. The file should be readable and specified with a fully qualified path.

Solution: Specify an existing file with a fully qualified file name when creating a resource.

301114 Command failed: /bin/rm -f %s/ppid/%s

Description: An attempt to remove the directory and all the files in the directory failed. This command is being executed as the user that is specified by the extension property DB_User.

Solution: No action is required.

301149 %s: unable to create failfast object.

Description: The pmmd program was not able to register with failfast.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

301162 zc_rgm_halt for zone %s: Exception <%s> thrown while querying membership. Exiting.

Description: An exception was thrown when zc_rgm_halt queried for the membership of the zone cluster, and thus zc_rgm_halt failed to check whether the zone is part of the zone cluster membership or not. Hence zc_rgm_halt will not be able to evacuate resource groups for this zone which belongs to a zone cluster. Support for this zone cluster might not work properly.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

301573 clcomm: error in copyin for cl_change_flow_settings

Description: The system failed a copy operation supporting a flow control state change.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

301603 fatal: cannot create any threads to handle switchback

Description: The rgmd daemon was unable to create a sufficient number of threads upon starting up. This is a fatal error. The rgmd will produce a core file and will force the node to halt or reboot to avoid the possibility of data corruption.

Solution: Make sure that the hardware configuration meets documented minimum requirements. Save a copy of the /var/adm/messages files on all nodes, and of the rgmd core file. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

301621 Cannot access file %s. This file is required to bypass the user credentials from being prompted during the server startup: %s

Description: The boot.properties file does not exist in in the server root's security directory.

Solution: Make sure that the boot.properties file is present in the server root's security directory. Read documentation for more details.

301635 clexecd: close returned %d. Exiting.

Description: clexecd program has encountered a failed thr_create(3THR) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

301685 The file system mount point %s information is missing from the /etc/vfstab file of the global zone. This file system could be original file system for the lofs file system with mount point %s configured to zone cluster %s.

Description: HAStoragePlus failed to find the specified entry in the vfstab.

Solution: Update the vfstab entry and retry the operation.

301736 start_dependency: Exceeded ${MAX_START_TIMEOUT} seconds for waiting on dependent resource for resource ${RESOURCE} to come online

Description: The Start_timeout for the dependent resource is exceeded.

Solution: Specify a larger timeout.

302040 clcomm: ksocket creation on routing socket failed with error = %d

Description: The system prepares IP communications across the private interconnect. A lookup operation on the routing socket failed.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

302286 Incorrect specification of tunable at line %d in file %s.

Description: The zone handler detected that key=value pair is not specified in appropraite manner.

Solution: Check the line number and ensure that tunables are kept in the format 'key'='value'.

302394 set_scproxy_resource - Oracle Grid Infrastructure resource %s has CARDINALITY=%s which is incorrect, CARDINALITY=%s is required.

Description: The Oracle Grid Infrastructure resource sun.<resource> CARDINALITY attribute value is incorrect.

Solution: You must set the CARDINALITY attribute of the Oracle Grid Infrastructure resource, sun.<resource>, equal to number of nodes listed within the Oracle Solaris Cluster resource group's nodelist that contains the Oracle Solaris Cluster SUNW.ScalDeviceGroup resource. Note that <resource> represents the Oracle Solaris Cluster SUNW.ScalDeviceGroup resource name. Refer to the Oracle Solaris Cluster documentation for information on how to do this.

302670 udlm_setup_port: fcntl: %d

Description: A server was not able to execute fnctl(). udlm exits and the node aborts and panics.

Solution: This is an internal error. Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your Oracle service representative.

303009 validate: EnvScript %s does not exist but it is required

Description: The environment script $Filename is set in the parameter file but does not exist.

Solution: set the variable EnvScript in the parameter file mentioned in option -N of the start, stop and probe command to a valid contents.

303231 mount_client_impl::remove_client() failed attempted RM change_repl_prov_status() to remove client, spec %s, name %s

Description: The system was unable to remove a PXFS replica on the node that this message was seen.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

303502 Logical changepw principal does not exist in %s.

Description: The logical host name associated with the "changepw" service principal does not exist in the /etc/krb5/kadm5.keytab file.

Solution: Create and/or add the "changepw/<logical host name>" service principal's keys in the /etc/krb5/kadm5.keytab file. Note: that the logical host name must be fully qualified.

303630 Cannot execute %s: %d.

Description: Failure in executing the command.

Solution: Check the syslog message for the command description. Check whether the system is low in memory or the process table is full and take appropriate action. Make sure that the executable exists.

303756 CMM: Unable to get reference to membership API object.

Description: An instance of the userland CMM encountered an internal initialization error. The userland CMM could not obtain a reference to the membership API object.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

303805 Cannot change the IPMP group on the local host.

Description: A different IPMP group for property NetIfList is specified in clreslogicalhostname command. The IPMP group on local node is set at resource creation time. Users may only update the value of property NetIfList for adding a IPMP group on a new node.

Solution: Rerun the clreslogicalhostname command with proper value for the NetIfList property.

303848 Failed to modify the START_DEPENDENCIES of the Oracle Grid Infrastructure %s resource [%s]

Description: Failed to modify the Oracle Grid Infrastructure database resource START_DEPENDENCIES.

Solution: Determine why modifying the database resource failed. If the problem persists, contact your Oracle support representative for further assistance.

303912 The original file system with mount point %s specified in the /etc/vfstab of a global zone for the lofs file system with mount point %s configured for the zone cluster %s is a local file system. Local file systems cannot be specified with scalable service resources.

Description: HAStoragePlus detected an inconsistency in its configuration: the resource group has been specified as scalable, but local file systems are used.

Solution: Correct either the resource group type or use global file systems.

304134 Validation of file system mount point %s configured to zone cluster %s has failed.

Description: The information for the specified mount point in the zone cluster is incorrect.

Solution: Check the entries and modify them with valid values.

304365 clcomm: Could not create any threads for pool %d

Description: The system creates server threads to support requests from other nodes in the cluster. The system could not create any server threads during system startup. This is caused by a lack of memory.

Solution: There are two solutions. Install more memory. Alternatively, take steps to reduce memory usage. Since the creation of server threads takes place during system startup, application memory usage is normally not a factor.

304749 Probe for resource sckrb5 successful.

Description: The complete or simple probe for the HA-KDC service has completed successfully.

Solution: This is for informational purposes only, no action is required.

304836 check_ids - Database Instance %s is down

Description: The Informix Server database is down.

Solution: None required. Oracle Solaris Cluster will restart the Informix Server.

305163 Start of HADB database completed successfully.

Description: The resource was able to successfully start the HADB database.

Solution: This is an informational message, no user action is needed.

305298 cm_callback_impl abort_trans: exiting

Description: ucmm callback for abort transition failed.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

305895 ucmmd got invalid upgrade callback from version manager: version %d.%d higher than highest version

Description: Version manager delivered upgrade callback to ucmmd about a new version that is higher than the highest version supported by ucmmd.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

306407 Failed to stop Adaptive server.

Description: Oracle Solaris Cluster HA for Sybase failed to stop using KILL signal.

Solution: Please examine whether any Sybase server processes are running on the server. Please manually shutdown the server.

306483 scf_transaction_property_change failed error %d: %s

Description: An API call failed.

Solution: Examine log files and syslog messages to determine the cause of the failure. Take corrective action based on any related messages. If the problem persists, report it to your Oracle support representative for further assistance.

306560 INTERNAL ERROR: Failed to get nodename of zone %s : %s.

Description: Failed to get the node name.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

307195 clcomm: error in copyin for cl_read_flow_settings

Description: The system failed a copy operation supporting flow control state reporting.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

307322 Unable to create thread. Exiting.

Description: clexecd program has encountered a failed thr_create(2) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

307531 open: %s

Description: open failed for the specified reason. The specified program will be terminated and this zone will not be able to host applications.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

307657 Oracle UDLM package is not installed. %s not found.

Description: Oracle UNIX Distributed Lock Manager (UDLM) is not properly installed on this node. The UDLM reconfiguration program could not locate the lock manager binary at the location indicated in the message. Oracle OPS/RAC will not be able to function on this node.

Solution: If you want to run OPS/RAC on this cluster node, verify installaton of ORCLudlm package. Refer to Oracle's documentation for installaton of Oracle UDLM.

307834 CCR: Invalid CCR table : %s cluster %s.

Description: CCR could not find a valid version of the indicated table on the nodes in the cluster.

Solution: There may be other related messages on the nodes where the failure occurred. They may help diagnose the problem. If the indicated table is unreadable due to disk failure, the root disk on that node needs to be replaced. If the table file is corrupted or missing, boot the cluster in -x mode to restore the indicated table from backup. The CCR tables are located at /etc/cluster/ccr/.

308041 scha_control RESOURCE_RESTART failed

Description: scha_control RESOURCE_RESTART failed

Solution: Determine why the scha_control RESOURCE_RESTART failed. If the problem persists, contact your Oracle support representative for further assistance.

308100 Validate - Couldn't retrieve Samba version number

Description: The Samba resource tries to validate that an acceptable version of Samba is being deployed, however it was unable to retrieve the Samba version number.

Solution: Check that Samba has been installed correctly

308378 Derby data service stop method returned with error %s

Description: The derby data service could not stop for an unknown reason.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

308814 CCR: Updating table %s failed to startup on node %s for cluster %s.

Description: The operation to update the indicated table failed to start on the indicated node.

Solution: There may be other related messages on the nodes where the failure occurred, which may help diagnose the problem. If the root disk failed, it needs to be replaced. If the indicated table was deleted by accident, boot the offending node(s) in -x mode to restore the indicated table from other nodes in the cluster. The CCR tables are located at /etc/cluster/ccr/. If the root disk is full, remove some unnecessary files to free up some space.

308975 Resource type "%s" does not exist.

Description: The SUNW.qfs resource type is not registered in the cluster.

Solution: Register the SUNW.qfs resource type, create the required instances of this resource type, and repeat the operation. For information about how to configure the shared QFS file system with Oracle Cluster, see your Oracle Solaris Cluster documentation and your SunQFS documentation.

309159 stop_dgproxy - Oracle ASM instance (%s) diskgroup (%s) is connected and remains mounted

Description: The Oracle ASM diskgroup is connected to a database and has not been dismounted.

Solution: None required. Informational message.

309394 stop_ndbd_shutdown: The restart -n was suspended by touching the noop file /tmp/%s_noop

Description: Because of the exitence of the shutdown controllers noop file there was no restart -n performed.

Solution: None

309609 Failed to validate the accessibility of the adapters in the zone cluster.

Description: There is no adapter found on this system that is authorized to be used for this zone cluster.

Solution: Use the clzonecluster(1M) command to configure the adapters to be used for this zone cluster and run the command to create the resource.

309961 Error during reading the property from repository %s

Description: There was an error in reading the property of the SMF service instance from the repository

Solution: Check the SMF manpage to know more about the error.Also make sure the basic SMF functionalities are working fine.Contact SUN vendor for more help.

310084 scal_initialize() call failed.

Description: There was an error in initializing.

Solution: Contact your authorized Oracle service provider for assistance in diagnosing the problem.

310098 The SUNW.wait_zc_boot resource can be configured in scalable resource group only.

Description: SUNW.wait_zc_boot resource is not configured in a scalable resource group.

Solution: Add this resource to a scalable resource group.

310555 CMM: Quorum device %d (%s) added; votecount = %d, bitmask of nodes with configured paths = 0x%llx.

Description: The specified quorum device with the specified votecount and configured paths bitmask has been added to the cluster. The quorum subsystem treats a quorum device in maintenance state as being removed from the cluster, so this message will be logged when a quorum device is taken out of maintenance state as well as when it is actually added to the cluster.

Solution: This is an informational message, no user action is needed.

310953 clnt_control of program %s failed %s.

Description: HA-NFS fault monitor failed to reset the retry timeout for retransimitting the rpc request.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

311129 Failed to retrieve IP address for %s

Description: Cluster cannot generate a callback for the RDS module. Operation of RDS sockets might be affected.

Solution: If Reliable Datagram Sockets (RDS) is used by applications running on this cluster, contact your Oracle Microsystems service representative to determine if a workaround or patch is available.

311275 Volume %s in disk group %s is not ENABLED

Description: One of the volumes being monitored is not in an enabled state.

Solution: Check state of the volume. Contact your authorized Oracle service provider for further assistance.

311291 sema_post badchild: %s

Description: The rpc.pmfd server was not able to act on a semaphore. The message contains the system error. The server does not perform the action requested by the client, and an error message is output to syslog.

Solution: Determine if the machine is running out of memory. If this is not the case, save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

311505 The resource group %s containing the resource %s is suspended. This has blocked a resource %s attempt on %s

Description: The operation requested by scha_control is prevented because the resource group is suspended.

Solution: No action required. To enable automatic recovery actions, use 'clresourcegroup resume'

311644 fork_event depth: ct_pr_event_get_pid: %s

Description: The rpc.pmfd was unable to retrieve the pid from a contract event. The rpc.pmfd will continue to monitor the process, but the rpc.pmfd may have missed an event of interest.

Solution: Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Oracle service provider.

312053 Cannot execute %s: %s.

Description: Failure in executing the command.

Solution: Check the syslog message for the command description. Check whether the system is low in memory or the process table is full and take appropriate action. Make sure that the executable exists.

312124 Failed to establish socket's default destination: %s

Description: Default destination for a raw icmp socket could not be established.

Solution: If the error message string thats logged in this message does not offer any hint as to what the problem could be, contact your authorized Oracle service provider.

312406 setproject call failed : %s

Description: setproject call failed. Should never occur.

Solution: Verify project database. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

312826 The Skgxn Service which provides Oracle RAC support in the ucmmd daemon encountered a non-recoverable error and must abort

Description: The Oracle RAC clustered database relies on the Skgxn Service provided by the ucmmd daemon for group membership services and will not function without it. The Skgxn Service has encountered a non-recoverable error and could not provide service.

Solution: Save copies of /var/adm/messages and /var/cluster/ucmm/ucmm_reconf.log files from all of the nodes in the cluster. Check for and save any core files of the ucmmd daemon or operating system. Contact your authorized Oracle service provider for assistance in diagnosing the problem. Please provide to them the saved files which are mentioned above.

312913 zc_acfs_boot: Zone boot operation completed successfully.

Description: The zone boot handler successfully brought the resource containing the SUNW.wait_zc_boot resource online.

Solution: This is an informational message; no user action is needed.

313017 Membership : Failure in notifying membership subsystem that zone %s went down, exception <%s> thrown.

Description: Failed to notify the cluster membership infrastructure that a zone cluster node went down. Support for the zone cluster might not work properly.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

313500 Probe - Fatal: Can't determine Schedd pid file - %s/schedd/schedd.pid does not exist.

Description: The file ${qmaster_spool_dir}/schedd.pid was not found. ${qmaster_spool_dir}/schedd.pid is the second argument to the 'Shutdown' function. 'Shutdown' is called within the stop script of the sge_schedd resource.

Solution: Confirm the file 'schedd.pid' exists. Said file should be found in the respective spool directory of the daemon in question.

313506 stop_chi - WebSphere MQ Channel Initiator %s stopped

Description: The specified WebSphere MQ Channel Initiator has been stopped.

Solution: None required. Informational message.

313510 SAP xserver is not available.

Description: SAP xserver is not running currently.

Solution: Informative message, no action is required.

313784 Admin Disable is been called. The stop method of the service will be called and outcome is unknown.For proper functioning of the res, continue by disable the resource first

Description: This message comes when user does "svcadm disable". Since manual "disabling" of a service is not encouraged once the service

Solution: Check for the validity and the states of resource and services.Contact SUN vendor for more help.But this should not be a problem in normal operation of the delegated restarter

313801 check_pgs: The host %s is not accessible, a failover will occur

Description: The address specified in the PGHOST variable is unavailable.

Solution: None, a failover will occur

313867 Unknown step: %s

Description: Request to run an unknown reconfiguration step.

Solution: No user action is needed.

314033 Server still running. Sleeping for 5 sec.

Description: We are allowing pmon some time to finish its work and exit cleanly.

Solution: None.

314073 validate_asm - %s/bin/crsctl either does not exist or is not executable

Description: ${CRS_HOME}/bin/crsctl either does not exist or is not a executable

Solution: Ensure that ${CRS_HOME} represents the directory where the Oracle Clusterware files are installed.

314185 Switchover error (%s): cannot find clexecd

Description: The file system specified in the message could not be hosted on the node the message came from. Check to see if the user program "clexecd" is running on that node.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

314314 prog <%s> step <%s> terminated due to receipt of signal <%d>

Description: ucmmd step terminated due to receipt of a signal.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified and if it recurs. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance.

314356 resource %s enabled.

Description: This is a notification from the rgmd that the operator has enabled a resource. This message can be used by system monitoring tools.

Solution: This is an informational message; no user action is needed.

314358 Command %s failed to complete. Return code is %d.

Description: The listed command failed to complete with the listed return code. The return code is from the script db_clear.

Solution: Look for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Oracle service provider.

314460 stop_pgs: Allow pmf to stop the remaining ssh-agent for the user %s

Description: It can not be determined which ssh agent is working for the user/database, it is now killed by PMF using the configured stop signal.

Solution: None

314502 Resources of type ScalDeviceGroup and ScalMountPoint must only be configured for nodes in the global zone, or nodes in a zone cluster

Description: Resources of type ScalDeviceGroup and ScalMountPoint are supported only in the global zone or in zones that are members of a zone cluster.

Solution: This is an unsupported configuration. Reconfigure the cluster so that resources of type ScalDeviceGroup and ScalMountPoint are not in non-global zones unless the non-global zone is a member of a zone cluster.

314706 Failed to do lstat() on test-file %s : %s

Description: The lstat() operation on the test file for I/O operations failed. One possible cause of this error is that the test file has been deleted. The deletion of this file might be caused by malicious activity in your system.

Solution: Restart the ScalMountPoint resource.

314877 Domain %s failed to shutdown immediately.

Description: The /usr/bin/virsh destroy command failed.

Solution: Determine why it was not possible to immediately terminate the domain.

314991 validate_common - The Oracle user %s does not belong to project %s

Description: The userid does not belong to the specified project.

Solution: Ensure the userid exists within the project. Check that you have the correct userid and project name.

315207 Failed to execute %s on %s. optval = %d

Description: Attempt to execute a command on a remote cluster node failed.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

315333 Function: stop_mysql - clrs disable for (%s) was unsuccessful

Description: The clrs disable of the MySQL replication resource was unsuccessfull

Solution: Examine the /var/adm/messages for the additional error messages and fix the root cause

315446 node id <%d> is out of range

Description: The low-level cluster machinery has encountered an error.

Solution: Look for other syslog messages occurring just before or after this one on the same node; they may provide a description of the error.

315699 mc_multi_openconn failed to open connection.

Description: Failed to allocate memory during connection establishment for an SCTP non-sticky service.

Solution: Install more memory, increase swap space, or reduce peak memory consumption.

315729 WARNING: Unable to get privatelink IP address for nodeid %d

Description: Call to get privatelink IP address for node failed.

Solution: Make sure entries in /etc/nsswitch.conf are correct to get information about this node.

316625 Timeout monitoring on method tag <%s> has been %s.

Description: The timeout monitoring on the running method is being suspended or resumed because a device group switchover has started or finished respectively.

Solution: This is just an informational message.

316649 pthread_rwlock_unlock err %d line %d

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

316916 zc_acfs_boot: Skipping the execution of the boot handler as the zone is coming up as part of physical node boot and the ACFS file systems will be mounted by RGM.

Description: The handler has detected that this is first boot of the zone.

Solution: This is an informational message; no user action is needed.

316965 % has requested a domain restart %s.

Description: The domain probe has requested a domain restart.

Solution: None. A domain restart will be attempted.

317213 in libsecurity for program %s (%lu); setnetconfig failed: %s

Description: The specified server was not able to initiate an rpc connection, because it could not get the network database handle. The server does not start. The rpc error message is shown. An error message is output to syslog.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

317215 validate_affinity_set - The Oracle ASM resource group (%s) has not set rg_affinities=++%s

Description: The clustered Oracle ASM instance resource group or Oracle ASM disk group resource group is missing a rg_affinities entry against the CRS resource group or Oracle ASM instance resource group respectively.

Solution: Ensure that RG_affinities is set.

317928 dbmcli option (%s) is not 'db_warm' nor 'db_online'.

Description: The extension property in the message is set to an invalid value.

Solution: Change the value of the extension property to a valid value.

318011 in libsecurity for program %s (%lu); file registration failed for transport %s

Description: A server (rpc.pmfd, rpc.fed or rgmd) was not able to create the "cache" file to duplicate the rpcbind information. The server should still be able to receive requests from clients (using rpcbind). An error message is output to syslog.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

318313 monitor_check: set_env_vars() failed for resource <%s>, resource group <%s>, node <%s>

Description: During execution of a scha_control(1HA,3HA) function, the rgmd daemon was unable to set up environment variables for method execution, causing a MONITOR_CHECK method invocation to fail. This in turn will prevent the attempted failover of the resource group from its current master to a new master.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

319129 The entry in /etc/vfstab of the zone cluster %s for file system mount point %s is incorrect: %s.

Description: The format of the entry for the specified mount point in the specified file is invalid.

Solution: Edit the file (usually /etc/vfstab) and check that entries conform to its format.

319261 liveCache %s failed to start.

Description: liveCache started up with error.

Solution: Oracle Solaris Cluster will fail over the liveCache resource to another available node. No user action is needed.

319374 Incoming argument size is zero.

Description: An internal error has occurred in the inter-process communication between rgmd and another clustering process. Other related error messages might precede or follow this one in the syslog output.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

319375 clexecd: wait_for_signals got NULL.

Description: clexecd problem encountered an error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

319413 Siebel server can be started only after Siebel database and Siebel gateway are running, and the scsblconfig file is correctly configured.

Description: This is a warning message indicating a problem in determining the status of Siebel database and/or the Siebel gateway.

Solution: Please verify that the scsblconfig file is correctly configured, and that the Siebel database and Siebel gateway are up before attempting to start the Siebel server.

319602 daemon started.

Description: The scdpmd is started.

Solution: No action required.

319737 The raw device to fsck is not specified in vfstab for mount point : %s.

Description: The 'device to fsck' field is missing from the vfstab entry for the specified mount point.

Solution: Add the 'device to fsck' field to the vfstab entry for the specified mount point and repeat the operation.

320466 The global cluster failover HAStoragePlus resources mentioned in the offline restart dependencies list of the resource '%s' are not online on same node.The dependent failover resources must be online on the same node to validate the configuration.

Description: Self explanatory.

Solution: Bring all the dependent failover resource's resource groups online on one node and retry the operation. If the problem persists, contact your authorized Oracle service provider with the /var/adm/messages files from all cluster nodes.

320970 Failed to retrieve the node id from the node name for node %s: %s.

Description: Self explanatory.

Solution: Check the cluster configuration. If the problem persists, contact your authorized Oracle service provider.

321245 resource <%s> is disabled but not offline

Description: While attempting to execute an operator-requested enable or disable of a resource, the rgmd has found the indicated resource to have its Onoff_switch property set to DISABLED, yet the resource is not offline. This suggests corruption of the RGM's internal data and will cause the enable or disable action to fail.

Solution: This may indicate an internal error or bug in the rgmd. Contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

321832 Could not set the contract id to 0 in the repository

Description: Not able to set the desired values in the SMF repository.

Solution: Check the SMF manpage to know more about the error.Also make sure the basic SMF functionalities are working fine.Contact SUN vendor for more help.

321962 Command %s failed to complete. HA-SAP will continue to start SAP.

Description: The command to cleanipc failed to complete.

Solution: This is an internal error. No user action needed. Save the /var/adm/messages from all nodes. Contact your authorized Oracle service provider.

322159 Error setting states inrepository: %s: %d

Description: Have problems in starting a communication with the SMF repository

Solution: Depending on the error, check the SMF man page.Contact SUN vendor for help.

322252 %s failed to stop the application and returned with %d

Description: A command was run to stop the application but it failed with an error. Both the command and the error code are specified in the message.

Solution: Save the syslog and contact your authorized Oracle service provider.

322323 INTERNAL ERROR in J2EE probe calling scds_fm_tcp_disconnect(): %s.

Description: The data service detected an internal error from scds.

Solution: Informational message. No user action is needed.

322373 Unable to unplumb %s%d, rc %d

Description: Oracle Solaris Cluster infrastructure failed to unplumb the transport interface.

Solution: The error message should contain the error code, so examine the message to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

322797 Error registering provider '%s' with the framework.

Description: The device configuration system on this node has suffered an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

322828 scha_control GIVEOVER failed

Description: scha_control GIVEOVER failed

Solution: Determine why the scha_control GIVEOVER failed. If the problem persists, contact your Oracle support representative for further assistance.

322853 The device special file (%s) is not either character or block device.

Description: Self explanatory.

Solution: Specify either a character or a block device path.

322862 clcomm: error in copyin for cl_read_threads_min

Description: The system failed a copy operation supporting flow control state reporting.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

322879 clcomm: Invalid copyargs: node %d pid %d

Description: The system does not support copy operations between the kernel and a user process when the specified node is not the local node.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

322895 exception %s raised while attempting to get running version of CMM.

Description: An exception occurred when retrieving the running version of CMM.

Solution: Contact your authorized Oracle service provider to determine if a workaround or patch is available.

322908 CMM: Failed to join the cluster: error = %d.

Description: The local node was unsuccessful in joining the cluster.

Solution: There may be other related messages on this node that may indicate the cause of this failure. Resolve the problem and reboot the node.

322920 Error unloading the EGC failfast module.

Description: The svc:/system/egc/failfast:default SMF service has failed to unload the EGC farm failfast module

Solution: Reboot the node.

323405 Error in informing the res group about the svc restart:%s

Description: When a service is restarted, the sc delegate restarter informs RGM about the restart of the resource using SCHA_RESOURCE_IS_RESTARTED scha control API.This message is displayed when this call cannot be made.

Solution: Check for the validity and the states of resource and services.Contact SUN vendor for more help.But this should not be a problem in normal operation of the delegated restarter

323592 Validation failed. CRS is not up. Please start it up before attempting to create proxy resource.

Description: Creation of a resource of type SUNW.scalable_rac_server_proxy failed because CRS is not up.

Solution: Bring up CRS before attempting to create a resource of the SUNW.scalable_rac_server_proxy resource type. If the problem persists, contact your Oracle support representative for further assistance.

323640 open64 while setting up process template: %s

Description: The libclcontract code was unable to open a file in the /system/contract/process/ directory. Consequently, the process that is using libclcontract was unable to launch the requested process under its control.

Solution: If the message is isolated, it was probably a transient error. Retry the requested action. If there are many instances of the message, there is a problem with the contract file system. Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Oracle service provider.

323873 Resource "%s" disabled.

Description: This ScalMountPoint resource was successfully disabled. This message is an informational message.

Solution: No user action is required.

324371 liveCache was stopped by the user outside of Oracle Solaris Cluster. Oracle Solaris Cluster will suspend monitoring until liveCache is again started up successfully outside of Oracle Solaris Cluster.

Description: When Oracle Solaris Cluster tries to bring up liveCache, it detects that liveCache was brought down by user intendedly outside of Oracle Solaris Cluster. Suu Cluster will not try to restart it under the control of Oracle Solaris Cluster until liveCache is started up successfully again by the user. This behaviour is enforced across nodes in the cluster.

Solution: Informative message. No action is needed.

324478 (%s): Error %d from read

Description: An error was encountered in the clexecd program while reading the data from the worker process.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

324924 in libsecurity contacting program %s (%lu): could not copy host name

Description: A client was not able to make an rpc connection to the specified server because the host name could not be saved. This problem can occur if the machine has low memory. An error message is output to syslog.

Solution: Determine if the host is low on memory. If not, save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

325032 qdmd: Quorum device type variable for type %s not found

Description: The quorum device monitoring daemon encountered an error while fetching device type information for the indicated quorum device type.

Solution: Contact service support.

325322 clcomm: error in copyin for state_resource_pool

Description: The system failed a copy operation supporting statistics reporting.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

325482 File %s is not owned by group (GID) %d

Description: The file is not owned by the gid which is listed in the message.

Solution: Set the permissions on the file so that it is owned by the gid which is listed in the message.

325530 Creation of the shutdown file %s has failed: %s

Description: The cp(1) command has returned an error.

Solution: Investigate the cause of the failure and correct the condition prior to attempting this operation again.

325593 check_file_exists - The file %s is not readable by its owner.

Description: A configuration file was not readable by its owner.

Solution: Ensure that the file has the read permission for its owner set.

325879 Failed to stop monitor-method: %s

Description: An error prevented a resource's fault monitor from stopping.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

326023 reservation warning(%s) - MHIOCGRP_PREEMPTANDABORT error in MHIOCGRP_INKEYS, error %d

Description: The device fencing program has encountered errors while trying to access a device. All retry attempts have failed.

Solution: This may be indicative of a hardware problem, which should be resolved as soon as possible. Once the problem has been resolved, the following actions may be necessary: If the message specifies the 'node_join' transition, then this node may be unable to access the specified device. If the failure occurred during the 'release_shared_scsi2' transition, then a node which was joining the cluster may be unable to access the device. In either case, access can be reacquired by executing '/usr/cluster/lib/sc/run_reserve -c node_join' on all cluster nodes. If the failure occurred during the 'make_primary' transition, then a device group might have failed to start on this node. If the device group was started on another node, move it to this node by using the cldevicegroup command. If the device group was not started, you can start it by using the cldevicegroup command. If the failure occurred during the 'primary_to_secondary' transition, then the shutdown or switchover of a device group might have failed. If so, the desired action may be retried.

326030 Local mountpoint %s must begin with / in local zone '%s'.

Description: The specified mount point in local zone is not an absolute path. An absolute path must start with slash(/).

Solution: Correct the mount point path value so that it is absolute path and repeat the operation.

326299 INTERNAL ERROR: remote cluster %s unreachable

Description: The rgmd was unable to delegate the giveover of the specified resource group on the remote zone cluster node. The message provides more information.

Solution: Examine other syslog messages occurring around the same time on the same node. These messages may indicate further action.

326363 Function: stop_sczbt - Logical interface %s:%s placed into the global zone

Description: The interface of the associated logical host is placed back into the global zone by the stop command of the sczbt component.

Solution: None

326528 Nonexistent Broker_name (%s).

Description: The broker name provided in the extension property Broker_Name does not exist.

Solution: Check that a broker instance exists for the supplied broker name. It should match the broker name portion of the path in Confdir_list.

326636 The profile for SAP %s instance %s does not exist

Description: The check for SAP profile failed. The start up of sap instance requires the profile to be present.

Solution: Make sure the sap profile is present under /usr/sap/SAPSID/SYS/profile/ directory.

326800 Multiple domain %s configuration exists on %s.

Description: The domain is configured on multiple cluster nodes.

Solution: Ensure that the domain is configured on one node of the cluster.

327057 SharedAddress stopped.

Description: The stop method is completed and the resource is stopped.

Solution: This is informational message. No user action required.

327132 Validate - Couldn't retrieve faultmonitor-user <%s> from the nameservice

Description: The Samba resource could not validate that the fault monitor userid exists.

Solution: Check that the correct fault monitor userid was used when registering the Samba resource and that the userid really exists.

327302 reservation fatal error(%s) - lock not specified

Description: The device fencing program has suffered an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available. Copies of /var/adm/messages from all nodes should be provided for diagnosis.

327339 unable to create file %s errno %d

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

327353 Global device path %s is not recognized as a device group or a device special file.

Description: Self explanatory.

Solution: Check that the specified global device path is valid.

327496 WARNING: IPMP group %s cannot host %s addresses.

Description: The IPMP group cannot host IP addresses of the type specified. One or more hostnames in the resource have mappings of that type. Those IP addresses will not be hosted on this node.

Solution: Configure the IPMP group in such a way that no host in the group has a mapping outside the instances that the IPMP group supports.

327549 Stop of HADB node %d did not complete.

Description: The resource was unable to successfully run the hadbm startnode command either because it was unable to execute the program, or the hadbm command received a signal.

Solution: This might be the result of a lack of system resources. Check whether the system is low in memory and take appropriate action.

328113 %s logical interface configuration operation failed with <%d>.

Description: An attempt to bring a network interface up or down has failed with the indicated error, while attempting to bring an IP address resource (of type LogicalHostname or SharedAddress) online or offline. Additional related failure messages are likely to be found following this one in the syslog output.

Solution: Check the configuration of network resources using the "clresourcegroup show -v +" command, and make any necessary corrections to the network configuration.

328393 perform_check - Probe command for %s (%s) timed-out.

Description: The probe command has timed-out.

Solution: Increase the Probe_timeout.

328580 rgmd died on node %s

Description: An inter-node communication failed because the rgmd died on another node. To avoid data corruption, the failfast mechanism will cause that node to halt or reboot.

Solution: No action is required. The cluster will reconfigure automatically. Examine syslog output on the rebooted node to determine the cause of node death. The syslog output might indicate further remedial actions.

328675 The mount point property of file system '%s' in pool '%s' is set to 'legacy', which is not supported by HAStoragePlus.

Description: Self explanatory. HAStoragePlus does not support Zettabyte File Systems (ZFS) as Failover File Systems (FFS) that have the mountpoint property set to 'legacy'.

Solution: Set the mountpoint property for the specified file system to 'default'.

328779 Probe for J2EE engine timed out in scds_fm_tcp_connect().

Description: The data service timed out while connecting to the J2EE engine port.

Solution: Informational message. No user action is needed.

329039 Cannot access file %s/config.xml or %s/config/config.xml: %s

Description: The config.xml file does not exist either in the <domain> or <domain>/config directory.

Solution: Make sure if config.xml file is present in the <domain> or <domain>/config directory and also make sure if proper permissions are set for the file.

329286 (%s) instead of UDLM_ACK got a %d

Description: Did not receive an acknowledgement from udlm as was expected.

Solution: None.

329429 reservation fatal error(%s) - host_name not specified

Description: The device fencing program has suffered an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available. Copies of /var/adm/messages from all nodes should be provided for diagnosis. It may be possible to retry the failed operation, depending on the nature of the error. If the message specifies the 'node_join' transition, then this node may be unable to access shared devices. If the failure occurred during the 'release_shared_scsi2' transition, then a node which was joining the cluster may be unable to access shared devices. In either case, it may be possible to reacquire access to shared devices by executing '/usr/cluster/lib/sc/run_reserve -c node_join' on all cluster nodes. If the failure occurred during the 'make_primary' transition, then a device group has failed to start on this node. If another node was available to host the device group, then it should have been started on that node. If desired, it might be possible to switch the device group to this node by using the cldevicegroup command. If no other node was available, then the device group will not have been started. You can use the cldevicegroup command to retry the attempt to start the device group. If the failure occurred during the 'primary_to_secondary' transition, then the shutdown or switchover of a device group has failed. The desired action may be retried.

329616 svc_probe used entire timeout of %d seconds during connect operation and exceeded the timeout by %d seconds. Attempting disconnect with timeout %d

Description: The probe timed out connecting to the application.

Solution: If the problem persists investigate why the application is responding slowly or if the Probe_timeout property needs to be increased.

330182 Internal error: default value missing for resource property

Description: A non-fatal internal error has occurred in the RGM.

Solution: Since this problem might indicate an internal logic error in the rgmd, save a copy of the /var/adm/messages files on all nodes, and the output of clresourcetype show -v, clresourcegroup show -v +, and clresourcegroup status +. Report the problem to your authorized Oracle service provider.

330505 start_ssh_agent: The start of the ssh-agent was unsuccessful

Description: The ssh-agent is not startable for the given user

Solution: Determine and fix the root cause by running the ssh-agent manually as the target user

330523 %s list-constraints for domain %s failed.

Description: "/opt/SUNWldm/bin/ldm list-constraints -x" for domain failed.

Solution: Determine why the command to list the domain constraints failed.

330526 CMM: Number of steps specified in registering callback = %d; should be <= %d.

Description: The number of steps specified during registering a CMM callback exceeds the allowable maximum. This is an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

330530 Failed to retrieve the resource property %s of resource %s: %s.

Description: There was a failure while retrieving a property of a resource. The names of the resource and the property are both provided in the error message. The reason that the error occurred is also provided in the message.

Solution: The operation will be retried after some time. But there might be a delay in failing over some HA-NFS resources. If this message is logged repeatedly, save a copy of the syslog and contact your authorized Oracle service provider.

330565 clcomm: solaris xdoor: Got zoneid %d instead of %d

Description: Zone information that has been passed does not match the client credentials.

Solution: Someone has tampered with Oracle Solaris Cluster code. This is a security violation. Shut down the identified zone.

330686 Function: validate - Non-global zones mountpoint %s does not exist

Description: The directory used as a mountpoint in the non-global zone is missing.

Solution: Create the mountpoint in the non-global zone.

330700 Cannot read template file (%s).

Description: Template file name was passed to the function for synchronizing the configuration file. Unable to locate the file indicated in the message. Unable to store property value of resource to configuration file.

Solution: Verify installation of Oracle Solaris Cluster. If the problem persists, save the contents of /var/adm/messages and contact your Oracle service representative.

330722 The derby data service is not already running

Description: Trying to stop the derby data service when it is not running.

Solution: This message is informational; no user action is needed.

330772 DB_password_file must be set when Auto_recovery is set to true.

Description: When auto_recovery is set to true the db_password_file extension property must be set to a file that can be passed as the value to the hadbm command's --dbpasswordfile argument.

Solution: Retry the resource creation and provide a value for the db_password_file extension property.

331059 validate_zcboot_resource - SUNW.wait_zc_boot resource is not configured for zone cluster %s

Description: SUNW.wait_zc_boot resource is not configured for zone cluster

Solution: Configure a SUNW.wait_zc_boot resource with ZCName set to the zone cluster.

331066 validate_acfsproxy - no disk group or volume found for mountpoint %s

Description: No disk group or volume for mountpoint specified in ACFS_MOUNTPOINT property

Solution: Ensure that an ACFS file system is created with mount point set to the path specified by the ACFS_MOUNTPOINT property.

331074 mc_multi_openconn failed to open bindtab connection.

Description: Failed to allocate memory during connection establishment for an SCTP sticky service.

Solution: Install more memory, increase swap space, or reduce peak memory consumption.

331221 CMM: Max detection delay specified is %ld which is larger than the max allowed %ld.

Description: The maximum of the node down detection delays is larger than the allowable maximum. The maximum allowed will be used as the actual maximum in this case.

Solution: This is an informational message, no user action is needed.

331301 Stop - can't determine Qmaster Spool dir

Description: The qmaster spool directory could not be determined, using the 'QmasterSpoolDir' function.

Solution: Use the command 'qconf -sconf' to determine the value of 'qmaster_spool_dir'. Update/correct the value if necessary using 'qconf -mconf'.

331325 sigprocmask: %s

Description: The rpc.pmfd server was not able to set its signal mask. The message contains the system error. This happens while the server is starting up, at boot time. The server does not come up, and an error message is output to syslog.

Solution: Save the syslog messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

331446 stop_diskgroup - Oracle ASM instance (%s) failed to dismount (%s)

Description: The Oracle ASM diskgroup failed to dismount.

Solution: Check the syslog for further messages. The Oracle Solaris Cluster resource will now enter a stop_failed state. You must determine why the Oracle ASM diskgroup failed to dismount. Once resolved you can reenable the Oracle Solaris Cluster resource again.

331879 Function: validate - ServiceProbeCommand (%s) not a fully qualified path.

Description: The command specified for variable ServiceProbeCommand within the /opt/SUNWsczone/sczsh/util/sczsh_config configuration file is not containing the full qualified path to it.

Solution: Make sure the full qualified path is specified for the ServiceProbeCommand, e.g. "/full/path/to/mycommand" rather than just "mycommand". This full qualified path must be accessible within the zone that command is being called.

332011 error-writing to pipe: %s.

Description: An internal error might have occurred.

Solution: Contact your authorized Oracle service provider for assistance in diagnosing the problem.

332256 Validate - winbind is not defined in %s in the passwd section

Description: Winbinbd is missing from the passwd section in /etc/nsswitch.conf

Solution: Enter winbind within the passwd section in /etc/nsswitch.conf.

333069 Failed to retrieve nodeid for %s.

Description: The nodeid for the given name could not be determined.

Solution: Make sure that the name given is a valid node identifier or node name.

333163 Malformed %s group specification %s.

Description: Failed to retrieve the ipmp information. The given IPMP group specification is invalid.

Solution: Check whether the IPMP group specification is in the form of ipmpgroup@nodename. If not, recreate the resource with the properly formatted group information.

333387 INTERNAL ERROR: starting_iter_deps_list: meth type <%d>

Description: A non-fatal internal error has occurred in the rgmd state machine.

Solution: Since this problem might indicate an internal logic error in the rgmd, save a copy of the /var/adm/messages files on all nodes, and the output of clresourcetype show -v, clresourcegroup show -v +, and clresourcegroup status +. Report the problem to your authorized Oracle service provider.

333428 Error getting handle tolibvxvm_get_dginfo

Description: An error occurred when the library routine was called.

Solution: Ensure that the correct version of the library is installed. Contact your authorized Oracle service provider for further assistance in diagnosing the problem.

333622 Property %s can be changed only while ucmmd is not running on the node.

Description: This property can be changed only while ucmmd is not running on the node. The volume manager processes on all the nodes must use identical value of this property for proper functioning on the cluster.

Solution: Change the RAC framework resource group to unmanaged state. Reboot all the nodes that can run RAC framework and modify the property.

333752 scha_control() returned error %d for %s in %s.

Description: The data service detected an internal error from scds.

Solution: Informational message. No user action is needed.

333874 failfastd: sigdelset returned %d. Exiting.

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available

333878 fatal: Unable to get the cluster configuration (%s).

Description: A call to an internal library to get the cluster configuration unexpectedly failed. The RGMD will exit, which will cause the node to reboot.

Solution: Report the problem to your authorized Oracle service provider.

334268 CCR: Can't read CCR metadata for cluster %s.

Description: Reading the CCR metadata failed on this node during the CCR data server initialization.

Solution: There may be other related messages on this node, which may help diagnose the problem. For example: If the root disk on the afflicted node has failed, then it needs to be replaced. If the cluster repository is corrupted, then boot this node in -x mode to restore the cluster repository from backup or other nodes in the cluster. The cluster repository is located at /etc/cluster/ccr/. Contact your authorized Oracle service provider for assistance.

334412 Telemetry data service monitor check method failed

Description: The monitor program of the telemetry data service detected an error. The cause of the error is given in some error messages displayed before this one.

Solution: Check if there are other error messages before this one, and contact your authorized Oracle service provider to determine whether a workaround or patch is available.

334697 Failed to retrieve the cluster property %s: %s.

Description: The query for a property failed. The reason for the failure is given in the message.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

334724 There should be one Network Resource in this resource group.

Description: There must be only one Failover IP address resource in this resource group. The Failover host for which the Node agents are configured must be created in this resource group.

Solution: Create the Failover host resource, on which the Node Agent and the Application Server instances are configured, in this resource group.

334965 Error writing configuration file %s.

Description: An error occurred when attempting to write the configuration file.

Solution: Investigate the cause of the failure and correct the condition prior to attempting this operation again.

334992 clutil: Adding deferred task after threadpool shutdown id %s

Description: During shutdown this operation is not allowed.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

335206 Failed to get host names from the resource.

Description: Retrieving the IP addresses from the network resources from this resource group has failed.

Solution: Internal error or API call failure might be the reasons. Check the error messages that occurred just before this message. If there is internal error, contact your authorized Oracle service provider. For API call failure, check the syslog messages from other components. For the resource name and resource group name, check the syslog tag.

335363 cl_execd: Error %d from open(/dev/zero). Exiting.

Description: cl_execd has encountered a failed open(2) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

335468 Time allocated to stop development system is too small (less than 5 seconds).

Description: Time allocated to stop the development system is too small.

Solution: The time for stopping the development system is a percentage of the total Start_timeout. Increase the value for property Start_timeout or the value for propety Dev_stop_pct.

335587 The non-existent mount point %s was created successfully with permissions %s and owned by the superuser.

Description: HAStoragePlus detected the mount point was missing, and created the mount point with the specified information.

Solution: This is an informational message, no user action is needed.

335591 Failed to retrieve the resource group property %s: %s.

Description: An API operation has failed while retrieving the resource group property. Low memory or API call failure might be the reasons.

Solution: In case of low memory, the problem will probably cured by rebooting. If the problem recurs, you might need to increase swap space by configuring additional swap devices. Otherwise, if it is API call failure, check the syslog messages from other components. For resource group name and the property name, check the current syslog message.

335619 clq_scsi3: Quorum device %s does not have any keys. Use a different device

Description: There are no keys on the device. This is unexpected behavior from the device driver, multipathing driver or device firmware.

Solution: Use a different device as a quorum device.

335836 Failed to mount file-system %s on mountpoint %s

Description: The file system that this ScalMountPoint resource represents could not be mounted on the mount point.

Solution: Determine whether the mount-point directory exists. If the directory does not exist, create it and repeat the operation. Otherwise, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

336760 Could not restart or failover the derby data service

Description: Could not restart or failover the derby data service.

Solution: For more detailed error message, check the syslog messages. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

336852 start_asm - Oracle CSS is not running

Description: The Oracle Solaris Cluster Synchronization Services (CSS) is not running.

Solution: Investigate why the CSS daemon is not running and then re-enable the Oracle Solaris Cluster resource.

336860 read %d for %snum_ports

Description: Could not get information about the number of ports udlm uses from config file udlm.conf.

Solution: Check to make sure udlm.conf file exist and has entry for udlm.num_ports. If everything looks normal and the problem persists, contact your Oracle service representative.

336868 Monitor for sckrb5 successfully started.

Description: The probe for HA-KDC has been started.

Solution: This message is for informational purposes only, no action is required.

337008 rgm_comm_impl::_unreferenced() called unexpectedly

Description: The low-level cluster machinery has encountered a fatal error. The rgmd will produce a core file and will cause the node to halt or reboot to avoid the possibility of data corruption.

Solution: Save a copy of the /var/adm/messages files on all nodes, and of the rgmd core file. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

337212 resource type %s removed.

Description: This is a notification from the rgmd that a resource type has been deleted. This message can be used by system monitoring tools.

Solution: This is an informational message; no user action is needed.

337736 %s: svc_run returned

Description: The RPC server exited unexpectedly.

Solution: Save the contents of /var/adm/messages from all nodes and contact your Oracle service representative for assistance in diagnosing and correcting the problem.

337957 Validation failed. The RAC framework resource %s that is specified in the RESOURCE_DEPENDENCIES property is not in the resource group that is specified by the resource group property RG_AFFINITIES.

Description: The resource being created or modified should be dependent upon the RAC framework resource in the RAC framework resource group.

Solution: If not already created, create the scalable resource group containing RAC framework resource and its associated resources. Specify this resource's dependency on the RAC framework by updating the RESOURCE_DEPENDENCIES property.

338067 This resource does not depend on any SUNW.HAStoragePlus resources. Proceeding with normal checks.

Description: The resource does not depend on any HAStoragePlus filesystems. The validation will continue with it's other checks.

Solution: This message is informational; no user action is needed.

338321 SCSLM <%s> zone <%s> corrupted project.cpu-shares

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

338839 clexecd: Could not create thread. Error: %d. Sleeping for %d seconds and retrying.

Description: clexecd program has encountered a failed thr_create() system call. The error message indicates the error number for the failure. It will retry the system call after specified time.

Solution: If the message is seen repeatedly, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

338957 Warning! Oracle Solaris Cluster resource cannot be brought online on this node because the corresponding Solaris SMF services may be online. Please disable the Solaris SMF services using the following command: 'svcadm disable %s'

Description: The Solaris SMF service indicated above could not be disabled as required by Oracle Solaris Cluster to make the service capable of restart/failover.

Solution: Try to manually disable the SMF service specified by the error message using the 'svcadm disable' command and retry the operation.

339119 scvxvmlg warning - chmod(%s) failed

Description: The program responsible for maintaining the VxVM namespace was unable to access the global device namespace. If configuration changes were recently made to VxVM diskgroups or volumes, this node may be unaware of those changes. Recently created volumes may be unaccessible from this node.

Solution: Verify that the /global/.devices/node@N (N = this node's node number) is mounted globally and is accessible. If no configuration changes have been recently made to VxVM diskgroups or volumes and all volumes continue to be accessible from this node, then no further action is required. If changes have been made, the device namespace on this node can be updated to reflect those changes by executing '/usr/cluster/lib/dcs/scvxvmlg'. If the problem persists, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

339206 validate: An invalid option entered or

Description: -2 A wrong variable is set in the parameter file or a line does not start with

Solution: -2 Fix the parameter file.

339353 Function: start_mysql - The pid file %s was not created within %s seconds

Description: the pid file of the MySQL Server was not created within 70 percent of the start timeout

Solution: None

339424 Could not host device service %s because this node is being removed from the list of eligible nodes for this service.

Description: A switchover/failover was attempted to a node that was being removed from the list of nodes that could host this device service.

Solution: This is an informational message, no user action is needed.

339444 Failed to stop fault-monitor : %s

Description: The fault monitor of this ScalMountPoint resource could not be stopped.

Solution: Manually kill the fault monitor process.

339590 Error (%s) when reading property %s.

Description: Unable to read property value using API. Property name is indicated in message. Syslog messages may give more information on errors in other modules.

Solution: Check syslog messages. Please report this problem.

339657 Issuing a restart request.

Description: This is informational message. We are above to call API function to request for restart. In case of failure, follow the syslog messages after this message.

Solution: No user action is needed.

339908 strtol: %s

Description: strtol failed. Should never occur. This might have failed if the return value could not be represented.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

339954 fatal: cannot create any threads to launch callback methods

Description: The rgmd daemon was unable to create a thread upon starting up. This is a fatal error. The rgmd will produce a core file and will force the node to halt or reboot to avoid the possibility of data corruption.

Solution: Make sure that the hardware configuration meets documented minimum requirements. Save a copy of the /var/adm/messages files on all nodes, and of the rgmd core file. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

340157 huge address size %d

Description: Size of MAC address in acknowledgment of the bind request exceeds the maximum size allotted. We are trying to open a fast path to the private transport adapters.

Solution: Reboot of the node might fix the problem.

340180 Prog <%s> step <%s>: quiesced.

Description: An internal error has occurred. The quiesce command, which is applicable only to resource groups, appears to have been applied to a ucmmd reconfiguration step.

Solution: This is an internal error. Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log, and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your authorized Oracle service provider.

340211 monitor_check: getlocalhostname() failed for resource <%s>, resource group <%s>, node <%s>

Description: While attempting to process a scha_control(1HA,3HA) call, the rgmd failed in an attempt to obtain the hostname of the local node. This is considered a MONITOR_CHECK method failure. This in turn will prevent the attempted failover of the resource group from its current master to a new master.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

340287 idl_set_timestamp(): IDL Exception

Description: The rgmd has encountered an error that prevents the scha_control function from successfully setting a ping-pong time stamp, probably because of a node death or network failure.

Solution: Usually, no action is required. If another node is available, services will be restarted automatically.

340464 SCSLM fork1 error <%s>

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

341205 Failed to replace bootcluster on the nodes of second partition

Description: During dual-partition upgrade, bootcluster component was not replaced on the nodes of the second partition. The dual-partition upgrade will continue to completion.

Solution: Do not boot any nodes in second partition into cluster mode until the dual-partition upgrade completes.

341259 Property %s can't start with a "/"

Description: The value of the property TargetFileSystem starts with a slash (/). However, the value of this property must not start with a slash.

Solution: Correct the value of the property and repeat the operation.

341502 Unable to plumb even after unplumbing. rc = %d

Description: Topology Manager failed to plumb an adapter for private network. A possible reason for plumb to fail is that it is already plumbed. Solaris clustering has successfully unplumbed the adapter but failed while trying to plumb for private use.

Solution: The error message should contain the error code, so examine the message to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

341539 fatal: Aborting node %s because method <%s> failed on resource <%s> and Failover_mode is set to HARD

Description: A STOP method has failed or timed out on a resource, and the Failover_mode property of that resource is set to HARD.

Solution: No action is required. This is normal behavior of the RGM. With Failover_mode set to HARD, the rgmd reboots the indicated node or zone to force the resource group offline so that it can be switched onto another node. Other syslog messages that occurred just before this one might indicate the cause of the STOP method failure.

341719 Restarting daemon %s.

Description: HA-NFS is restarting the specified daemon.

Solution: No action.

341801 No Port_list extension property configured in resource.

Description: The port_list extension property is not configured for a "network-aware" resource.

Solution: Configure the port_list extension property.

341804 Failed to retrieve information for user %s.

Description: Failed to retrieve information for the specified HADB MA user

Solution: Check if the proper HADB MA User ID is set or check if this user exists on all the nodes of the cluster.

342113 Invalid script name %s. It cannot contain any '/'.

Description: The script name should be just the script name, no path is needed.

Solution: Specify just the script name without any path.

342193 Attempt to mount %s failed on this node.

Description: In a scalable resource group, each node that is configured in the resource group attempts to mount the file system. Only one node can succeed in mounting the file system. The remaining nodes which fail to mount the file system issue this message.

Solution: This is an informational message. However, if no node succeeds in mounting the file system, check the failure message of each node. If you are unable to resolve the problem contact your authorized Oracle service provider with copies of /var/adm/messages files on all nodes.

342336 clcomm: Pathend %p: path_down not allowed in state %d

Description: The system maintains state information about a path. A path_down operation is not allowed in this state.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

342472 Error while posting sysevent from %s: %s

Description: An internal error has occurred while posting a system event. System events are used for keeping an audit trail of cluster behavior. Related error messages might be found near this one in the syslog output.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

342597 sigaddset: %s

Description: -2 The rpc.fed server encountered an error with the sigemptyset function, and was not able to start. The message contains the system error.

Solution: Save the syslog messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

342922 User %s does not belong to the project %s: %s.

Description: The specified user does not belong to the project that is specified in the error message.

Solution: Use the projadd(1M) command to add the specified user to the specified project.

342950 start_ids - Informix Server (%s) started rc(%s)

Description: The specified Informix Server was started successfully.

Solution: None required. Informational message.

343233 Failed to disable %s.

Description: The Solaris SMF service indicated above could not be disabled as required by Oracle Solaris Cluster to make the service capable of restart/failover.

Solution: Try to manually disable the SMF service specified by the error message using the 'svcadm disable' command and retry the operation.

343271 getzonenamebyid: %s

Description: getzonenamebyid failed for the specified reason. The specified program will be terminated. This zone will not be able to host applications.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

343307 Could not open file %s: %s.

Description: System has failed to open the specified file.

Solution: Check whether the permissions are valid. This might be the result of a lack of system resources. Check whether the system is low in memory and take appropriate action. For specific error information, check the syslog message.

343667 Function: validate: The LD_LIBRARY_PATH %s is not valid for this PostgreSQL installation

Description: The LD_LIBRARY_PATH is not valid to call the postgres binary.

Solution: Qualify the LD_LIBRARY_PATH in the parameter file until it is sufficient for the psql binary.

343870 clcomm: Rejecting communication attempt from node %s; local node has unresolved CCR changes done after split brain.

Description: The local node has unresolved CCR changes that were done in this node's partition when the cluster was in a split-brain scenario while the property multiple_partitions=true was set in CCR. The administrator must first resolve the CCR changes. Hence, this node will reject the communication attempt from a remote node.

Solution: Decide whether the CCR data on this node should be the final CCR data that is used by the cluster. If yes, then reboot the remote node into noncluster mode and mark its CCR data as invalid. Mark this local node's CCR data as valid, and then reboot the remote node into cluster mode. If no, then reboot this local node into noncluster mode and mark its CCR data as invalid. Mark the remote node's CCR data as valid and reboot this local node into cluster mode.

344059 RAC server %s probe successful.

Description: This message indicates that fault monitor has successfully probed the RAC server

Solution: No action required. This is informational message.

344291 clq_scsi3: Duplicate keys 0x%llx, found in registration key list of quorum device %s.

Description: Duplicate keys found on specified quorum device. This error occurs because of unexpected behavior from device driver or multipathing driver or device's firmware.

Solution: Please look for updates in device driver, multipathing driver or device firmware. If no updates are available contact the Oracle device driver support team.

344368 scvxvmlg warning - chown(%s) failed

Description: The program responsible for maintaining the VxVM namespace was unable to access the global device namespace. If configuration changes were recently made to VxVM diskgroups or volumes, this node may be unaware of those changes. Recently created volumes may be unaccessible from this node.

Solution: Verify that the /global/.devices/node@N (N = this node's node number) is mounted globally and is accessible. If no configuration changes have been recently made to VxVM diskgroups or volumes and all volumes continue to be accessible from this node, then no further action is required. If changes have been made, the device namespace on this node can be updated to reflect those changes by executing '/usr/cluster/lib/dcs/scvxvmlg'. If the problem persists, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

344512 Failed to create a temporary file during determining MDS node of '%s' file system : %s.

Description: The zone boot handler failed to create a temporary file.

Solution: Check the log messages to rectify the problem. If the problem persists, contact your authorized Oracle service provider.

344614 Started SAP processes under PMF successfully.

Description: Informational message. SAP is being started under the control of Process Monitoring Facility (PMF).

Solution: No action needed.

344672 Unable to open door descriptor %s

Description: A process running in a non-global zone was unable to communicate with the cluster framework in the global zone.

Solution: Save the /var/adm/messages files on each node. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

344870 stop_ndbd_shutdown: The restart -n of all data nodes was unsuccesful

Description: The restart -n of the datanode was unsuccessful.

Solution: None

345736 Unable to allocate memory

Description: An internal error has occurred in the inter-process communication between Oracle Solaris Cluster processes. Related error messages might be found near this one in the syslog output.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

346015 Function: check_sczbt - %s Milestone [%s] not online, try again in 5 seconds

Description: The milestone is not online or degraded. The state is checked again in 5 seconds.

Solution: None.

346255 zc_acfs_boot: Failed to create directory %s : %s

Description: The handler failed to create the specified directory. This might affect the behavior of the boot handler which mounts the ACFS file systems configured for zone cluster.

Solution: Check the log message for the failure and create the specified directory before doing any zone administration operations. Contact your authorized Oracle service provider with copy of /var/adm/messages files on all nodes for any further problems on the behavior of this zone.

346341 Failed to check the status of %s service.

Description: There was an error while retrieving the status of the specified SMF service.

Solution: Determine the reason for the failure by using svcs(1) and by checking /var/adm/messages. Re-try the operation after the problem is resolved. Contact your authorized Oracle service provider to determine whether a workaround or patch is available if the problem persists.

346395 UNRECOVERABLE ERROR: Creation of %s failed with error code %s

Description: Creation of ${QL_TRANSFORM_CCR_FILE} failed with error code ${retval}.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

346439 Could not verify value of property %s for %s.

Description: An API call failed.

Solution: Examine log files and syslog messages to determine the cause of the failure. Take corrective action based on any related messages. If the problem persists, report it to your Oracle support representative for further assistance.

346644 zc_acfs_halt: Failed to retrieve CRS_HOME from the SUNW.scalable_asm_instance_proxy resource configured in global zone

Description: The zone halt handler failed to retrieve CRS_HOME from the SUNW.scalable_asm_instance_proxy resource configured in global zone.

Solution: Investigate the zone halt log messages and rectify the problem. If problem persists after rebooting the zone, contact your authorized Oracle service provider with copy of /var/adm/messages files on all nodes.

346831 Notice: not OK to join

Description: This is an informational message. This message can be seen when reconfiguration is in progress on other cluster nodes. The operation will be retried.

Solution: This message is informational; no user action is needed.

346858 UPDATE operation successfully completed.

Description: An UPDATE operation has completed successfully.

Solution: None required. Informational message.

347023 Could not run %s. User program did not execute cleanly.

Description: There were problems making an upcall to run a user-level program.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

347091 resource type %s added.

Description: This is a notification from the rgmd that the operator has created a new resource type. This message can be used by system monitoring tools.

Solution: This is an informational message; no user action is needed.

348065 CCR: Lost quorum while starting to update table %s, cluster %s.

Description: The cluster lost quorum when CCR started to update the indicated table.

Solution: Reboot the cluster.

348240 clexecd: putmsg returned %d.

Description: clexecd program has encountered a failed putmsg(2) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

348504 Error: Startup of ${SERVER} failed.

Description: An attempt to start the rpc.fed server failed. This error will prevent the rgmd from starting, which will prevent this node from participating as a full member of the cluster.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

349041 RGM unblocked, returned from blocked invocation.

Description: The RGM has been unblocked. cluster file systems are available.

Solution: This is an informational message, no user action is needed.

349049 CCR reported invalid table %s; halting node

Description: The CCR reported to the rgmd that the CCR table specified is invalid or corrupted. The node will be halted to prevent further errors.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

349741 Command %s is not a regular file.

Description: The specified pathname, which was passed to a libdsdev routine such as scds_timerun or scds_pmf_start, does not refer to a regular file. This could be the result of 1) mis-configuring the name of a START or MONITOR_START method or other property, 2) a programming error made by the resource type developer, or 3) a problem with the specified pathname in the file system itself.

Solution: Ensure that the pathname refers to a regular, executable file.

349932 validate_options: %s Option %s not set

Description: The referenced script needs a mandatory option which got not set.

Solution: Verify the options upon registration for the referenced script and make sure all mandatory options got provided.

350574 Start of HADB database did not complete: %s.

Description: The resource was unable to successfully run the hadbm start command either because it was unable to execute the program, or the hadbm command received a signal.

Solution: This might be the result of a lack of system resources. Check whether the system is low in memory and take appropriate action.

350783 set_ts_prio : Unable to get ff_admin_v

Description: cl_execd program coudn't get a reference to the CORBA failfast server object.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

351887 Bulk registration failed

Description: The cl_apid was unable to perform the requested registration for the CRNP service.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

351983 Validate - can't determine path to Grid Engine utility binaries

Description: The Sun Grid Engine binary 'gethostname' was not found in ${SGE_ROOT}/utilbin/<arch>. 'gethostname' is used only representatively. If it is not found the other Sun Grid Engine utilities are presumed misplaced also.

Solution: Find 'gethostname' in the Sun Grid Engine installation. Make certain it is in a location conforming to ${SGE_ROOT}/utilbin/<arch>, where <arch> is the result of running ${SGE_ROOT}/util/arch.

352149 monitor_check: method <%s> failed on resource <%s> in resource group <%s> on node <%s>, exit code <%d>, time used: %d%% of timeout <%d seconds>

Description: In scha_control, monitor_check method of the resource failed on specific node.

Solution: No action is required; this is normal phenomenon of scha_control, which launches the corresponding monitor_check method of the resource on all candidate nodes and looks for a healthy node which passes the test. If a healthy node is found, scha_control will let the node take over the resource group. Otherwise, scha_control will just exit early.

352218 WebSphere MQ Channel Initiator %s started

Description: The specified WebSphere MQ Channel Initiator has been started.

Solution: None required. Informational message.

352222 check_file_exists - The file %s does not exist.

Description: A configuration file was not found.

Solution: Ensure that the file exists and that the correct configuration properties are specified.

352271 %s: Unable to determine hostname. Error: %s

Description: The hostname of the cluster node could not be determined.

Solution: Check if the command was run prior to setting the hostname. Contact your authorized Oracle service provider to determine whether a workaround or patch is avaliable.

352954 Resource (%s) not configured.

Description: This is an internal error. Resource name indicated in the message was passed to the function for synchronizing the configuration files. Unable to locate the resource.

Solution: If the problem persists, save the contents of /var/adm/messages and contact your Oracle service representative.

353368 Unable to to run %s: %s.

Description: The specified command was unable to run because of the specified reason.

Solution: Examine other syslog messages occurring around the same time on the same node, to see if the source of the problem can be identified.

353467 %s: CCR exception for %s table

Description: libscdpm could not perform an operation on the CCR table specified in the message.

Solution: Check if the table specified in the message is present in the Cluster Configuration Repository (CCR). The CCR is located in /etc/cluster/ccr. This error could happen because the table is corrupted, or because there is no space left on the root file system to make any updates to the table. This message will mean that the Disk Path Monitoring daemon cannot access the persistent information it maintains about disks and their monitoring status. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

353557 Filesystem (%s) is locked and cannot be frozen

Description: The file system has been locked with the _FIOLFS ioctl. It is necessary to perform an unlock _FIOLFS ioctl. The growfs(1M) or lockfs(1M) command may be responsible for this lock.

Solution: An _FIOLFS LOCKFS_ULOCK ioctl is required to unlock the file system.

353566 Error %d from start_failfast_server

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

353753 invalid mask in hosts list: %s

Description: The allow_hosts or deny_hosts for the CRNP service contained an invalid mask. This error may prevent the cl_apid from starting up.

Solution: Remove the offending IP address from the allow_hosts or deny_hosts property, or fix the mask.

353894 SCSLM write <%s> error <%s>

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

354821 Attempting to start the fault monitor under process monitor facility.

Description: The function is going to request the PMF to start the fault monitor. If the request fails, refer to the syslog messages that appear after this message.

Solution: This is an informational message, no user action is required.

355663 Failed to post event %lld: %s

Description: The cl_eventd was unable to post an event to the sysevent queue locally, and will not retry.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

355950 HA: unknown invocation result status %d

Description: An invocation completed with an invalid result status.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

356110 The SPI 0x%x for dst %s does not have Idle timeout defined. IPsec Session Failover cannot be provided for the SA. Please update the SA with idle timeout

Description: The syncsa server daemon encountered an SA for a serviced IP address with idle timeout value not defined. Idle timeout value is required to provide IPsec Session Failover for the client.

Solution: Update the SA with idle timeout value defined.

356795 CMM: Reconfiguration step %d was forced to return.

Description: One of the CMM reconfiguration step transitions failed, probably due to a problem on a remote node. A reconfiguration is forced assuming that the CMM will resolve the problem.

Solution: This is an informational message, no user action is needed.

356930 Property %s is empty. This property must be specified for scalable resources.

Description: The value of the specified property must not be empty for scalable resources.

Solution: Use clresource to specify a non-empty value for the property.

357032 Function: validate: The Hostname property must be set if the resource group property Maximum_Primaries is equal 1

Description: The Hostname property must be set in failover configurations.

Solution: Specify the Hostname property if the resource group property. Maximum_primaries is equal to 1

357117 reservation notice(%s) - MHIOCSTATUS success during retry attempt: %d

Description: Informational message from reserve on ioctl success during retry.

Solution: No user action required.

357260 Could not stop derby data service monitor (resource: %s)

Description: The monitor program of the derby data service could not stop. This should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

357263 munmap: %s

Description: The rpc.pmfd server was not able to delete shared memory for a semaphore, possibly due to low memory, and the system error is shown. This is part of the cleanup after a client call, so the operation might have gone through. An error message is output to syslog.

Solution: Determine if the machine is running out of memory. If this is not the case, save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

357444 reservation fatal error - get_cluster_state() exception

Description: The fencing subsystem was unable to obtain information about the state of the cluster.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available. Copies of /var/adm/messages from all nodes should be provided for diagnosis. It might be possible to retry the failed operation, depending on the nature of the error. If the message specifies the 'node_join' transition, then this node might be unable to access shared devices. If the failure occurred during the 'release_shared_scsi2' transition, then a node that was joining the cluster might be unable to access shared devices. In either case, it might be possible to reacquire access to shared devices by executing '/usr/cluster/lib/sc/run_reserve -c node_join' on all cluster nodes. If the failure occurred during the 'make_primary' transition, then a device group has failed to start on this node. If another node was available to host the device group, then it should have been started on that node. It might be possible to switch the device group to this node by using the cldevicegroup command. If another node is not available, then the device group will not be started. You can use the cldevicegroup command to retry the attempt to start the device group. If the failure occurred during the 'primary_to_secondary' transition, then the shutdown or switchover of a device group has failed. You can retry the desired action.

357511 reservation warning(%s) - MHIOCGRP_INKEYS error(%d) will retry in %d seconds

Description: The device fencing program has encountered errors while trying to access a device. The failed operation will be retried

Solution: This is an informational message, no user action is needed.

357766 ping_retry out of bound. The number of retry must be between %d and %d: using the default value

Description: scdpmd config file (/etc/cluster/scdpm/scdpmd.conf) has a bad ping_retry value. The default ping_retry value is used.

Solution: Fix the value of ping_retry in the config file.

357959 Found another active instance of ifconfig proxy server. Exiting ifconfig_serverd.

Description: The ifconfig server program found another active ifconfig program already in execution.

Solution: This is an information message. No user action is required.

358206 clcomm: solaris xdoor: Got zone cluster id %d instead of %d for zone %s

Description: Zone cluster id information that has been passed does not match the client credentials.

Solution: Someone has tampered with Oracle Solaris Cluster code. This is a security violation. Shut down the identified zone.

358404 Validation failed. PASSWORD missing in CONNECT_STRING

Description: PASSWORD is missing in the specified CONNECT_STRING. The format could be either 'username/password' or '/' (if operating system authentication is used).

Solution: Specify CONNECT_STRING in the specified format.

358533 Invalid protocol is specified in %s property.

Description: The specified system property does not have a valid protocol.

Solution: Using clnode, change the value of the property to use a valid protocol. For example: TCP, UDP.

358621 Misconfiguration of the RAC framework resource group. The UDLM resource is missing, while the Oracle UDLM package is installed.

Description: The Oracle UDLM resource is missing from the RAC framework resource group while the Oracle UDLM package (ORCLudlm) is installed.

Solution: Configure the RAC framework resource group to have only one SKGXN interface, either the Oracle UDLM or the Oracle Solaris Cluster native and then start the resource group.

358861 validate: The Tomcat port is not set but it is required

Description: The Tomcat port is not set in the parameter file

Solution: Set the Tomcat Port in the parameter file.

359013 cl_execd: Unable to create thread in the worker process. Exiting.

Description: cl_execd program has encountered a failed thr_create(2) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

359970 zc_rgm_halt for zone %s: Could not get hostname of this zone. Exiting.

Description: zc_rgm_halt could not get the hostname of the zone going down. Hence zc_rgm_halt will not be able to evacuate resource groups for this zone which belongs to a zone cluster. Support for this zone cluster might not work properly.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

360349 %s: sigemptyset(3C): %s

Description: The pmmd daemon was unable to initialize a signal set because the sigemptyset(3C) function failed. The message contains the system error. The pmmd daemon will not do the requested action.

Solution: Save a copy of the /var/adm/messages files on this node, and report the problem to your authorized Oracle service provider.

360363 Validation failed. Resource group property RG_AFFINITIES should specify a STRONG POSITIVE affinity (++) with the SCALABLE resource group containing the RAC framework resource.

Description: The resource being created or modified must belong to a resource group that has a strong positive affinity with the scalable resource group containing the RAC framework resource.

Solution: If not already created, create the scalable resource group containing the RAC framework resource and its associated resources. Specify a strong positive (++) affinity with the scalable resource group containing the RAC framework resource by using RG_AFFINITIES property of the resource group.

360416 Needed Oracle Solaris Cluster nodes are online, continuing with database start.

Description: All the Oracle Solaris Cluster nodes needed to start the database are running the resource.

Solution: This is an informational message, no user action is needed.

360567 fillCacheNative: scha_status %d: %s

Description: Failed to retreive the resource type information.

Solution: Contact your authorized Oracle service provider for assistance in diagnosing the problem.

360600 Oracle UDLM package wrong instruction set architecture.

Description: Proper Oracle UNIX Distributed Lock Manager (UDLM) is not installed on this node. A 64 bit UDLM package should not be installed in 32 bit operating environment. Oracle OPS/RAC will not be able to function on this node.

Solution: Install ORCLudlm package that is appropriate in this operating environment. Refer to Oracle's documentation for installaton of Oracle UDLM.

360923 contract_open: %s

Description: The libclcontract code was unable to retrieve the status of the newly created process template. The libclcontract code will kill the newly forked process because the process using the libclcontract code is unable to monitor the forked process.

Solution: If the message is isolated, it was probably a transient error. Retry the requested action. If there are many instances of the message, there is a problem with the contract file system. Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Oracle service provider.

360990 Service is already running. Cannot use PMF.

Description: The data service detected a running SAP instance. Webas_Use_Pmf is specified, thus the data service cannot start probing the instance.

Solution: Either set Webas_Use_Pmf to False, or stop the service.

361048 ERROR: rgm_run_state() returned non-zero while running boot methods

Description: The rgmd state machine has encountered an error on this node.

Solution: Look for preceding syslog messages on the same node, which may provide a description of the error.

361056 [PID %d] Bad data sent by proxy event listener daemon

Description: The proxy event listener daemon send bad data to the specified process.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

361447 Failed to get the list of adapters for the zone cluster %s, error = %d

Description: There was a failure to get the list of adapters configured to be used for the zone cluster.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

362117 Config file: %s unknown variable name line %d

Description: Error in scdpmd config file (/etc/cluster/scdpm/scdpmd.conf).

Solution: Fix the config file.

362242 The asadmin list-node-agents command failed to run. Unable to communicate with the Domain Admin Server %s on port %d. The Probe method will wait for the Domain Admin Server to be UP before starting the Node Agents.

Description: Before Starting the Node Agents, the start method checks for the status of the Domain Admin Server. The Node Agents are started only if the Domain Admin Server is UP. This error indicates that the Domain Admin Server is not running. The resource will be brought online but the start method will not start the Node Agents. The probe will monitor the status of the Domain Admin Server and will start the Node Agents once the Domain Admin Server is accessible.

Solution: If the Domain Admin Server is also an Oracle Solaris Cluster resource then set the resource dependency between the Node Agents resource and the Domain Admin Server resource. If the Domain Admin Server is not an Oracle Solaris Cluster resource then make sure it is Running.

362305 run_srvctl - Oracle ASM instance (%s) %s successful

Description: The Oracle ASM instance has been enabled/disabled or started/stopped.

Solution: None required. Informational message.

362630 Failed to open the file %s : %s

Description: The zone boot handler failed to open the specified file.

Solution: Check for the possible reasons for open failure and reboot the node after rectify the problem.

362657 Error when sending response from child process: %m

Description: Error occurred when sending message from fault monitor child process. Child process will be stopped and restarted.

Solution: If error persists, then disable the fault monitor and resport the problem.

362719 Resource group load factors for limit <%s> on node <%s> total <%d>: exceeds the soft limit <%d>

Description: The sum of the resource group load factors for the specified load limit on the given node has moved above the configured soft load limit.

Solution: This is an informational message; no action is required. If there is sufficient spare capacity on other nodes, you can use the "switch" or "remaster" subcommand of clresourcegroup(1CL) to relocate one or more resource groups from the indicated node onto other nodes.

362957 Oracle Solaris Cluster boot: reset vote returns $res

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

363357 Failed to unregister callback for IPMP group %s with tag %s (request failed with %d).

Description: An unexpected error occurred while trying to communicate with the network monitoring daemon (cl_pnmd).

Solution: Make sure the network monitoring daemon (cl_pnmd) is running.

363696 Error: unable to bring Resource Group <%s> ONLINE, because the Resource Groups <%s> for which it has a strong positive affinity are not online.

Description: The rgmd is enforcing the strong positive affinities of the resource groups. This behavior is normal and expected.

Solution: No action required. If desired, use clresourcegroup to change the resource group affinities.

364067 UNRECOVERABLE ERROR: Oracle Solaris Cluster boot: Could not initialize cluster framework

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

364188 Validation failed. Listener_name not set

Description: 'Listener_name' property of the resource is not set. HA-Oracle will not be able to manage Oracle listener if Listener name is not set.

Solution: Specify correct 'Listener_name' when creating resource. If resource is already created, please update resource property.

364203 check_ids - Database Instance %s is restarting

Description: The Informix Server database is starting up.

Solution: None required. Oracle Solaris Cluster will restart the Informix Server so that it is managed by Oracle Solaris Cluster.

364387 dl_attach: bad ACK header %u

Description: Could not attach to the physical device. We are trying to open a fast path to the private transport adapters.

Solution: Reboot of the node might fix the problem.

364510 The specified Oracle dba group id (%s) does not exist

Description: Group id of oracle dba does not exist.

Solution: Make sure /etc/nswitch.conf and /etc/group files are valid and have correct information to get the group id of dba.

364618 getzoneid() failed. Unable to verify privilege.

Description: The validate method for the SUNW.nfs service was unable to query the zoneid of the zone where it was launched into.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

364735 No PMF tag registered for the telemetry data service monitor

Description: The monitor program of the telemetry data service does not seem to be registered with the PMF. This should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

364774 The entry in vfstab for mount point '%s' exceeds %d characters.

Description: The internal buffer size of the vfstab entry for the specified mount point has exceeded VFS_LINE_MAX characters.

Solution: Shorten the vfstab entry for that mount point so that the length of the entry does not exceed VFS_LINE_MAX characters. You can shorten the vfstab entry by reducing the length of, for example, the block device, character device, or mount point.

364782 [PID %d] atexit(3C) failed : error %d

Description: The cluster events listener library in this specified process could not register a function to be called on exit, because atexit(3C) failed. The specified process will exit now.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

365287 Error detected while parsing -> %s

Description: This message shows the line that was being parsed when an error was detected.

Solution: Please ensure that all entries in the custom monitor action file are valid and follow the correct syntax. After the file is corrected, validate it again to verify the syntax.

365747 Derby data service stop method completed successfully

Description: The derby data service stopped successfully.

Solution: This message is informational; no user action needed.

365980 Wrong number of parameters for check_properties

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

366225 Listener %s stopped successfully

Description: Informational message. HA-Oracle successfully stopped Oracle listener.

Solution: None

366483 SAPDB parent kernel process was terminated.

Description: The SAPDB parent kernel process was not running on the system.

Solution: During normal operation, this error should not occurred, unless the process was terminated manually, or the SAPDB kernel process was terminated due to SAPDB kernel problem. Consult the SAPDB log file for additional information to determine whether the process was terminated abnormally.

366803 %s: Unable to set automatic MT mode.

Description: This program could not set automatic MT mode.

Solution: Save the contents of /var/adm/messages from all nodes and contact your Oracle service representative for assistance in diagnosing and correcting the problem.

366846 Domain %s started.

Description: The domain was started successfully.

Solution: None required. Informational message.

367048 validate_presentation - File or directory (%s) must not be under SUNW.HAStoragePlus control.

Description: File or directory must not be under SUNW.HAStoragePlus control.

Solution: Ensure that the file or directory is stored locally.

367077 Failfast: timeout - unit "%s"%s"%s.

Description: A failfast client has encountered a timeout and is going to panic the node or zone.

Solution: There might be other related messages on this node that can help diagnose the problem. Resolve the problem and reboot the node or zone if the node or zone panic is unexpected.

367270 INTERNAL ERROR: Failed to create the path to the %s file.

Description: An internal error has occurred.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

367417 Could not put the prop %s of svc %s, in the repository: %s

Description: Problem in creating memory space during resource management of SMF delegated restarter

Solution: Check the system memory usage

367864 svc_init failed.

Description: The rpc.pmfd server was not able to initialize server operation. This happens while the server is starting up, at boot time. The server does not come up, and an error message is output to syslog.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

367880 Probe command '%s' timed out: %s.

Description: Probing with the specified command timed out.

Solution: Other syslog messages occurring just before this one might indicate the reason for the failure. You might consider increasing the timeout value for the method that generated the error.

368138 Function: validate: TRY_RECONNECT is not numeric or 0

Description: In the parameter file, there is a non numeric character in the value for the TRY_RECONNECT variable.

Solution: Fix the TRY_RECONNECT variable in the parameter file.

368373 %s is locally mounted. Unmounting it.

Description: HAStoragePlus found the specified mount point mounted as a local file system. It will unmount it, as asked for.

Solution: This is an informational message, no user action is needed.

368456 Invalid global device path %s detected for mount point %s.

Description: The specified global device path is not valid.

Solution: Check the path and correct the entry with a valid global device path.

368529 Dual-partition upgrade state prevents booting into cluster mode.

Description: Dual-partition cluster upgrade is in progress. Until the upgrade is completed, you can boot the node only into noncluster mode.

Solution: Boot the node into noncluster mode (boot -x). Then continue with the upgrade.

368571 Validate - Faultmonitor-resource <%s> does not exist

Description: The Samba resource could not validate that the fault monitor resource exists.

Solution: Check that the Samba instance's smb.conf file has the fault monitor resource scmondir defined. Please refer to the data service documentation to determine how to do this.

368596 libsecurity: program %s (%lu); unexpected getnetconfigent error

Description: A client of the specified server was not able to initiate an rpc connection, because it could not get the network information. The pmfadm or scha command exits with error. An error message is output to syslog.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

368819 t_rcvudata in recv_request: %s

Description: Call to t_rcvudata() failed. The "t_rcvudata" man page describes possible error codes. udlm will exit and the node will abort.

Solution: This is an internal error. Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your Oracle service representative.

369460 udlm_send_reply %s: udp is null!

Description: Can not communicate with udlmctl because the address to send to is null.

Solution: None. udlm will handle this error.

369728 Taking action specified in Custom_action_file.

Description: Fault monitor detected an error specified by the user in a custom action filer. This message indicates that the fault monitor is taking action as specified by the user for such an error.

Solution: This is an informational message.

370604 This resource depends on a HAStoragePlus resouce that is in a different Resource Group. This configuration is not supported.

Description: The resource depends on a HAStoragePlus resource that is configured in a different resource group. This configuration is not supported.

Solution: Please add this resource and the HAStoragePlus resource in the same resource group.

370743 clq_scsi3: Ioctl MHIOCGRP_PREEMPTANDABORT returned failure (error = %d) for quorum device %s Key = %llx

Description: The ioctl to scrub keys from the specified quorum device failed. This is unexpected behavior from the device driver, multipathing driver or device firmware.

Solution: Use a different device as a quorum device.

370750 The Failover_mode setting of %s for resource %s in resource group %s has blocked a resource %s attempt on %s

Description: The rgmd is enforcing the RESTART_ONLY or LOG_ONLY value for the Failover_mode system property. Those settings may prevent some operations initiated by scha_control.

Solution: No action required. If desired, use clresourcegroup to change the Failover_mode setting.

370949 created %d threads to launch resource callback methods; desired number = %d

Description: The rgmd daemon was unable to create the desired number of threads upon starting up. This is not a fatal error, but it might cause RGM reconfigurations to take longer because it will limit the number of tasks that the rgmd can perform concurrently.

Solution: Make sure that the hardware configuration meets documented minimum requirements. Examine other syslog messages on the same node to see if the cause of the problem can be determined.

371199 clcomm: failed to load driver module ibp - %s paths will not come up.

Description: Oracle Solaris Cluster was not able to load the said network driver module. Any private interconnect paths that use an adapter of the corresponding type will not be able to come up. If all private interconnect adapters on this node are of this type, the node will not be able to join the cluster at all.

Solution: Install the appropriate network driver on this node. If the node could not join the cluster, boot the node in the non cluster mode and then install the driver. Reboot the node after the driver has been installed.

371250 Failed to set this node as primary for service '%s'.

Description: There were problems while trying make this node primary for this service.

Solution: Retry the last service switchover operation.

371489 Validate - Informix Server (%s) validation was successful

Description: The Informix Server validation was successful.

Solution: None required, informational message.

371615 In J2EE probe, failed to find Content-Length: in %s.

Description: The reply from the J2EE engine did not contain a Content-Length: entry in the http header.

Solution: Informational message. No user action is needed.

371681 Derby data service monitor successfully stopped (resource: %s)

Description: The monitor program of the derby data service stopped successfully.

Solution: This message is informational; no user action needed.

372460 Failed to take DNS out of PMF control; trying to send SIGKILL now

Description: Oracle Solaris Cluster failed to stop restarting the application.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

372492 scvxvmlg error - found non device-node or non link %s, directory not removed

Description: The program responsible for maintaining the VxVM namespace had detected suspicious entries in the global device namespace.

Solution: The global device namespace should only contain diskgroup directories and volume device nodes for registered diskgroups. The specified path was not recognized as either of these and should be removed from the global device namespace.

372618 Unable to extract the primary source IP address from the SCTP Cookie chunk.

Description: Either the SCTP COOKIE-ACK packet does not contain a cookie in the right position or the cookie does not contain a primary client IP address.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

372645 validate_server - The CLUSTER_PARTICIPANT variable in file %s is not set to "YES" (%s).

Description: The CLUSTER_PARTICIPANT variable must be set to "YES" when a BI server is configured in a scalable resource group.

Solution: Ensure that the CLUSTER_PARTICIPANT variable in the NQSConfig.INI file is set to "YES".

372887 HA: repl_mgr: exception occurred while invoking RMA

Description: An unrecoverable failure occurred in the HA framework.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

372920 Validate_sbp - MySQL replication resource is not specified in option %s

Description: The required mysql replication resource is not specified.

Solution: Make sure that the required resource is specified.

373148 The port portion of %s at position %d in property %s is not a valid port.

Description: The property named does not have a legal value. The position index, which starts at 0 for the first element in the list, indicates which element in the property list was invalid.

Solution: Assign the property a legal value.

373515 could not create server main door : %s

Description: The proxy event listener daemon could not create a door because door_create(3DOOR) failed for the specified reason.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

373816 clcomm: copyinstr: max string length %d too long

Description: The system attempted to copy a string from user space to the kernel. The maximum string length exceeds length limit.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

374006 prog <%s> failed on step <%s> retcode <%d>

Description: ucmmd step failed on a step.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified and if it recurs. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance.

374748 Membership : Could not create state machine thread for membership (%s).

Description: A thread required for membership could not be created. This might be due to lack of memory.

Solution: Lack of memory might lead to other problems on the node. You must free up memory on the node.

374839 Failfast : Fair share class not configured in this system

Description: Fair share scheduling class is not configured in this system, but a task needs to run in fair share scheduling class.

Solution: Configure fair share priority class for the system.

375331 dl_bind: DL_BIND_ACK protocol error

Description: Could not bind to the physical device. We are trying to open a fast path to the private transport adapters.

Solution: Reboot of the node might fix the problem.

375416 metaset -o returned (%d). %s not owner

Description: The node is not the owner of the metaset.

Solution: Determine why the node is not the owner of the metaset. Examine the output from metaset. Determine whether the SUNW.vucmm_framework resource and either the SUNW.vucmm_svm resource or the SUNW.vucmm_cvm resource are online. Or in legacy mode, determine whether the SUNW.rac_framework resource and either the SUNW.rac_svm resource or the SUNW.rac_cvm resource are online.

375575 Devicegroup (%s) not healthy!

Description: The volume is not available.

Solution: Determine the status of the disk set or disk group and the volume. For Solaris Volume Manager for Oracle Solaris Cluster volumes, run 'metastat -s'. For Veritas Volume Manager volumes, run 'vxprint'.

375584 Unexpected signal %d.

Description: The cl_eventlogd daemon has received a signal, possibly caused by an operator-initiated kill(1) command. The signal is ignored.

Solution: This message is informational only, and does not require user action.

375650 Function: val_parfile - %s not specified in %s, which is required

Description: The referenced necessary parameter is not mentioned in the parameter file.

Solution: Specify the parameter as a key value pair in the parameter file.

376111 Unable to compose %s path. Sending SIGKILL now.

Description: The STOP method was not able to construct the applications stop command. The STOP method will send SIGKILL to stop the application.

Solution: Other messages will indicate what the underlying problem was such as no memory or a bad configuration.

376118 Interface name %s too long

Description: Cluster cannot generate a callback for the RDS module. Operation of RDS sockets might be affected.

Solution: If Reliable Datagram Sockets (RDS) is used by applications running on this cluster, contact your Oracle Microsystems service representative to determine if a workaround or patch is available.

376369 Invalid configuration. SUNWudlmr and SUNWudlm packages must be installed on this node when using the Oracle UDLM.

Description: The required SUNWudlm and SUNWudlmr packages must be installed when using the Oracle UDLM.

Solution: Install the SUNWudlm and SUNWudlmr packages from the distribution. If the problem persists, contact your Oracle service representative for assistance in diagnosing and correcting the problem.

376596 Property "%s" should be of the form <filer name>:<absolute path to exported directory>

Description: The form of the TargetFileSystem property is incorrect. For an NFS file system that is exported from a NAS device, the value of the property TargetFileSystem must begin with the NAS device name, followed by a colon (:) and the full path to the directory that the device is exporting.

Solution: Correct the value of the property and repeat the operation.

376714 sysevent_bind_handle() failed : %s

Description: The proxy event listener daemon could not bind with the Solaris sysevents framework because sysevent_bind_handle(3SYSEVENT) failed. Hence, the daemon will not receive any cluster event notifications.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

376723 Error: unable to bring resource group <%s> ONLINE, because one or more resource groups with a strong negative affinity for it are in an error state.

Description: The rgmd is unable to bring the specified resource group online on the local node, because one or more resource groups related to it by strong negative RG affinities are in STOP_FAILED error state.

Solution: Find the errored resource groups and resources by using "clresourcegroup status" and "clresource status". Clear the STOP_FAILED error states by using "clresource clear". Use ps(1) or application-specific commands to make sure that the resource has stopped completely; kill resource-related processes if necessary.

376861 Migration of domain %s timed out, the domain state is now shut off.

Description: The domain migration or live migration timed out.

Solution: None required. Informational message.

376905 Failed to retrieve WLS extension properties.Will shutdown the WLS using sigkill

Description: Failed to retrieve the WLS exension properties that are needed to do a smooth shutdown. The WLS stop method however will go ahead and kill the WLS process.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

376974 Error in initialization; exiting.

Description: The cl_apid was unable to start-up. There should be other error message with more detailed explanations of the specific problems.

Solution: Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

377035 The path name %s associated with the FilesystemCheckCommand extension property is not a regular file.

Description: HAStoragePlus found that the specified file was not a plain file, but of different type (directory, symbolic link, etc.).

Solution: Correct the value of the FilesystemCheckCommand extension property by specifying a regular executable.

377347 CMM: Node %s (nodeid = %ld) is up; new incarnation number = %ld.

Description: The specified node has come up and joined the cluster. A node is assigned a unique incarnation number each time it boots up.

Solution: This is an informational message, no user action is needed.

377483 Creation of resource <%s> failed because the inter-cluster offline-restart dependencies could not be set

Description: Resource creation failed due to specification of invalid inter cluster dependencies.

Solution: Check the remote cluster name or remote resource name and retry the same command.

377531 Stop saposcol under PMF times out.

Description: Stopping the SAP OS collector process under the control of Process Monitor facility times out. This might happen under heavy system load.

Solution: You might consider increase the stop time out value.

377624 Membership : Previous shutdown of cluster '%s' was incomplete; shut it down completely now.

Description: A membership shutdown reconfiguration of this zone cluster was aborted previously.

Solution: Perform a complete shutdown of this zone cluster. If the shutdown of the zone cluster keeps aborting, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

377807 ucmmd unable to register for upgrade callbacks with version manager: %s

Description: An exception was raised when ucmmd tried to register for upgrade callbacks with the Version Manager.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

377897 Successfully started the service.

Description: Informational message. SAP started up successfully.

Solution: No action needed.

378220 Siebel gateway already running.

Description: Siebel gateway was not expected to be running. This may be due to the gateway having started outside Oracle Solaris Cluster control.

Solution: Please shutdown the gateway instance manually, and retry the previous operation.

378360 Validate - DHCP directory %s does not exist

Description: The DHCP resource could not validate that the DHCP directory defined in the /etc/inet/dhcpsvc.conf file for the PATH variable exists.

Solution: Ensure that /etc/inet/dhcpsvc.conf has the correct entry for the PATH variable by configuring DHCP appropriately, i.e. as defined within the Oracle Solaris Cluster Data Service for DHCP.

378427 prog <%s> step <%s> terminated due to receipt of signal

Description: ucmmd step terminated due to receipt of a signal.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified and if it recurs. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance.

378872 %s operation failed : %s.

Description: Specified system operation could not complete successfully.

Solution: This is as an internal error. Contact your authorized Oracle service provider with the following information. 1) Saved copy of /var/adm/messages file. 2) Output of "ifconfig -a" command.

379098 Request to mount QFS file systems returned successfully.

Description: This is a notification from the handler that the request to RGM to mount the shared qfs file systems returned without failure.

Solution: This is an informational message; no user action is needed.

379132 devfsadm successfully configured DID

Description: devfsadm command successfully configured DID devices.

Solution: This is an informational message, no user action is needed.

379450 reservation fatal error(%s) - fenced_node not specified

Description: The device fencing program has suffered an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available. Copies of /var/adm/messages from all nodes should be provided for diagnosis. It may be possible to retry the failed operation, depending on the nature of the error. If the message specifies the 'node_join' transition, then this node may be unable to access shared devices. If the failure occurred during the 'release_shared_scsi2' transition, then a node which was joining the cluster may be unable to access shared devices. In either case, it may be possible to reacquire access to shared devices by executing '/usr/cluster/lib/sc/run_reserve -c node_join' on all cluster nodes. If the failure occurred during the 'make_primary' transition, then a device group has failed to start on this node. If another node was available to host the device group, then it should have been started on that node. If desired, it might be possible to switch the device group to this node by using the cldevicegroup command. If no other node was available, then the device group will not have been started. You can use the cldevicegroup command to retry the attempt to start the device group. If the failure occurred during the 'primary_to_secondary' transition, then the shutdown or switchover of a device group has failed. The desired action may be retried.

379568 Failed to resolve CCR directory from the Nameserver

Description: The pnm proxy daemon could not get a reference to the CCR.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

379627 ct_pr_event_get_ppid: %s

Description: The rpc.pmfd was unable to retrieve the parent pid from a contract event. The rpc.pmfd will continue to monitor the process, but the rpc.pmfd may have missed an event of interest.

Solution: Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Oracle service provider.

379820 INTERNAL ERROR in J2EE probe calling scds_fm_tcp_write(): %s.

Description: The data service could not write to the J2EE engine port.

Solution: Informational message. No user action is needed.

380088 clq_sq_disk: Preempted from quorum device %s.

Description: Unable to locate this node's registration key on the quorum device. This node might have been preempted by another node. Because this node was expelled from the cluster, the node now halts.

Solution: Correct the problem that caused the node to be expelled from the cluster. The most common cause is a network communication failure between this node and other members of the cluster. After completing repairs, reboot the node back into the cluster.

380317 Failed to verify that all IPMP groups are in a stable state. Assuming this node cannot respond to client requests.

Description: The state of the IPMP groups on the node could not be determined.

Solution: Make sure all adapters and cables are working. Look in the /var/adm/messages file for message from the network monitoring daemon (cl_pnmd).

380365 (%s) t_rcvudata, res %d, flag %d: tli error: %s

Description: Call to t_rcvudata() failed. The "t_sndudata" man page describes possible error codes. udlmctl will exit.

Solution: Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your Oracle service representative.

380445 scds_pmf_stop() failed with error %s.

Description: Shutdown through PMF returned an error.

Solution: No user action needed.

380785 door_call: %s; will not retry

Description: The door_call failed with the specified reason.

Solution: No action necessary.

380939 SCSLM scslm_init pthread_create error <%s>

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

381244 in libsecurity mkdir of %s failed: %s

Description: The rpc.pmfd, rpc.fed or rgmd server was not able to create a directory to contain "cache" files for rpcbind information. The affected component should still be able to function by directly calling rpcbind.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

381386 Prog <%s> step <%s>: unkillable.

Description: The specified callback method for the specified resource became stuck in the kernel, and could not be killed with a SIGKILL. The UCMM reboots the node to prevent the stuck node from causing unavailability of the services provided by UCMM.

Solution: No action is required. This is normal behavior of the UCMM. Other syslog messages that occurred just before this one might indicate the cause of the method failure.

381577 getzonenamebyid failed in security_svc_reg.

Description: The getzonenamebyid(3C) operation failed.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

382169 Share path name %s not absolute.

Description: A path specified in the dfstab file does not begin with "/"

Solution: Only absolute path names can be shared with HA-NFS.

382252 Share path %s: file system %s is not mounted.

Description: The specified file system, which contains the share path specified, is not currently mounted.

Solution: Correct the situation with the file system so that it gets mounted.

382343 %s: Not root.

Description: A user other than root attempted to run this program.

Solution: If this error occurred during normal operation, save the contents of /var/adm/messages from all nodes and contact your Oracle service representative for assistance in diagnosing and correcting the problem.

382460 Failed to obtain SAM-FS constituent volumes from mount point %s: %s.

Description: HAStoragePlus was not able to determine the volumes that are part of this SAM-FS file system.

Solution: Check the SAM-FS file system configuration. If the problem persists, contact your authorized Oracle service provider.

382666 cl_execd: Error %d from pipe

Description: cl_execd program has encountered a failed pipe(2) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

382995 ioctl in negotiate_uid failed

Description: Call to ioctl() failed. The "ioctl" man page describes possible error codes. ucmmd will exit and the node will abort.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

383040 Failed to map adapter %s to an IPMP group, error = %d

Description: There was an error while attempting to map an adapter to an IPMP group.

Solution: This is an informational message. No action is required.

383045 dl_bind: bad ACK header %u

Description: An unexpected error occurred. The acknowledgment header for the bind request (to bind to the physical device) is bad. We are trying to open a fast path to the private transport adapters.

Solution: Reboot of the node might fix the problem.

383264 Function: validate - %s configured with address %s, please remove the address using zonecfg

Description: There is an IP address conflict between the SUNW.LogicalHostname resource and the configured zone.

Solution: Remove the IP address from the zones configuration with the zonecfg command.

383583 Instance number <%s> does not consist of 2 numeric characters.

Description: The instance number specified is not a valid SAP instance number.

Solution: Specify a valid instance number.

383706 NULL value returned for the resource property %s.

Description: NULL value was specified for the extension property of the resource.

Solution: For the property name check the syslog message. Any of the following situations might have occurred. Different user action is needed for these different scenarios. 1) If a new resource is created or updated, check whether the value of the extension property is empty. If it is, provide a valid value by using clresource. 2) For all other cases, treat it as an Internal error. Contact your authorized Oracle service provider.

383767 scha_cluster_close failed with %d

Description: Call to close the cluster information handle failed. The second part of the message gives the error code.

Solution: There could be other related error messages which might be helpful. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

384138 Failed to stop fault monitor

Description: An error prevented a resource's fault monitor from stopping.

Solution: Determine why the fault monitor process could not be stopped. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

384373 Failed to save old zpools.

Description: The online update of the HAStoragePlus resource is not successful because of failure in saving the old zpools that were present before updating the resource.

Solution: Check the syslog messages and try to resolve the problem. Try again to update the resource. If the problem persists, contact your authorized Oracle service provider.

384549 CCR: Could not backup the CCR table %s errno = %d.

Description: The indicated error occurred while backing up indicated CCR table on this node. The errno value indicates the nature of the problem. errno values are defined in the file /usr/include/sys/errno.h. An errno value of 28(ENOSPC) indicates that the root file system on the indicated node is full. Other values of errno can be returned when the root disk has failed(EIO) or some of the CCR tables have been deleted outside the control of the cluster software(ENOENT).

Solution: There may be other related messages on this node, which may help diagnose the problem, for example: If the root file system is full on the node, then free up some space by removing unnecessary files. If the root disk on the afflicted node has failed, then it needs to be replaced. If the indicated CCR table was accidently deleted, then boot this node in -x mode to restore the indicated CCR table from other nodes in the cluster or backup. The CCR tables are located at /etc/cluster/ccr/. Contact your authorized Oracle service provider for assistance.

384621 RDBMS probe successful

Description: This message indicates that Fault monitor has successfully probed the RDBMS server

Solution: No action required. This is informational message.

384629 Function: validate: Directory %s does not contain the PostgreSQL binaries

Description: The directory mentioned in the PGROOT variable does not contain the PostgreSQL binaries in its bin directory.

Solution: Provide the directory which does contain at least the PostgreSQL binaries in the path ./bin.

384651 Proxy monitor not running (%d)

Description: The Monitor of a resource of type SUNW.scalable_rac_server_proxy is not running.

Solution: None required. Informational message.

385026 asm_proxy_daemon - failed to determine named pipe (%s) elapsed time

Description: Failed to determine the elapsed time for the named pipe.

Solution: Check the syslog for further messages.

385176 Ifconfig proxy : Unexpected signal, Exiting.

Description: The ifconfig proxy program got an unexpected signal and is exiting.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

385407 t_alloc (open_cmd_port) failed with errno%d

Description: Call to t_alloc() failed. The "t_alloc" man page describes possible error codes. ucmmd will exit and the node will abort.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

385550 Can't setup binding entries from node %d for GIF node %d

Description: Failed to maintain client affinity for some sticky services running on the named server node due to a problem on the named GIF node. Connections from existing clients for those services might go to a different server node as a result.

Solution: If client affinity is a requirement for some of the sticky services, say due to data integrity reasons, switchover all global interfaces (GIFs) from the named GIF node to some other node.

385655 reservation fatal error(%s) - Unable to retrieve DID device information

Description: The device fencing program has suffered an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

385803 Nodelist must contain an even number of nodes.

Description: The HADB resource must be configured to run on an even number of Oracle Solaris Cluster nodes.

Solution: Recreate the resource group and specify an even number of Oracle Solaris Cluster nodes in the nodelist.

385864 scha_resource_get_zone() failed to retrieve the resource property %s of %s: %s.

Description: Failed to retrieve the specified property of a resource.

Solution: Check the syslog messages around the time of the error for messages indicating the cause of the failure. If this error persists, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

385866 Function: validate: Directory %s does not contain the MySQL Cluster ndbd configuration file

Description: A directory is specified in the DATA_DIR variable which does not contain a my.cnf file.

Solution: Specify a directory in the DATA_DIR variable in the parmeter file, which contains the my.cnf file.

385902 pmf_search_children: Error signaling <%s>: %s

Description: An error occured while rpc.pmfd attempted to send a signal to one of the processes of the given tag. The reason for the failure is also given. The signal was sent to the process as a result of some event external to rpc.pmfd. rpc.pmfd "intercepted" the signal, and is trying to pass the signal on to the monitored process.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

385991 monitor_check: fe_method_full_name() failed for resource <%s>, resource group <%s>, node <%s>

Description: During execution of a scha_control(1HA,3HA) function, the rgmd daemon was unable to assemble the full method pathname for the MONITOR_CHECK method. This is considered a MONITOR_CHECK method failure. This in turn will prevent the attempted failover of the resource group from its current master to a new master.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

386072 chdir: %s

Description: The rpc.pmfd server was not able to change directory. The message contains the system error. The server does not perform the action requested by the client, and an error message is output to syslog.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

386282 ccr_initialize failure

Description: An attempt to start the scdpmd failed.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

386327 Stop Startup script using pmfadm failed. tag %s error=%s

Description: The agent's attempt to stop a previous instance startup instruction that was issued to it failed.

Solution: Contact your Oracle support representative for further assistance.

386333 SCSLM <%s> meth 0x%x with running 0x%x

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

386842 set_scproxy_resource - Oracle Grid Infrastructure resource %s has ACTION_SCRIPT=%s which is incorrect.

Description: The Oracle Grid Infrastructure resource sun.<resource> ACTION_SCRIPT attribute value is incorrect.

Solution: You must set the ACTION_SCRIPT attribute for the Oracle Grid Infrastructure resource, sun.<resource>, equal to <basedir>/SUNWscor/dsconfig/bin/scproxy_crs_action. Note that <resource> represents the Oracle Solaris Cluster SUNW.ScalDeviceGroup resource name and <basedir> is typically /opt. Refer to the Oracle Solaris Cluster documentation for information on how to do this.

387003 CCR: CCR metadata not found.

Description: The CCR is unable to locate its metadata.

Solution: Boot the offending node in -x mode to restore the indicated table from backup or other nodes in the cluster. The CCR tables are located at /etc/cluster/ccr/. Contact your authorized Oracle service provider for assistance.

387232 resource %s monitor enabled.

Description: This is a notification from the rgmd that the operator has enabled monitoring on a resource. This message can be used by system monitoring tools.

Solution: This is an informational message; no user action is needed.

387288 clcomm: Path %s online

Description: A communication link has been established with another node.

Solution: No action required.

387361 [PID %d] Could not get event listener door handle : status %d, error %s

Description: The specified process could not get to the door of the proxy event listener daemon.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

387572 File %s should be readable and writable by %s.

Description: A program required the specified file to be readable and writable by the specified user.

Solution: Set correct permissions for the specified file to allow the specified user to read it and write to it.

388195 scf_handle_create failed: %s

Description: An API call failed.

Solution: Examine log files and syslog messages to determine the cause of the failure. Take corrective action based on any related messages. If the problem persists, report it to your Oracle support representative for further assistance.

388316 acfs_proxy_daemon - restarting to include the new Proxy_probe_interval (%s)

Description: Restarting as the Proxy_probe_interval has changed.

Solution: None required. The ACFS proxy daemon will be restarted to ensure the new Proxy_probe_interval value is used.

388330 Text server stopped.

Description: The Text server has been stopped by Oracle Solaris Cluster HA for Sybase.

Solution: This is an informational message, no user action is needed.

388501 Error while unbinding 'ifconfig_proxy_server' in the name server. Exiting.

Description: The ifconfig proxy program could not register the corba object in the nameserver.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

388555 Usage: %s [-c|-u] -R <resource-name> -T <type-name> -G <group-name> [-r <sys_def_prop>=<value> ...] [-x <ext_prop>=<value> ...] [-Z <zone-name>]

Description: Incorrect arguments are passed to the callback method of a cluster data service agent.

Solution: This error might occur while developing and testing a new agent, if a method is manually invoked with incorrect command line arguments. If seen on a production cluster, this message indicates an internal error. Contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

388645 Failed to open the configuration file %s : %s.

Description: The zone handler failed to open the specified configuration file.

Solution: Check for the error message and rectify the problem.

389071 Validate - Group mqbrkrs does not exist

Description: The WebSphere MQ Broker resource failed to validate that the group mqbrkrs exists.

Solution: Ensure that the group mqbrkrs exists.

389221 could not open configuration file: %s

Description: The specified configuration file could not be opened.

Solution: Check if the configuration file exists and has correct permissions. If the problem persists, contact your Oracle Service representative.

389231 clcomm: inbound_invo::cancel:_state is 0x%x

Description: The internal state describing the server side of a remote invocation is invalid when a cancel message arrives during processing of the remote invocation.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

389369 Validation failed. SYBASE ASE STOP_FILE %s is not executable.

Description: File specified in the STOP_FILE extension property is not an executable file.

Solution: Please check the permissions of file specified in the STOP_FILE extension property. File should be executable by the Sybase owner and root user.

389516 NULL value returned for the extension property %s.

Description: NULL value was specified for the extension property of the resource.

Solution: For the property name check the syslog message. Any of the following situations might have occurred. Different user action is needed for these different scenarios. 1) If a new resource is created or updated, check whether the value of the extension property is empty. If it is, provide a valid value by using clresource. 2) For all other cases, treat it as an Internal error. Contact your authorized Oracle service provider.

390130 Failed to allocate space for %s.

Description: An internal error has occurred.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

390212 Core files in ${SCCOREDIR}: ${CORES_FILES}

Description: One of the daemon launched by /etc/init.d/bootcluster script has core dumped.

Solution: Provide core dumps to your authorized Oracle service provider. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

390515 Function: validate - %s (%s) already in use on %s:%s for %s, please resolve this conflict

Description: The logical host is used in another zone already. A logical host can not be used in two zones at the same time.

Solution: Resolve the conflicting IP address configuration for your zones.

390782 lkcm_cfg: Unable to get new nodelist

Description: Error when reading nodelist.

Solution: This is an internal error. Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your Oracle service representative.

391177 Failed to open %s: %s.

Description: HA Storage Plus failed to open the specified file.

Solution: Check the system configuration. If the problem persists, contact your authorized Oracle service provider.

391240 RAC server %s is not running. Manual intervention is required.

Description: The the fault monitor for the RAC server instance has identified that the instance is no longer running. The fault monitor does NOT attempt to restart or failover the resource or resource group.

Solution: The cause of the instance failure should be investigated, and once rectified, the RAC server instance should be restarted.

391502 Database is still running after %d seconds. Selecting new Sun Cluster node to run the stop command.

Description: The database is still running but the resource on the Oracle Solaris Cluster node that was selected to run the hadbm stop command is now offline, possibly because of an error while running the hadbm command. A different Oracle Solaris Cluster node will be selected to run the hadbm stop command again.

Solution: This is an informational message, no user action is needed.

391738 (%s) bad poll revent: %x (hex)

Description: Call to poll() failed. The "poll" man page describes possible error codes. udlmctl will exit.

Solution: Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your Oracle service representative.

392288 Unmounting the file systems is completed successfully.

Description: Self explanatory.

Solution: This is an informational message, no user action is needed.

392732 No suitable adapter is authorized to be used with resource %s on zone cluster %s.

Description: There is no adapter found on this system that is authorized to be used for this zone cluster.

Solution: Use the clzonecluster(1M) command to configure the adapters to be used for this zone cluster and run the command to create the resource.

392782 Failed to retrieve the property %s for %s: %s.

Description: API operation has failed in retrieving the cluster property.

Solution: For property name, check the syslog message. For more details about API call failure, check the syslog messages from other components.

392998 Fault monitor probe response time exceeded timeout (%d secs). The timeout for subsequent probes will be temporarily increased by 10%%

Description: The time taken for the last fault monitor probe to complete was greater than the resource's configured probe timeout, so a timeout error occurred. The timeout for subsequent probes will be increased by 10% until the probe response time drops below 50% of the timeout, at which point the timeout will be reduced to it's configured value.

Solution: The database should be investigated for the cause of the slow response and the problem fixed, or the resource's probe timeout value increased accordingly.

393382 DNS successfully stopped

Description: The STOP method for DNS for was successful.

Solution: No action needed.

393487 The file system associated with mount point %s will be locally mounted in zone cluster %s. Local file systems cannot be specified with scalable service resources.

Description: HAStoragePlus detected an inconsistency in its configuration: the resource group has been specified as scalable; therefore, local file systems cannot be specified in the FilesystemMountPoints extension property.

Solution: Correct either the resource group type or remove the local file system from the FilesystemMountPoints extension property.

393552 Insufficient memory.

Description: There is not enough memory available.

Solution: Lack of memory might lead to other problems. You must free up memory on the node or add more memory to the system. If that does not resolve the problem, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

393934 Stopping the adaptive server with wait option.

Description: The Oracle Solaris Cluster HA for Sybase will attempt to shutdown the Sybase adaptive server using the wait option.

Solution: This is an informational message, no user action is needed.

393957 Failed to read mount point on local node

Description: During dual-partition upgrade in a live upgrade scenario, the mount point information is not present.

Solution: Refer to documentation about recovering from a failed dual-partition upgrade in a live upgrade scenario.

393960 sigaction failed in set_signal_handler

Description: The ucmmd has failed to initialize signal handlers by a call to sigaction(2). The error message indicates the reason for the failure. The ucmmd will produce a core file and will force the node to halt or reboot to avoid the possibility of data corruption.

Solution: Save a copy of the /var/adm/messages files on all nodes and of the ucmmd core. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

394325 Received notice that IPMP group %s has failed.

Description: The status of the named IPMP group has become degraded. If possible, the scalable resources currently running on this node with monitoring enabled will be relocated off of this node, if the IPMP group stays in a degraded state.

Solution: Check the status of the IPMP group on the node. Try to fix the adapters in the IPMP group.

394661 Failed to stop the Node Agent %s and the server instances with SIGKILL.

Description: The Stop method failed to stop the Node Agent and the Application Server instances even with SIGKILL.

Solution: Manually stop or kill the Node Agent and Application Server instances.

395008 Error reading stopstate file.

Description: The stopstate file could not be opened and read.

Solution: Examine other syslog messages occurring around the same time on the same node, to see if the source of the problem can be identified.

395353 Failed to check whether the resource is a network address resource.

Description: While retrieving the IP addresses from the network resources, the attempt to check whether the resource is a network resource or not has failed.

Solution: Internal error or API call failure might be the reasons. Check the error messages that occurred just before this message. If there is internal error, contact your authorized Oracle service provider. For API call failure, check the syslog messages from other components.

395359 Function: validate: The Environment script %s is not a valid c shell script

Description: The environment script specified in the parameter file needs to be a valid c shell script, because the login shell of the PostgreSQL user is c shell compliant.

Solution: Fix the environment script until it passes csh -n scriptname.

395492 qdmd: ORB initialization failed. Exiting.

Description: The quorum device monitoring daemon received an error during ORB initialization.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

395794 validate_dg_asm_dependency - The Oracle ASM disk group resource (%s) requires that an Oracle ASM instance resource is created first

Description: The Oracle ASM disk group resource reuqires an offline restart dependency against an Oracle ASM instance resource, however no such resource exists.

Solution: Ensure that a resource using type SUNW.scalable_asm_instance or SUNW.scalable_asm_insatnce_proxy is created before creating an Oracle ASM disk group resource.

396490 Misconfiguration of the RAC framework resource group. The UDLM resource is present, while the Oracle UDLM package is not installed.

Description: The Oracle UDLM resource is configured in the RAC framework resource group while the Oracle UDLM package (ORCLudlm) is not installed.

Solution: Configure the RAC framework resource group to have only one SKGXN interface, either the Oracle UDLM or the Oracle Solaris Cluster native and then start the resource group.

396509 Function: validate - The host %s is not configured UP on the hosts adapters

Description: The host specified in the PGHOST variable is not configured up on the hosts adapters.

Solution: Fix either the network configuration or the PGHOST variable

396727 Attempting to check for existence of %s pid %d resulted in error: %s.

Description: HA-NFS fault monitor attempted to check the status of the specified process but failed. The specific cause of the error is logged.

Solution: No action. HA-NFS fault monitor would ignore this error and would attempt this operation at a later time. If this error persists, check to see if the system is lacking the required resources (memory and swap) and add or free resources if required. Reboot the node if the error persists.

396901 clq_netapp: quorum open error: No %s data for quorum device was found in CCR --- quorum device %s will be unavailable.

Description: The configuration information obtained from the CCR for the NetApp NAS device was missing one or more items of required data. The device will not be available.

Solution: Remove the device using scconf, and try adding it again.

396947 clq_scsi3: One of the key 0x%llx was found to be invalid value on quorum device %s.

Description: One of the registration keys is found to be invalid value on specified quorum device. This error occurs because of unexpected behavior from the device driver or multipathing driver or device's firmware.

Solution: Unconfigure the quorum device and scrub it and then configure it back as a quorum device. Please also look for updates to the device driver, multipathing driver or device firmware. If no updates are available, contact the Oracle device driver support team.

397020 Unix DLM abort failed

Description: Failed to abort unix dlm. This is an error that can be ignored.

Solution: None.

397340 Monitor initialization error. Unable to open resource: %s Group: %s: error %d

Description: Error occured in monitor initialization. Monitor is unable to get resource information using API calls.

Solution: Check syslog messages for errors logged from other system modules. Stop and start fault monitor. If error persists then disable fault monitor and report the problem.

397371 'dbmcli -d <LC_NAME> -n <logical host name> db_state' timed out.

Description: The SAP utility listed timed out.

Solution: Make sure the logical host name resource is online.

397421 fork error: %s

Description: The libclcontract code was not able to fork the specified process. The message contains the system error. The server process (which is using libclcontract) does not perform the action requested by the client, and an error message is output to syslog.

Solution: Determine if the machine is running out of memory. If this is not the case, save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

397724 Error when stopping Oracle CRS using: "%s", error(%s), "%s".

Description: Stop of Oracle CRS failed.

Solution: Check errors on the system and correct them before restarting the CRS framework resource. If you cannot resolve this problem, contact your Oracle service representative for assistance.

397940 INTERNAL ERROR in J2EE probe calling scds_fm_tcp_read(): %s.

Description: The data service could not read the J2EE probe reply.

Solution: Informational message. No user action is needed.

398023 validate_cluster - The CLUSTER_PARTICIPANT variable in file %s is not set to "YES" (%s).

Description: The CLUSTER_PARTICIPANT variable must be set to "YES" when multiple BI servers are configured in a scalable resource group.

Solution: Ensure that the CLUSTER_PARTICIPANT variable in the NQSConfig.INI file is set to "YES".

399037 mc_closeconn failed to close connection

Description: The system has run out of resources that is required to process connection terminations for a scalable service.

Solution: If cluster networking is required, add more resources (most probably, memory) and reboot.

399172 first probe for N1 Grid Service Provisioning System Tomcat was unsuccessful, try again in 5 seconds

Description: The first probe for the Tomcat will be rescheduled in 5 seconds

Solution: None

399216 clexecd: Got an unexpected signal %d in process %s (pid=%d, ppid=%d)

Description: clexecd program got a signal indicated in the error message.

Solution: clexecd program will exit and node will be halted or rebooted to prevent data corruption. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

399477 Function: validate_probe - Directory for the parameter file %s does not exist any more, a faiover will occur

Description: The file specified in the PARFILE variable does not exist any more.

Solution: Create the directory and restore the parameter file. None if it was a lost mount.

399534 Failed to add the domain %s using %s/%s.xml.

Description: Defining the domain using an XML file failed.

Solution: The command /opt/SUNWldm/bin/ldm "add-domain" failed to define the domain. Determine if you have specified the correct domain name when registering the resource.

399548 %s failed with exit code %d.

Description: The specified command returned the specified exit code.

Solution: Examine other syslog messages occurring around the same time on the same node, to see if the source of the problem can be identified.

399552 "pmfctl -S": Error suspending pid %d for tag <%s>: %d

Description: An error occured while rpc.pmfd attempted to suspend the monitoring of the indicated pid, possibly because the indicated pid has exited while attempting to suspend its monitoring.

Solution: Check if the indicated pid has exited, if this is not the case, Save the syslog messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

399753 CCR: CCR data server failed to register with CCR transaction manager.

Description: The CCR data server on this node failed to join the cluster, and can only serve readonly requests.

Solution: There may be other related CCR messages on this and other nodes in the cluster, which may help diagnose the problem. It may be necessary to reboot this node or the entire cluster.

399803 validate_server - The SERVERS list (%s) does not match the hostnames of the nodes in the resource group node list (%s).

Description: The list of BI servers in the NQClusterConfig.INI file does not match the hostnames of the nodes in the resource group node list.

Solution: Ensure that the BI servers defined in the NQClusterConfig.INI file match the hostnames of the nodes in the resource group node list.