Sun Cluster Error Messages Guide for Solaris OS

Message IDs 300000–399999

This section contains message IDs 300000–399999.

300278 Validate - CON_LIMIT=%s is incorrect, default CON_LIMIT=70 is being used

Description:

The value specified for CON_LIMIT is invalid.

Solution:

Either accept the default value of CON_LIMIT=70 or change the value of CON_LIMIT to be less than or equal to 100 when registering the resource.

300397 resource %s property changed.

Description:

This is a notification from the rgmd that a resource's property has been edited by the cluster administrator. This message can be used by system monitoring tools.

Solution:

This is an informational message; no user action is needed.

300537 scvxvmlg error - lstat(%s) failed with errno %d

Description:

The program responsible for maintaining the VxVM namespace was unable to access the global device namespace. If configuration changes were recently made to VxVM diskgroups or volumes, this node may be unaware of those changes. Recently created volumes may be unaccessible from this node.

Solution:

Verify that the /global/.devices/node@N (N = this node's node number) is mounted globally and is accessible. If no configuration changes have been recently made to VxVM diskgroups or volumes and all volumes continue to be accessible from this node, then no further action is required. If changes have been made, the device namespace on this node can be updated to reflect those changes by executing '/usr/cluster/lib/dcs/scvxvmlg'. If the problem persists, contact your authorized Sun service provider to determine whether a workaround or patch is available.

300598 Disk not found in CCR. Internal error. Line %d

Description:

Internal error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

300705 Failed to look up the service group.

Description:

Failed to look up the internal data structure during connection establishment.

Solution:

The connection involved might be disconnected. If it happens repeatedly contact your authorized Sun service provider to determine whether a workaround or patch is available.

300777 reservation warning(%s) - Unable to open device %s, errno %d, will retry in %d seconds

Description:

The device fencing program has encountered errors while trying to access a device. The failed operation will be retried

Solution:

This is an informational message, no user action is needed.

300783 Resource Type "%s" does not exist.

Description:

The SUNW.qfs resource type is not registered in the cluster.

Solution:

Register the SUNW.qfs resource type, create the required instances of this resource type, and repeat the operation. For information about how to configure the shared QFS file system with Sun Cluster, see your Sun Cluster documentation and your Sun StorEdge QFS documentation.

301092 file specified in ENVIRONMENT_FILE parameter %s does not exist.

Description:

The 'Environment_File' property was set when configuring the resource. The file specified by the 'Environment_File' property may not exist. The file should be readable and specified with a fully qualified path.

Solution:

Specify an existing file with a fully qualified file name when creating a resource.

301114 Command failed: /bin/rm -f %s/ppid/%s

Description:

An attempt to remove the directory and all the files in the directory failed. This command is being executed as the user that is specified by the extension property DB_User.

Solution:

No action is required.

301573 clcomm: error in copyin for cl_change_flow_settings

Description:

The system failed a copy operation supporting a flow control state change.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

301603 fatal: cannot create any threads to handle switchback

Description:

The rgmd daemon was unable to create a sufficient number of threads upon starting up. This is a fatal error. The rgmd will produce a core file and will force the node to halt or reboot to avoid the possibility of data corruption.

Solution:

Make sure that the hardware configuration meets documented minimum requirements. Save a copy of the /var/adm/messages files on all nodes, and of the rgmd core file. Contact your authorized Sun service provider for assistance in diagnosing the problem.

301635 clexecd: close returned %d. Exiting.

Description:

clexecd program has encountered a failed thr_create(3THR) system call. The error message indicates the error number for the failure.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

302670 udlm_setup_port: fcntl: %d

Description:

A server was not able to execute fnctl(). udlm exits and the node aborts and panics.

Solution:

This is an internal error. Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your Sun service representative.

303009 validate: EnvScript %s does not exist but it is required

Description:

The environment script $Filename is set in the parameter file but does not exist.

Solution:

set the variable EnvScript in the parameter file mentioned in option -N of the start, stop and probe command to a valid contents.

303231 mount_client_impl::remove_client() failed attempted RM change_repl_prov_status() to remove client, spec %s, name %s

Description:

The system was unable to remove a PXFS replica on the node that this message was seen.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

303502 Logical changepw principal does not exist in %s.

Description:

The logical host name associated with the "changepw" service principal does not exist in the /etc/krb5/kadm5.keytab file.

Solution:

Create and/or add the "changepw/<logical host name>" service principal's keys in the /etc/krb5/kadm5.keytab file. Note: that the logical host name must be fully qualified.

303630 Cannot execute %s: %d.

Description:

Failure in executing the command.

Solution:

Check the syslog message for the command description. Check whether the system is low in memory or the process table is full and take appropriate action. Make sure that the executable exists.

303805 Cannot change the IPMP group on the local host.

Description:

A different IPMP group for property NetIfList is specified in clreslogicalhostname command. The IPMP group on local node is set at resource creation time. Users may only update the value of property NetIfList for adding a IPMP group on a new node.

Solution:

Rerun the clreslogicalhostname command with proper value for the NetIfList property.

303941 Unsuccessful probe of %s port %d for non-secure resource %s. (%s)

Description:

An error occurred while fault monitor attempted to probe the health of the data service.

Solution:

Wait for the fault monitor to correct this by doing restart or failover. For more error description, look at the syslog messages.

304365 clcomm: Could not create any threads for pool %d

Description:

The system creates server threads to support requests from other nodes in the cluster. The system could not create any server threads during system startup. This is caused by a lack of memory.

Solution:

There are two solutions. Install more memory. Alternatively, take steps to reduce memory usage. Since the creation of server threads takes place during system startup, application memory usage is normally not a factor.

304749 Probe for resource sckrb5 successful.

Description:

The complete or simple probe for the HA-KDC service has completed successfully.

Solution:

This is for informational purposes only, no action is required.

305163 Start of HADB database completed successfully.

Description:

The resource was able to successfully start the HADB database.

Solution:

This is an informational message, no user action is needed.

305298 cm_callback_impl abort_trans: exiting

Description:

ucmm callback for abort transition failed.

Solution:

Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Sun service provider for assistance in diagnosing the problem.

305331 Sun Cluster is waiting for lock on device %s. Lock is currently held by %s for fsck/mount.

Description:

Sun Cluster boot is waiting for the mentioned node to complete fsck/mount of a global filesystem and release the lock on a device.

Solution:

Check the console of the specified cluster node to see if any of the nodes are waiting for a manual fsck to be done. If this is so, exiting the shell after performing the fsck will allow the boot of the other nodes to continue.

306407 Failed to stop Adaptive server.

Description:

Sun Cluster HA for Sybase failed to stop using KILL signal.

Solution:

Please examine whether any Sybase server processes are running on the server. Please manually shutdown the server.

306483 scf_transaction_property_change failed error %d: %s

Description:

An API call failed.

Solution:

Examine log files and syslog messages to determine the cause of the failure. Take corrective action based on any related messages. If the problem persists, report it to your Sun support representative for further assistance.

307195 clcomm: error in copyin for cl_read_flow_settings

Description:

The system failed a copy operation supporting flow control state reporting.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

307322 Unable to create thread. Exiting.

Description:

clexecd program has encountered a failed thr_create(2) system call. The error message indicates the error number for the failure.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

307531 open: %s

Description:

open failed for the specified reason. The specified program will be terminated and this zone will not be able to host applications.

Solution:

Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Sun service provider for assistance in diagnosing the problem.

307657 Oracle UDLM package is not installed. %s not found.

Description:

Oracle UNIX Distributed Lock Manager (UDLM) is not properly installed on this node. The UDLM reconfiguration program could not locate the lock manager binary at the location indicated in the message. Oracle OPS/RAC will not be able to function on this node.

Solution:

If you want to run OPS/RAC on this cluster node, verify installaton of ORCLudlm package. Refer to Oracle's documentation for installaton of Oracle UDLM.

308100 Validate - Couldn't retrieve Samba version number

Description:

The Samba resource tries to validate that an acceptable version of Samba is being deployed, however it was unable to retrieve the Samba version number.

Solution:

Check that Samba has been installed correctly

308297 Directory %s, exported from filer %s, is not configured within SunCluster.

Description:

The specified directory, which is exported from the specified NAS device, has not yet been configured with Sun Cluster.

Solution:

Run the 'scnasdir' command to configure the directory with Sun Cluster and repeat the operation.

308378 Derby data service stop method returned with error %s

Description:

The derby data service could not stop for an unknown reason.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

309961 Error during reading the property from repository %s

Description:

There was an error in reading the property of the SMF service instance from the repository

Solution:

Check the SMF manpage to know more about the error.Also make sure the basic SMF functionalities are working fine.Contact SUN vendor for more help.

310084 scal_initialize() call failed.

Description:

There was an error in initializing.

Solution:

Contact your authorized Sun service provider for assistance in diagnosing the problem.

310555 CMM: Quorum device %d (%s) added; votecount = %d, bitmask of nodes with configured paths = 0x%llx.

Description:

The specified quorum device with the specified votecount and configured paths bitmask has been added to the cluster. The quorum subsystem treats a quorum device in maintenance state as being removed from the cluster, so this message will be logged when a quorum device is taken out of maintenance state as well as when it is actually added to the cluster.

Solution:

This is an informational message, no user action is needed.

310953 clnt_control of program %s failed %s.

Description:

HA-NFS fault monitor failed to reset the retry timeout for retransimitting the rpc request.

Solution:

Save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

311291 sema_post badchild: %s

Description:

The rpc.pmfd server was not able to act on a semaphore. The message contains the system error. The server does not perform the action requested by the client, and an error message is output to syslog.

Solution:

Determine if the machine is running out of memory. If this is not the case, save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

311505 The resource group %s containing the resource %s is suspended. This has blocked a resource %s attempt on %s

Description:

The operation requested by scha_control is prevented because the resource group is suspended.

Solution:

No action required. To enable automatic recovery actions, use 'clresourcegroup resume'

311644 fork_event depth: ct_pr_event_get_pid: %s

Description:

The rpc.pmfd was unable to retrieve the pid from a contract event. The rpc.pmfd will continue to monitor the process, but the rpc.pmfd may have missed an event of interest.

Solution:

Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Sun service provider.

312053 Cannot execute %s: %s.

Description:

Failure in executing the command.

Solution:

Check the syslog message for the command description. Check whether the system is low in memory or the process table is full and take appropriate action. Make sure that the executable exists.

312124 Failed to establish socket's default destination: %s

Description:

Default destination for a raw icmp socket could not be established.

Solution:

If the error message string thats logged in this message does not offer any hint as to what the problem could be, contact your authorized Sun service provider.

312406 setproject call failed : %s

Description:

setproject call failed. Should never occur.

Solution:

Verify project database. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

312826 The Skgxn Service which provides Oracle RAC support in the ucmmd daemon encountered a non-recoverable error and must abort

Description:

The Oracle RAC clustered database relies on the Skgxn Service provided by the ucmmd daemon for group membership services and will not function without it. The Skgxn Service has encountered a non-recoverable error and could not provide service.

Solution:

Save copies of /var/adm/messages and /var/cluster/ucmm/ucmm_reconf.log files from all of the nodes in the cluster. Check for and save any core files of the ucmmd daemon or operating system. Contact your authorized Sun service provider for assistance in diagnosing the problem. Please provide to them the saved files which are mentioned above.

313500 Probe - Fatal: Can't determine Schedd pid file - %s/schedd/schedd.pid does not exist.

Description:

The file ${qmaster_spool_dir}/schedd.pid was not found. ${qmaster_spool_dir}/schedd.pid is the second argument to the 'Shutdown' function. 'Shutdown' is called within the stop script of the sge_schedd resource.

Solution:

Confirm the file 'schedd.pid' exists. Said file should be found in the respective spool directory of the daemon in question.

313506 stop_chi - WebSphere MQ Channel Initiator %s stopped

Description:

The specified WebSphere MQ Channel Initiator has been stopped.

Solution:

None required. Informational message.

313510 SAP xserver is not available.

Description:

SAP xserver is not running currently.

Solution:

Informative message, no action is required.

313784 Admin Disable is been called. The stop method of the service will be called and outcome is unknown.For proper functioning of the res, continue by disable the resource first

Description:

This message comes when user does "svcadm disable". Since manual "disabling" of a service is not encouraged once the service

Solution:

Check for the validity and the states of resource and services.Contact SUN vendor for more help.But this should not be a problem in normal operation of the delegated restarter

313867 Unknown step: %s

Description:

Request to run an unknown udlm step.

Solution:

None.

314314 prog <%s> step <%s> terminated due to receipt of signal <%d>

Description:

ucmmd step terminated due to receipt of a signal.

Solution:

Examine other syslog messages occurring at about the same time to see if the problem can be identified and if it recurs. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Sun service provider for assistance.

314334 Falied to do lstat() on test-file %s : %s

Description:

The lstat() operation on the test file for I/O operations failed. One possible cause of this error is that the test file has been deleted. The deletion of this file might be caused by malicious activity in your system.

Solution:

Restart the ScalMountPoint resource.

314356 resource %s enabled.

Description:

This is a notification from the rgmd that the operator has enabled a resource. This message can be used by system monitoring tools.

Solution:

This is an informational message; no user action is needed.

314358 Command %s failed to complete. Return code is %d.

Description:

The listed command failed to complete with the listed return code. The return code is from the script db_clear.

Solution:

Look for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Sun service provider.

315446 node id <%d> is out of range

Description:

The low-level cluster machinery has encountered an error.

Solution:

Look for other syslog messages occurring just before or after this one on the same node; they may provide a description of the error.

315699 mc_multi_openconn failed to open connection.

Description:

Failed to allocate memory during connection establishment for an SCTP non-sticky service.

Solution:

Install more memory, increase swap space, or reduce peak memory consumption.

315729 WARNING: Unable to get privatelink IP address for nodeid %d

Description:

Call to get privatelink IP address for node failed.

Solution:

Make sure entries in /etc/nsswitch.conf are correct to get information about this node.

316215 Process sapsocol is already running outside of Sun Cluster. Will terminate it now, and restart it under Sun Cluster.

Description:

The SAP OS collector process is running outside of the control of Sun Cluster. HA-SAP will terminate it and restart it under the control of Sun Cluster.

Solution:

Informational message. No user action needed.

316625 Timeout monitoring on method tag <%s> has been %s.

Description:

The timeout monitoring on the running method is being suspended or resumed because a device group switchover has started or finished respectively.

Solution:

This is just an informational message.

316649 pthread_rwlock_unlock err %d line %d

Description:

Internal error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

317213 in libsecurity for program %s (%lu); setnetconfig failed: %s

Description:

The specified server was not able to initiate an rpc connection, because it could not get the network database handle. The server does not start. The rpc error message is shown. An error message is output to syslog.

Solution:

Save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

317928 dbmcli option (%s) is not 'db_warm' nor 'db_online'.

Description:

The extension property in the message is set to an invalid value.

Solution:

Change the value of the extension property to a valid value.

318011 in libsecurity for program %s (%lu); file registration failed for transport %s

Description:

A server (rpc.pmfd, rpc.fed or rgmd) was not able to create the "cache" file to duplicate the rpcbind information. The server should still be able to receive requests from clients (using rpcbind). An error message is output to syslog.

Solution:

Save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

318313 monitor_check: set_env_vars() failed for resource <%s>, resource group <%s>, node <%s>

Description:

During execution of a scha_control(1HA,3HA) function, the rgmd daemon was unable to set up environment variables for method execution, causing a MONITOR_CHECK method invocation to fail. This in turn will prevent the attempted failover of the resource group from its current master to a new master.

Solution:

Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Sun service provider for assistance in diagnosing and correcting the problem.

319048 CCR: Cluster has lost quorum while updating table %s, it is possibly in an inconsistent state - ABORTING.

Description:

The cluster lost quorum while the indicated table was being changed, leading to potential inconsistent copies on the nodes.

Solution:

Check if the indicated table are consistent on all the nodes in the cluster, if not, boot the cluster in -x mode to restore the indicated table from backup. The CCR tables are located at /etc/cluster/ccr/.

319261 liveCache %s failed to start.

Description:

liveCache started up with error.

Solution:

Sun Cluster will fail over the liveCache resource to another available node. No user action is needed.

319374 Incoming argument size is zero.

Description:

An internal error has occurred in the inter-process communication between rgmd and another clustering process. Other related error messages might precede or follow this one in the syslog output.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

319375 clexecd: wait_for_signals got NULL.

Description:

clexecd problem encountered an error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

319413 Siebel server can be started only after Siebel database and Siebel gateway are running, and the scsblconfig file is correctly configured.

Description:

This is a warning message indicating a problem in determining the status of Siebel database and/or the Siebel gateway.

Solution:

Please verify that the scsblconfig file is correctly configured, and that the Siebel database and Siebel gateway are up before attempting to start the Siebel server.

319602 daemon started.

Description:

The scdpmd is started.

Solution:

No action required.

319737 The raw device to fsck is not specified in vfstab for mount point : %s.

Description:

The 'device to fsck' field is missing from the vfstab entry for the specified mount point.

Solution:

Add the 'device to fsck' field to the vfstab entry for the specified mount point and repeat the operation.

320970 Failed to retrieve the node id from the node name for node %s: %s.

Description:

Self explanatory.

Solution:

Check the cluster configuration. If the problem persists, contact your authorized Sun service provider.

321245 resource <%s> is disabled but not offline

Description:

While attempting to execute an operator-requested enable or disable of a resource, the rgmd has found the indicated resource to have its Onoff_switch property set to DISABLED, yet the resource is not offline. This suggests corruption of the RGM's internal data and will cause the enable or disable action to fail.

Solution:

This may indicate an internal error or bug in the rgmd. Contact your authorized Sun service provider for assistance in diagnosing and correcting the problem.

321832 Could not set the contract id to 0 in the repository

Description:

Not able to set the desired values in the SMF repository.

Solution:

Check the SMF manpage to know more about the error.Also make sure the basic SMF functionalities are working fine.Contact SUN vendor for more help.

321962 Command %s failed to complete. HA-SAP will continue to start SAP.

Description:

The command to cleanipc failed to complete.

Solution:

This is an internal error. No user action needed. Save the /var/adm/messages from all nodes. Contact your authorized Sun service provider.

322159 Error setting states inrepository: %s: %d

Description:

Have problems in starting a communication with the SMF repository

Solution:

Depending on the error, check the SMF man page.Contact SUN vendor for help.

322252 %s failed to stop the application and returned with %d

Description:

A command was run to stop the application but it failed with an error. Both the command and the error code are specified in the message.

Solution:

Save the syslog and contact your authorized Sun service provider.

322323 INTERNAL ERROR in J2EE probe calling scds_fm_tcp_disconnect(): %s.

Description:

The data service detected an internal error from scds.

Solution:

Informational message. No user action is needed.

322373 Unable to unplumb %s%d, rc %d

Description:

Topology Manage is done with using the interface and failed to unplumb the adapter.

Solution:

Need a user action for this message.

322642 Error binding to %s port %d for non-secure resource %s: %s (%s)

Description:

An error occurred while fault monitor attempted to probe the health of the data service.

Solution:

Wait for the fault monitor to correct this by doing restart or failover. For more error description, look at the syslog messages.

322797 Error registering provider '%s' with the framework.

Description:

The device configuration system on this node has suffered an internal error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

322862 clcomm: error in copyin for cl_read_threads_min

Description:

The system failed a copy operation supporting flow control state reporting.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

322879 clcomm: Invalid copyargs: node %d pid %d

Description:

The system does not support copy operations between the kernel and a user process when the specified node is not the local node.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

322908 CMM: Failed to join the cluster: error = %d.

Description:

The local node was unsuccessful in joining the cluster.

Solution:

There may be other related messages on this node that may indicate the cause of this failure. Resolve the problem and reboot the node.

322920 Error unloading the EGC failfast module.

Description:

The svc:/system/egc/failfast:default SMF service has failed to unload the EGC farm failfast module

Solution:

Reboot the node.

323405 Error in informing the res group about the svc restart:%s

Description:

When a service is restarted, the sc delegate restarter informs RGM about the restart of the resource using SCHA_RESOURCE_IS_RESTARTED scha control API.This message is displayed when this call cannot be made.

Solution:

Check for the validity and the states of resource and services.Contact SUN vendor for more help.But this should not be a problem in normal operation of the delegated restarter

323592 Validation failed. CRS is not up. Please start it up before attempting to create proxy resource.

Description:

Creation of a resource of type SUNW.scalable_rac_server_proxy failed because CRS is not up.

Solution:

Bring up CRS before attempting to create a resource of the SUNW.scalable_rac_server_proxy resource type. If the problem persists, contact your Sun support representative for further assistance.

323640 open64 while setting up process template: %s

Description:

The rpc.pmfd was unable to open a file in the /system/contract/process/ directory. Consequently, the rpc.pmfd was unable to launch the requested process under its control.

Solution:

If the message is isolated, it was probably a transient error. If you were running pmfadm(1M) directly, retry the requested action. If there are many instances of the message, there is a problem with the contract file system. Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Sun service provider.

323873 Resource "%s" disabled.

Description:

This ScalMountPoint resource was successfully disabled. This message is an informational message.

Solution:

No user action is required.

324478 (%s): Error %d from read

Description:

An error was encountered in the clexecd program while reading the data from the worker process.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

324924 in libsecurity contacting program %s (%lu): could not copy host name

Description:

A client was not able to make an rpc connection to the specified server because the host name could not be saved. This problem can occur if the machine has low memory. An error message is output to syslog.

Solution:

Determine if the host is low on memory. If not, save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

325322 clcomm: error in copyin for state_resource_pool

Description:

The system failed a copy operation supporting statistics reporting.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

325482 File %s is not owned by group (GID) %d

Description:

The file is not owned by the gid which is listed in the message.

Solution:

Set the permissions on the file so that it is owned by the gid which is listed in the message.

325750 Failed to analyze the device special file associated with file system mount point %s: %s.

Description:

HA Storage Plus was not able to open the underlying device of the specified mount point.

Solution:

Check that this device is valid.

326023 reservation warning(%s) - MHIOCGRP_PREEMPTANDABORT error in MHIOCGRP_INKEYS, error %d

Description:

The device fencing program has encountered errors while trying to access a device. All retry attempts have failed.

Solution:

This may be indicative of a hardware problem, which should be resolved as soon as possible. Once the problem has been resolved, the following actions may be necessary: If the message specifies the 'node_join' transition, then this node may be unable to access the specified device. If the failure occurred during the 'release_shared_scsi2' transition, then a node which was joining the cluster may be unable to access the device. In either case, access can be reacquired by executing '/usr/cluster/lib/sc/run_reserve -c node_join' on all cluster nodes. If the failure occurred during the 'make_primary' transition, then a device group might have failed to start on this node. If the device group was started on another node, move it to this node by using the cldevicegroup command. If the device group was not started, you can start it by using the cldevicegroup command. If the failure occurred during the 'primary_to_secondary' transition, then the shutdown or switchover of a device group might have failed. If so, the desired action may be retried.

326030 Local mountpoint %s must begin with / in local zone '%s'.

Description:

The specified mount point in local zone is not an absolute path. An absolute path must start with slash(/).

Solution:

Correct the mount point path value so that it is absolute path and repeat the operation.

326363 Function: stop_sczbt - Logical interface %s:%s placed into the global zone

Description:

The interface of the associated logical host is placed back into the global zone by the stop command of the sczbt component.

Solution:

None

326528 Nonexistent Broker_name (%s).

Description:

The broker name provided in the extension property Broker_Name does not exist.

Solution:

Check that a broker instance exists for the supplied broker name. It should match the broker name portion of the path in Confdir_list.

326636 The profile for SAP %s instance %s does not exist

Description:

The check for SAP profile failed. The start up of sap instance requires the profile to be present.

Solution:

Make sure the sap profile is present under /usr/sap/SAPSID/SYS/profile/ directory.

327057 SharedAddress stopped.

Description:

The stop method is completed and the resource is stopped.

Solution:

This is informational message. No user action required.

327132 Validate - Couldn't retrieve faultmonitor-user <%s> from the nameservice

Description:

The Samba resource could not validate that the fault monitor userid exists.

Solution:

Check that the correct fault monitor userid was used when registering the Samba resource and that the userid really exists.

327302 reservation fatal error(%s) - lock not specified

Description:

The device fencing program has suffered an internal error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available. Copies of /var/adm/messages from all nodes should be provided for diagnosis.

327339 unable to create file %s errno %d

Description:

Internal error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

327353 Global device path %s is not recognized as a device group or a device special file.

Description:

Self explanatory.

Solution:

Check that the specified global device path is valid.

327549 Stop of HADB node %d did not complete.

Description:

The resource was unable to successfully run the hadbm startnode command either because it was unable to execute the program, or the hadbm command received a signal.

Solution:

This might be the result of a lack of system resources. Check whether the system is low in memory and take appropriate action.

328113 %s logical interface configuration operation failed with <%d>.

Description:

An attempt to bring a network interface up or down has failed with the indicated error, while attempting to bring an IP address resource (of type LogicalHostname or SharedAddress) online or offline. Additional related failure messages are likely to be found following this one in the syslog output.

Solution:

Check the configuration of network resources using the "clresourcegroup show -v +" command, and make any necessary corrections to the network configuration.

328580 rgmd died on node %s

Description:

An inter-node communication failed because the rgmd died on another node. To avoid data corruption, the failfast mechanism will cause that node to halt or reboot.

Solution:

No action is required. The cluster will reconfigure automatically. Examine syslog output on the rebooted node to determine the cause of node death. The syslog output might indicate further remedial actions.

328675 The mount point property of file system '%s' in pool '%s' is set to 'legacy', which is not supported by HAStoragePlus.

Description:

Self explanatory. HAStoragePlus does not support Zettabyte File Systems (ZFS) as Failover File Systems (FFS) that have the mountpoint property set to 'legacy'.

Solution:

Set the mountpoint property for the specified file system to 'default'.

328779 Probe for J2EE engine timed out in scds_fm_tcp_connect().

Description:

The data service timed out while connecting to the J2EE engine port.

Solution:

Informational message. No user action is needed.

329039 Cannot access file %s/config.xml or %s/config/config.xml: %s

Description:

The config.xml file does not exist either in the <domain> or <domain>/config directory.

Solution:

Make sure if config.xml file is present in the <domain> or <domain>/config directory and also make sure if proper permissions are set for the file.

329286 (%s) instead of UDLM_ACK got a %d

Description:

Did not receive an acknowledgement from udlm as was expected.

Solution:

None.

329429 reservation fatal error(%s) - host_name not specified

Description:

The device fencing program has suffered an internal error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available. Copies of /var/adm/messages from all nodes should be provided for diagnosis. It may be possible to retry the failed operation, depending on the nature of the error. If the message specifies the 'node_join' transition, then this node may be unable to access shared devices. If the failure occurred during the 'release_shared_scsi2' transition, then a node which was joining the cluster may be unable to access shared devices. In either case, it may be possible to reacquire access to shared devices by executing '/usr/cluster/lib/sc/run_reserve -c node_join' on all cluster nodes. If the failure occurred during the 'make_primary' transition, then a device group has failed to start on this node. If another node was available to host the device group, then it should have been started on that node. If desired, it might be possible to switch the device group to this node by using the cldevicegroup command. If no other node was available, then the device group will not have been started. You can use the cldevicegroup command to retry the attempt to start the device group. If the failure occurred during the 'primary_to_secondary' transition, then the shutdown or switchover of a device group has failed. The desired action may be retried.

329616 svc_probe used entire timeout of %d seconds during connect operation and exceeded the timeout by %d seconds. Attempting disconnect with timeout %d

Description:

The probe timed out connecting to the application.

Solution:

If the problem persists investigate why the application is responding slowly or if the Probe_timeout property needs to be increased.

329847 Warning: node %d has a weight of 0 assigned to it for property %s.

Description:

The named node has a weight of 0 assigned to it. A weight of 0 means that no new client connections will be distributed to that node.

Solution:

Consider assigning the named node a non-zero weight.

330182 Internal error: default value missing for resource property

Description:

A non-fatal internal error has occurred in the RGM.

Solution:

Since this problem might indicate an internal logic error in the rgmd, save a copy of the /var/adm/messages files on all nodes, and the output of clresourcetype show -v, clresourcegroup show -v +, and clresourcegroup status +. Report the problem to your authorized Sun service provider.

330526 CMM: Number of steps specified in registering callback = %d; should be <= %d.

Description:

The number of steps specified during registering a CMM callback exceeds the allowable maximum. This is an internal error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

330530 Failed to retrieve the resource property %s of resource %s: %s.

Description:

There was a failure while retrieving a property of a resource. The names of the resource and the property are both provided in the error message. The reason that the error occurred is also provided in the message.

Solution:

The operation will be retried after some time. But there might be a delay in failing over some HA-NFS resources. If this message is logged repeatedly, save a copy of the syslog and contact your authorized Sun service provider.

330686 Function: validate - Non-global zones mountpoint %s does not exist

Description:

The directory used as a mountpoint in the non-global zone is missing.

Solution:

Create the mountpoint in the non-global zone.

330700 Cannot read template file (%s).

Description:

Template file name was passed to the function for synchronizing the configuration file. Unable to locate the file indicated in he message. Unable to store property value of resource to configuration file.

Solution:

Verify installation of Sun Cluster support packages for Oracle RAC. If the problem persists, save the contents of /var/adm/messages and contact your Sun service representative.

330722 The derby data service is not already running

Description:

Trying to stop the derby data service when it is not running.

Solution:

This message is informational; no user action is needed.

330772 DB_password_file must be set when Auto_recovery is set to true.

Description:

When auto_recovery is set to true the db_password_file extension property must be set to a file that can be passed as the value to the hadbm command's --dbpasswordfile argument.

Solution:

Retry the resource creation and provide a value for the db_password_file extension property.

331074 mc_multi_openconn failed to open bindtab connection.

Description:

Failed to allocate memory during connection establishment for an SCTP sticky service.

Solution:

Install more memory, increase swap space, or reduce peak memory consumption.

331221 CMM: Max detection delay specified is %ld which is larger than the max allowed %ld.

Description:

The maximum of the node down detection delays is larger than the allowable maximum. The maximum allowed will be used as the actual maximum in this case.

Solution:

This is an informational message, no user action is needed.

331301 Stop - can't determine Qmaster Spool dir

Description:

The qmaster spool directory could not be determined, using the 'QmasterSpoolDir' function.

Solution:

Use the command 'qconf -sconf' to determine the value of 'qmaster_spool_dir'. Update/correct the value if necessary using 'qconf -mconf'.

331325 sigprocmask: %s

Description:

The rpc.pmfd server was not able to set its signal mask. The message contains the system error. This happens while the server is starting up, at boot time. The server does not come up, and an error message is output to syslog.

Solution:

Save the syslog messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

331879 Function: validate - ServiceProbeCommand (%s) not a fully qualified path.

Description:

The command specified for variable ServiceProbeCommand within the /opt/SUNWsczone/sczsh/util/sczsh_config configuration file is not containing the full qualified path to it.

Solution:

Make sure the full qualified path is specified for the ServiceProbeCommand, e.g. "/full/path/to/mycommand" rather than just "mycommand". This full qualified path must be accessible within the zone that command is being called.

332256 Validate - winbind is not defined in %s in the passwd section

Description:

Winbinbd is missing from the passwd section in /etc/nsswitch.conf

Solution:

Enter winbind within the passwd section in /etc/nsswitch.conf.

333069 Failed to retrieve nodeid for %s.

Description:

The nodeid for the given name could not be determined.

Solution:

Make sure that the name given is a valid node identifier or node name.

333163 Malformed %s group specification %s.

Description:

Failed to retrieve the ipmp information. The given IPMP group specification is invalid.

Solution:

Check whether the IPMP group specification is in the form of ipmpgroup@nodename. If not, recreate the resource with the properly formatted group information.

333387 INTERNAL ERROR: starting_iter_deps_list: meth type <%d>

Description:

A non-fatal internal error has occurred in the rgmd state machine.

Solution:

333428 Error getting handle tolibvxvm_get_dginfo

Description:

An error occurred when the library routine was called.

Solution:

Ensure that the correct version of the library is installed. Contact your authorized Sun service provider for further assistance in diagnosing the problem.

333622 Property %s can be changed only while ucmmd is not running on the node.

Description:

This property can be changed only while ucmmd is not running on the node. The volume manager processes on all the nodes must use identical value of this property for proper functioning on the cluster.

Solution:

Change the RAC framework resource group to unmanaged state. Reboot all the nodes that can run RAC framework and modify the property.

333752 scha_control() returned error %d for %s in %s.

Description:

The data service detected an internal error from scds.

Solution:

Informational message. No user action is needed.

333874 failfastd: sigdelset returned %d. Exiting.

Description:

Internal error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available

333878 fatal: Unable to get the cluster configuration (%s).

Description:

A call to an internal library to get the cluster configuration unexpectedly failed. RGMD will exit causing the node to reboot.

Solution:

Report the problem to your authorized Sun service provider.

334412 Telemetry data service monitor check method failed

Description:

The monitor program of the telemetry data service detected an error. The cause of the error is given in some error messages displayed before this one.

Solution:

Check if there are other error messages before this one, and contact your authorized Sun service provider to determine whether a workaround or patch is available.

334697 Failed to retrieve the cluster property %s: %s.

Description:

The query for a property failed. The reason for the failure is given in the message.

Solution:

Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Sun service provider for assistance in diagnosing the problem.

334724 There should be one Network Resource in this resource group.

Description:

There must be only one Failover IP address resource in this resource group. The Failover host for which the Node agents are configured must be created in this resource group.

Solution:

Create the Failover host resource, on which the Node Agent and the Application Server instances are configured, in this resource group.

334992 clutil: Adding deferred task after threadpool shutdown id %s

Description:

During shutdown this operation is not allowed.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

335206 Failed to get host names from the resource.

Description:

Retrieving the IP addresses from the network resources from this resource group has failed.

Solution:

Internal error or API call failure might be the reasons. Check the error messages that occurred just before this message. If there is internal error, contact your authorized Sun service provider. For API call failure, check the syslog messages from other components. For the resource name and resource group name, check the syslog tag.

335468 Time allocated to stop development system is too small (less than 5 seconds).

Description:

Time allocated to stop the development system is too small.

Solution:

The time for stopping the development system is a percentage of the total Start_timeout. Increase the value for property Start_timeout or the value for propety Dev_stop_pct.

335569 The quorum configuration task encountered a problem on node ${nodename}, manual configuration by using scsetup(1M) might be necessary

Description:

The attempt to automatically configure quorum disks failed on one or more nodes. The last node to join the cluster is supposed to configure quorum. However, other nodes also perform registration tasks when they join the cluster. This message indicates that one or more of these attempts failed, which prevented the last node from configuring quorum.

Solution:

Manually configure quorum disks and initialize the cluster by using clsetup or scsetup after all nodes have joined the cluster.

335587 The non-existent mount point %s was created successfully with permissions %s and owned by the superuser.

Description:

HAStoragePlus detected the mount point was missing, and created the mount point with the specified information.

Solution:

This is an informational message, no user action is needed.

335591 Failed to retrieve the resource group property %s: %s.

Description:

An API operation has failed while retrieving the resource group property. Low memory or API call failure might be the reasons.

Solution:

In case of low memory, the problem will probably cured by rebooting. If the problem recurs, you might need to increase swap space by configuring additional swap devices. Otherwise, if it is API call failure, check the syslog messages from other components. For resource group name and the property name, check the current syslog message.

335836 Failed to mount file-system %s on mountpoint %s

Description:

The file system that this ScalMountPoint resource represents could not be mounted on the mount point.

Solution:

Determine whether the mount-point directory exists. If the directory does not exist, create it and repeat the operation. Otherwise, contact your authorized Sun service provider to determine whether a workaround or patch is available.

336760 Could not restart or failover the derby data service

Description:

Could not restart or failover the derby data service.

Solution:

For more detailed error message, check the syslog messages. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

336860 read %d for %snum_ports

Description:

Could not get information about the number of ports udlm uses from config file udlm.conf.

Solution:

Check to make sure udlm.conf file exist and has entry for udlm.num_ports. If everything looks normal and the problem persists, contact your Sun service representative.

336868 Monitor for sckrb5 successfully started.

Description:

The probe for HA-KDC has been started.

Solution:

This message is for informational purposes only, no action is required.

337008 rgm_comm_impl::_unreferenced() called unexpectedly

Description:

The low-level cluster machinery has encountered a fatal error. The rgmd will produce a core file and will cause the node to halt or reboot to avoid the possibility of data corruption.

Solution:

Save a copy of the /var/adm/messages files on all nodes, and of the rgmd core file. Contact your authorized Sun service provider for assistance in diagnosing the problem.

337212 resource type %s removed.

Description:

This is a notification from the rgmd that a resource type has been deleted. This message can be used by system monitoring tools.

Solution:

This is an informational message; no user action is needed.

337736 %s: svc_run returned

Description:

The RPC server exited unexpectedly.

Solution:

Save the contents of /var/adm/messages from all nodes and contact your Sun service representative for assistance in diagnosing and correcting the problem.

337957 Validation failed. The RAC framework resource %s that is specified in the RESOURCE_DEPENDENCIES property is not in the resource group that is specified by the resource group property RG_AFFINITIES.

Description:

The resource being created or modified should be dependent upon the rac_framework resource in the RAC framework resource group.

Solution:

If not already created, create the RAC framework resource group and it's associated resources. Then specify the rac_framework resource for this resource's RESOURCE_DEPENDENCIES property.

338067 This resource does not depend on any SUNW.HAStoragePlus resources. Proceeding with normal checks.

Description:

The resource does not depend on any HAStoragePlus filesystems. The validation will continue with it's other checks.

Solution:

This message is informational; no user action is needed.

338321 SCSLM <%s> zone <%s> corrupted project.cpu-shares

Description:

Should never occur.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

338839 clexecd: Could not create thread. Error: %d. Sleeping for %d seconds and retrying.

Description:

clexecd program has encountered a failed thr_create() system call. The error message indicates the error number for the failure. It will retry the system call after specified time.

Solution:

If the message is seen repeatedly, contact your authorized Sun service provider to determine whether a workaround or patch is available.

339119 scvxvmlg warning - chmod(%s) failed

Description:

Solution:

339206 validate: An invalid option entered or

Description:

-2 A wrong variable is set in the parameter file or a line does not start with

Solution:

-2 Fix the parameter file.

339424 Could not host device service %s because this node is being removed from the list of eligible nodes for this service.

Description:

A switchover/failover was attempted to a node that was being removed from the list of nodes that could host this device service.

Solution:

This is an informational message, no user action is needed.

339444 Failed to stop fault-monitor : %s

Description:

The fault monitor of this ScalMountPoint resource could not be stopped.

Solution:

Manually kill the fault monitor process.

339521 CCR: Lost quorum while starting to update table %s.

Description:

The cluster lost quorum when CCR started to update the indicated table.

Solution:

Reboot the cluster.

339590 Error (%s) when reading property %s.

Description:

Unable to read property value using API. Property name is indicated in message. Syslog messages may give more information on errors in other modules.

Solution:

Check syslog messages. Please report this problem.

339657 Issuing a restart request.

Description:

This is informational message. We are above to call API function to request for restart. In case of failure, follow the syslog messages after this message.

Solution:

No user action is needed.

339908 strtol: %s

Description:

strtol failed. Should never occur. This might have failed if the return value could not be represented.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

339954 fatal: cannot create any threads to launch callback methods

Description:

The rgmd daemon was unable to create a thread upon starting up. This is a fatal error. The rgmd will produce a core file and will force the node to halt or reboot to avoid the possibility of data corruption.

Solution:

340157 huge address size %d

Description:

Size of MAC address in acknowledgment of the bind request exceeds the maximum size allotted. We are trying to open a fast path to the private transport adapters.

Solution:

Reboot of the node might fix the problem.

340180 Prog <%s> step <%s>: quiesced.

Description:

An internal error has occurred. The quiesce command, which is applicable only to resource groups, appears to have been applied to a ucmmd reconfiguration step.

Solution:

This is an internal error. Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log, and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your authorized Sun service provider.

340211 monitor_check: getlocalhostname() failed for resource <%s>, resource group <%s>, node <%s>

Description:

While attempting to process a scha_control(1HA,3HA) call, the rgmd failed in an attempt to obtain the hostname of the local node. This is considered a MONITOR_CHECK method failure. This in turn will prevent the attempted failover of the resource group from its current master to a new master.

Solution:

340287 idl_set_timestamp(): IDL Exception

Description:

The rgmd has encountered an error that prevents the scha_control function from successfully setting a ping-pong time stamp, presumably because a node died. This does not prevent the attempted failover from succeeding, but in the worst case, might prevent the anti-"pingpong" feature from working, which may permit a resource group to fail over repeatedly between two or more nodes.

Solution:

Examine syslog output on the node that rebooted, to determine the cause of node death. The syslog output might indicate further remedial actions.

340464 SCSLM fork1 error <%s>

Description:

Should never occur.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

341205 Failed to replace bootcluster on the nodes of second partition

Description:

During dual-partition upgrade, bootcluster component was not replaced on the nodes of the second partition. The dual-partition upgrade will continue to completion.

Solution:

Do not boot any nodes in second partition into cluster mode until the dual-partition upgrade completes.

341259 Property %s can't start with a "/"

Description:

The value of the property TargetFileSystem starts with a slash (/). However, the value of this property must not start with a slash.

Solution:

Correct the value of the property and repeat the operation.

341502 Unable to plumb even after unplumbing. rc = %d

Description:

Topology Manager failed to plumb an adapter for private network. A possible reason for plumb to fail is that it is already plumbed. Solaris clustering has successfully unplumbed the adapter but failed while trying to plumb for private use.

Solution:

Need a user action for this message.

341539 fatal: Aborting node %s because method <%s> failed on resource <%s> and Failover_mode is set to HARD

Description:

A STOP method has failed or timed out on a resource, and the Failover_mode property of that resource is set to HARD.

Solution:

No action is required. This is normal behavior of the RGM. With Failover_mode set to HARD, the rgmd reboots the indicated node or zone to force the resource group offline so that it can be switched onto another node. Other syslog messages that occurred just before this one might indicate the cause of the STOP method failure.

341719 Restarting daemon %s.

Description:

HA-NFS is restarting the specified daemon.

Solution:

No action.

341804 Failed to retrieve information for user %s.

Description:

Failed to retrieve information for the specified BV user

Solution:

Check if the proper Broadvision Unix User ID is set or check if this user exists on all the nodes of the cluster.

342113 Invalid script name %s. It cannot contain any '/'.

Description:

The script name should be just the script name, no path is needed.

Solution:

Specify just the script name without any path.

342193 Attempt to mount %s failed on this node.

Description:

In a scalable resource group, each node that is configured in the resource group attempts to mount the file system. Only one node can succeed in mounting the file system. The remaining nodes which fail to mount the file system issue this message.

Solution:

This is an informational message. However, if no node succeeds in mounting the file system, check the failure message of each node. If you are unable to resolve the problem contact your authorized Sun service provider with copies of /var/adm/messages files on all nodes.

342336 clcomm: Pathend %p: path_down not allowed in state %d

Description:

The system maintains state information about a path. A path_down operation is not allowed in this state.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

342472 Error while posting sysevent from %s: %s

Description:

An internal error has occurred while posting a system event. System events are used for keeping an audit trail of cluster behavior. Related error messages might be found near this one in the syslog output.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

342597 sigaddset: %s

Description:

-2 The rpc.fed server encountered an error with the sigemptyset function, and was not able to start. The message contains the system error.

Solution:

Save the syslog messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

342922 User %s does not belong to the project %s: %s.

Description:

The specified user does not belong to the project that is specified in the error message.

Solution:

Use the projadd(1M) command to add the specified user to the specified project.

343233 Failed to disable %s.

Description:

The Solaris SMF service indicated above could not be disabled as required by Sun Cluster to make the service capable of restart/failover.

Solution:

Try to manually disable the SMF service specified by the error message using the 'svcadm disable' command and retry the operation.

343271 getzonenamebyid: %s

Description:

getzonenamebyid failed for the specified reason. The specified program will be terminated. This zone will not be able to host applications.

Solution:

Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Sun service provider for assistance in diagnosing the problem.

343307 Could not open file %s: %s.

Description:

System has failed to open the specified file.

Solution:

Check whether the permissions are valid. This might be the result of a lack of system resources. Check whether the system is low in memory and take appropriate action. For specific error information, check the syslog message.

343667 Function: validate: The LD_LIBRARY_PATH %s is not valid for this PostgreSQL installation

Description:

The LD_LIBRARY_PATH is not valid to call the postgres binary.

Solution:

Qualify the LD_LIBRARY_PATH in the parameter file until it is sufficient for the psql binary.

344059 RAC server %s probe successful.

Description:

This message indicates that fault monitor has successfully probed the RAC server

Solution:

No action required. This is informational message.

344368 scvxvmlg warning - chown(%s) failed

Description:

Solution:

344614 Started SAP processes under PMF successfully.

Description:

Informational message. SAP is being started under the control of Process Monitoring Facility (PMF).

Solution:

No action needed.

344672 Unable to open door descriptor %s

Description:

A process running in a non-global zone was unable to communicate with the cluster framework in the global zone.

Solution:

Save the /var/adm/messages files on each node. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

346395 UNRECOVERABLE ERROR: Creation of %s failed with error code %s

Description:

Creation of ${QL_TRANSFORM_CCR_FILE} failed with error code ${retval}.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

346439 Could not verify value of property %s for %s.

Description:

An API call failed.

Solution:

346831 Notice: not OK to join

Description:

This is informational message. This message can be seen when ucmm reconfiguration is in progress on other cluster nodes. The operation will be retried.

Solution:

This message is informational; no user action is needed.

346858 UPDATE operation successfully completed.

Description:

An UPDATE operation has completed successfully.

Solution:

None required. Informational message.

347023 Could not run %s. User program did not execute cleanly.

Description:

There were problems making an upcall to run a user-level program.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

347091 resource type %s added.

Description:

This is a notification from the rgmd that the operator has created a new resource type. This message can be used by system monitoring tools.

Solution:

This is an informational message; no user action is needed.

348240 clexecd: putmsg returned %d.

Description:

clexecd program has encountered a failed putmsg(2) system call. The error message indicates the error number for the failure.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

348504 Error: Startup of ${SERVER} failed.

Description:

An attempt to start the rpc.fed server failed. This error will prevent the rgmd from starting, which will prevent this node from participating as a full member of the cluster.

Solution:

349041 RGM unblocked, returned from blocked invocation.

Description:

The RGM has been unblocked. cluster file systems are available.

Solution:

This is an informational message, no user action is needed.

349049 CCR reported invalid table %s; halting node

Description:

The CCR reported to the rgmd that the CCR table specified is invalid or corrupted. The node will be halted to prevent further errors.

Solution:

Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Sun service provider for assistance in diagnosing the problem.

349741 Command %s is not a regular file.

Description:

The specified pathname, which was passed to a libdsdev routine such as scds_timerun or scds_pmf_start, does not refer to a regular file. This could be the result of 1) mis-configuring the name of a START or MONITOR_START method or other property, 2) a programming error made by the resource type developer, or 3) a problem with the specified pathname in the file system itself.

Solution:

Ensure that the pathname refers to a regular, executable file.

349932 validate_options: %s Option %s not set

Description:

The referenced script needs a mandatory option which got not set.

Solution:

Verify the options upon registration for the referenced script and make sure all mandatory options got provided.

350574 Start of HADB database did not complete: %s.

Description:

The resource was unable to successfully run the hadbm start command either because it was unable to execute the program, or the hadbm command received a signal.

Solution:

This might be the result of a lack of system resources. Check whether the system is low in memory and take appropriate action.

351887 Bulk registration failed

Description:

The cl_apid was unable to perform the requested registration for the CRNP service.

Solution:

351983 Validate - can't determine path to Grid Engine utility binaries

Description:

The Sun Grid Engine binary 'gethostname' was not found in ${SGE_ROOT}/utilbin/<arch>. 'gethostname' is used only representatively. If it is not found the other Sun Grid Engine utilities are presumed misplaced also.

Solution:

Find 'gethostname' in the Sun Grid Engine installation. Make certain it is in a location conforming to ${SGE_ROOT}/utilbin/<arch>, where <arch> is the result of running ${SGE_ROOT}/util/arch.

352149 monitor_check: method <%s> failed on resource <%s> in resource group <%s> on node <%s>, exit code <%d>, time used: %d%% of timeout <%d seconds>

Description:

In scha_control, monitor_check method of the resource failed on specific node.

Solution:

No action is required, this is normal phenomenon of scha_control, which launches the corresponding monitor_check method of the resource on all candidate nodes and looks for a healthy node which passes the test. If a healthy node is found, scha_control will let the node take over the resource group. Otherwise, scha_control will just exit early.

352218 WebSphere MQ Channel Initiator %s started

Description:

The specified WebSphere MQ Channel Initiator has been started.

Solution:

None required. Informational message.

352271 %s: Unable to determine hostname. Error: %s

Description:

The hostname of the cluster node could not be determined.

Solution:

Check if the command was run prior to setting the hostname. Contact your authorized Sun service provider to determine whether a workaround or patch is avaliable.

352954 Resource (%s) not configured.

Description:

This is an internal error. Resource name indicated in the message was passed to the function for synchronizing the configuration files. Unable tolocate the resource.

Solution:

If the problem persists, save the contents of /var/adm/messages and contact your Sun service representative.

353368 Unable to to run %s: %s.

Description:

The specified command was unable to run because of the specified reason.

Solution:

Examine other syslog messages occurring around the same time on the same node, to see if the source of the problem can be identified.

353467 %s: CCR exception for %s table

Description:

libscdpm could not perform an operation on the CCR table specified in the message.

Solution:

Check if the table specified in the message is present in the Cluster Configuration Repository (CCR). The CCR is located in /etc/cluster/ccr. This error could happen because the table is corrupted, or because there is no space left on the root file system to make any updates to the table. This message will mean that the Disk Path Monitoring daemon cannot access the persistent information it maintains about disks and their monitoring status. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

353557 Filesystem (%s) is locked and cannot be frozen

Description:

The file system has been locked with the _FIOLFS ioctl. It is necessary to perform an unlock _FIOLFS ioctl. The growfs(1M) or lockfs(1M) command may be responsible for this lock.

Solution:

An _FIOLFS LOCKFS_ULOCK ioctl is required to unlock the file system.

353566 Error %d from start_failfast_server

Description:

Internal error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

353753 invalid mask in hosts list: %s

Description:

The allow_hosts or deny_hosts for the CRNP service contained an invalid mask. This error may prevent the cl_apid from starting up.

Solution:

Remove the offending IP address from the allow_hosts or deny_hosts property, or fix the mask.

353894 SCSLM write <%s> error <%s>

Description:

Should never occur.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

354821 Attempting to start the fault monitor under process monitor facility.

Description:

The function is going to request the PMF to start the fault monitor. If the request fails, refer to the syslog messages that appear after this message.

Solution:

This is an informational message, no user action is required.

355663 Failed to post event %lld: %s

Description:

The cl_eventd was unable to post an event to the sysevent queue locally, and will not retry.

Solution:

355950 HA: unknown invocation result status %d

Description:

An invocation completed with an invalid result status.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

356795 CMM: Reconfiguration step %d was forced to return.

Description:

One of the CMM reconfiguration step transitions failed, probably due to a problem on a remote node. A reconfiguration is forced assuming that the CMM will resolve the problem.

Solution:

This is an informational message, no user action is needed.

356930 Property %s is empty. This property must be specified for scalable resources.

Description:

The value of the specified property must not be empty for scalable resources.

Solution:

Use clresource to specify a non-empty value for the property.

357117 reservation notice(%s) - MHIOCSTATUS success during retry attempt: %d

Description:

Informational message from reserve on ioctl success during retry.

Solution:

No user action required.

357260 Could not stop derby data service monitor (resource: %s)

Description:

The monitor program of the derby data service could not stop. This should never occur.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

357263 munmap: %s

Description:

The rpc.pmfd server was not able to delete shared memory for a semaphore, possibly due to low memory, and the system error is shown. This is part of the cleanup after a client call, so the operation might have gone through. An error message is output to syslog.

Solution:

357511 reservation warning(%s) - MHIOCGRP_INKEYS error(%d) will retry in %d seconds

Description:

The device fencing program has encountered errors while trying to access a device. The failed operation will be retried

Solution:

This is an informational message, no user action is needed.

357766 ping_retry out of bound. The number of retry must be between %d and %d: using the default value

Description:

scdpmd config file (/etc/cluster/scdpm/scdpmd.conf) has a bad ping_retry value. The default ping_retry value is used.

Solution:

Fix the value of ping_retry in the config file.

357767 %d entries found in property %s. For a nonsecure %s instance %s should have exactly one entry.

Description:

Since a nonsecure Server instance only listens on a single port, the specified property should only have a single entry. A different number of entries was found.

Solution:

Change the number of entries to be exactly one.

358404 Validation failed. PASSWORD missing in CONNECT_STRING

Description:

PASSWORD is missing in the specified CONNECT_STRING. The format could be either 'username/password' or '/' (if operating system authentication is used).

Solution:

Specify CONNECT_STRING in the specified format.

358533 Invalid protocol is specified in %s property.

Description:

The specified system property does not have a valid protocol.

Solution:

Using clnode, change the value of the property to use a valid protocol. For example: TCP, UDP.

358557 pxvfs::mount(): global mounts are not enabled (need to run "clconfig -g" first)

Description:

A global mount command is attempted before the node has initialized the global file system name space. Typically this caused by trying to perform a global mount while the system is booted in single user mode.

Solution:

If the system is not at run level 2 or 3, change to run level 2 or 3 using the init(1M) command. Otherwise, check message logs for errors during boot.

358861 validate: The Tomcat port is not set but it is required

Description:

The Tomcat port is not set in the parameter file

Solution:

Set the Tomcat Port in the parameter file.

360300 Unable to determine Sun Cluster node for HADB node %d.

Description:

The HADB database must be created using the hostnames of the Sun Cluster private interconnect, the hostname for the specified HADB node is not a private cluster hostname.

Solution:

Recreate the HADB and specify cluster private interconnect hostnames.

360432 Validation failed. Resource group property RG_AFFINITIES should specify a STRONG POSITIVE affinity (++) with the SCALABLE resource group containing the RAC framework resources

Description:

The resource being created or modified must belong to a group that has a strong positive affinity with the SCALABLE RAC framework resource group.

Solution:

If not already created, create the RAC framework resource group and it's associated resources. Then specify the RAC resource group (preceded with "++") for this resource's group RG_AFFINITIES property.

360600 Oracle UDLM package wrong instruction set architecture.

Description:

Proper Oracle UNIX Distributed Lock Manager (UDLM) is not installed on this node. A 64 bit UDLM package should not be installed in 32 bit operating environment. Oracle OPS/RAC will not be able to function on this node.

Solution:

Install ORCLudlm package that is appropriate in this operating environment. Refer to Oracle's documentation for installaton of Oracle UDLM.

360923 contract_open: %s

Description:

The rpc.pmfd was unable to retrieve the status of the newly created process template. The rpc.pmfd will kill the newly forked process because the rpc.pmfd is unable to monitor the process.

Solution:

360990 Service is already running. Cannot use PMF.

Description:

The data service detected a running SAP instance. Webas_Use_Pmf is specified, thus the data service cannot start probing the instance.

Solution:

Either set Webas_Use_Pmf to False, or stop the service.

361048 ERROR: rgm_run_state() returned non-zero while running boot methods

Description:

The rgmd state machine has encountered an error on this node.

Solution:

Look for preceding syslog messages on the same node, which may provide a description of the error.

361471 Stopping Oracle CRS using: "%s".

Description:

This is to show the command that the CRS Framework used to stop Oracle CRS in the event that Oracle CRS does not stop.

Solution:

No action required.

361880 None of the hostnames/IP addresses specified can be managed by this resource.

Description:

There was a failure in obtaining a list of IP addresses for the hostnames in the resource. Messages logged immediately before this message may indicate what the exact problem is.

Solution:

Check the settings in /etc/nsswitch.conf and verify that the resolver is able to resolve the hostnames.

362117 Config file: %s unknown variable name line %d

Description:

Error in scdpmd config file (/etc/cluster/scdpm/scdpmd.conf).

Solution:

Fix the config file.

362242 The asadmin list-node-agents command failed to run. Unable to communicate with the Domain Admin Server %s on port %d. The Probe method will wait for the Domain Admin Server to be UP before starting the Node Agents.

Description:

Before Starting the Node Agents, the start method checks for the status of the Domain Admin Server. The Node Agents are started only if the Domain Admin Server is UP. This error indicates that the Domain Admin Server is not running. The resource will be brought online but the start method will not start the Node Agents. The probe will monitor the status of the Domain Admin Server and will start the Node Agents once the Domain Admin Server is accessible.

Solution:

If the Domain Admin Server is also a suncluster resource then set the resource dependency between the Node Agents resource and the Domain Admin Server resource. If the Domain Admin Server is not a sun cluster resource then make sure it is Running.

362657 Error when sending response from child process: %m

Description:

Error occurred when sending message from fault monitor child process. Child process will be stopped and restarted.

Solution:

If error persists, then disable the fault monitor and resport the problem.

363357 Failed to unregister callback for IPMP group %s with tag %s (request failed with %d).

Description:

An unexpected error occurred while trying to communicate with the network monitoring daemon (pnmd).

Solution:

Make sure the network monitoring daemon (pnmd) is running.

363696 Error: unable to bring Resource Group <%s> ONLINE, because the Resource Groups <%s> for which it has a strong positive affinity are not online.

Description:

The rgmd is enforcing the strong positive affinities of the resource groups. This behavior is normal and expected.

Solution:

No action required. If desired, use clresourcegroup to change the resource group affinities.

364188 Validation failed. Listener_name not set

Description:

'Listener_name' property of the resource is not set. HA-Oracle will not be able to manage Oracle listener if Listener name is not set.

Solution:

Specify correct 'Listener_name' when creating resource. If resource is already created, please update resource property.

364387 dl_attach: bad ACK header %u

Description:

Could not attach to the physical device. We are trying to open a fast path to the private transport adapters.

Solution:

Reboot of the node might fix the problem.

364510 The specified Oracle dba group id (%s) does not exist

Description:

Group id of oracle dba does not exist.

Solution:

Make sure /etc/nswitch.conf and /etc/group files are valid and have correct information to get the group id of dba.

364618 getzoneid() failed. Unable to verify privilege.

Description:

The validate method for the SUNW.Event service was unable to query the zoneid of the zone where it was launched into.

Solution:

364735 No PMF tag registered for the telemetry data service monitor

Description:

The monitor program of the telemetry data service does not seem to be registered with the PMF. This should never occur.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

364774 The entry in vfstab for mount point '%s' exceeds %d characters.

Description:

The internal buffer size of the vfstab entry for the specified mount point has execeeded VFS_LINE_MAX characters.

Solution:

Shorten the vfstab entry for that mount point so that the length of the entry does not exceed VFS_LINE_MAX characters. You can shorten the vfstab entry by reducing the length of, for example, the block device, character device, or mount point.

365287 Error detected while parsing -> %s

Description:

This message shows the line that was being parsed when an error was detected.

Solution:

Please ensure that all entries in the custom monitor action file are valid and follow the correct syntax. After the file is corrected, validate it again to verify the syntax.

365747 Derby data service stop method completed successfully

Description:

The derby data service stopped successfully.

Solution:

This message is informational; no user action needed.

365980 Wrong number of parameters for check_properties

Description:

Should never occur.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

366225 Listener %s stopped successfully

Description:

Informational message. HA-Oracle successfully stopped Oracle listener.

Solution:

None

366483 SAPDB parent kernel process was terminated.

Description:

The SAPDB parent kernel process was not running on the system.

Solution:

During normal operation, this error should not occurred, unless the process was terminated manually, or the SAPDB kernel process was terminated due to SAPDB kernel problem. Consult the SAPDB log file for additional information to determine whether the process was terminated abnormally.

366803 %s: Unable to set automatic MT mode.

Description:

This program could not set automatic MT mode.

Solution:

Save the contents of /var/adm/messages from all nodes and contact your Sun service representative for assistance in diagnosing and correcting the problem.

367077 Failfast: timeout - unit "%s"%s"%s.

Description:

A failfast client has encountered a timeout and is going to panic the node or zone.

Solution:

There might be other related messages on this node that can help diagnose the problem. Resolve the problem and reboot the node or zone if the node or zone panic is unexpected.

367270 INTERNAL ERROR: Failed to create the path to the %s file.

Description:

An internal error has occurred.

Solution:

Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Sun service provider for assistance in diagnosing the problem.

367417 Could not put the prop %s of svc %s, in the repository: %s

Description:

Problem in creating memory space during resource management of SMF delegated restarter

Solution:

Check the system memory usage

367864 svc_init failed.

Description:

The rpc.pmfd server was not able to initialize server operation. This happens while the server is starting up, at boot time. The server does not come up, and an error message is output to syslog.

Solution:

Save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

367880 Probe command '%s' timed out: %s.

Description:

Probing with the specified command timed out.

Solution:

Other syslog messages occurring just before this one might indicate the reason for the failure. You might consider increasing the timeout value for the method that generated the error.

368373 %s is locally mounted. Unmounting it.

Description:

HA Storage Plus found the specified mount point mounted as a local file system. It will unmount it, as asked for.

Solution:

This is an informational message, no user action is needed.

368529 Dual-partition upgrade state prevents booting into cluster mode.

Description:

Dual-partition cluster upgrade is in progress. Until the upgrade is completed, you can boot the node only into noncluster mode.

Solution:

Boot the node into noncluster mode (boot -x). Then continue with the upgrade.

368571 Validate - Faultmonitor-resource <%s> does not exist

Description:

The Samba resource could not validate that the fault monitor resource exists.

Solution:

Check that the Samba instance's smb.conf file has the fault monitor resource scmondir defined. Please refer to the data service documentation to determine how to do this.

368596 libsecurity: program %s (%lu); unexpected getnetconfigent error

Description:

A client of the specified server was not able to initiate an rpc connection, because it could not get the network information. The pmfadm or scha command exits with error. An error message is output to syslog.

Solution:

Save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

368819 t_rcvudata in recv_request: %s

Description:

Call to t_rcvudata() failed. The "t_rcvudata" man page describes possible error codes. udlm will exit and the node will abort.

Solution:

This is an internal error. Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your Sun service representative.

369460 udlm_send_reply %s: udp is null!

Description:

Can not communicate with udlmctl because the address to send to is null.

Solution:

None. udlm will handle this error.

369570 Multiple ports specified in property %s.

Description:

The validate method for the SUNW.Event service found the specified problem. Thus, the service could not be started.

Solution:

Modify the specified property to fix the problem specified.

369728 Taking action specified in Custom_action_file.

Description:

Fault monitor detected an error specified by the user in a custom action filer. This message indicates that the fault monitor is taking action as specified by the user for such an error.

Solution:

This is an informational message.

370604 This resource depends on a HAStoragePlus resouce that is in a different Resource Group. This configuration is not supported.

Description:

The resource depends on a HAStoragePlus resource that is configured in a different resource group. This configuration is not supported.

Solution:

Please add this resource and the HAStoragePlus resource in the same resource group.

370750 The Failover_mode setting of %s for resource %s in resource group %s has blocked a resource %s attempt on %s

Description:

The rgmd is enforcing the RESTART_ONLY or LOG_ONLY value for the Failover_mode system property. Those settings may prevent some operations initiated by scha_control.

Solution:

No action required. If desired, use clresourcegroup to change the Failover_mode setting.

370949 created %d threads to launch resource callback methods; desired number = %d

Description:

The rgmd daemon was unable to create the desired number of threads upon starting up. This is not a fatal error, but it might cause RGM reconfigurations to take longer because it will limit the number of tasks that the rgmd can perform concurrently.

Solution:

Make sure that the hardware configuration meets documented minimum requirements. Examine other syslog messages on the same node to see if the cause of the problem can be determined.

371369 CCR: CCR data server on node %s unreachable while updating table %s.

Description:

While the TM was updating the indicated table in the cluster, the specified node went down and has become unreachable.

Solution:

The specified node needs to be rebooted.

371615 In J2EE probe, failed to find Content-Length: in %s.

Description:

The reply from the J2EE engine did not contain a Content-Length: entry in the http header.

Solution:

Informational message. No user action is needed.

371681 Derby data service monitor successfully stopped (resource: %s)

Description:

The monitor program of the derby data service stopped successfully.

Solution:

This message is informational; no user action needed.

372492 scvxvmlg error - found non device-node or non link %s, directory not removed

Description:

The program responsible for maintaining the VxVM namespace had detected suspicious entries in the global device namespace.

Solution:

The global device namespace should only contain diskgroup directories and volume device nodes for registered diskgroups. The specified path was not recognized as either of these and should be removed from the global device namespace.

372618 Unable to extract the primary source IP address from the SCTP Cookie chunk.

Description:

Either the SCTP COOKIE-ACK packet does not contain a cookie in the right position or the cookie does not contain a primary client IP address.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

372887 HA: repl_mgr: exception occurred while invoking RMA

Description:

An unrecoverable failure occurred in the HA framework.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

373148 The port portion of %s at position %d in property %s is not a valid port.

Description:

The property named does not have a legal value. The position index, which starts at 0 for the first element in the list, indicates which element in the property list was invalid.

Solution:

Assign the property a legal value.

373816 clcomm: copyinstr: max string length %d too long

Description:

The system attempted to copy a string from user space to the kernel. The maximum string length exceeds length limit.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

373999 door_call: %s; aborting

Description:

The door_call failed with the specified reason. The program will be terminated and the node will be rebooted or halted.

Solution:

Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Sun service provider for assistance in diagnosing the problem.

374006 prog <%s> failed on step <%s> retcode <%d>

Description:

ucmmd step failed on a step.

Solution:

375331 dl_bind: DL_BIND_ACK protocol error

Description:

Could not bind to the physical device. We are trying to open a fast path to the private transport adapters.

Solution:

Reboot of the node might fix the problem.

375416 metaset -o returned (%d). %s not owner

Description:

The node is not the owner of the metaset.

Solution:

Determine why the node is not the owner of the metaset. Examine the output from metaset. Determine whether the SUNW.rac_framework resource and either the SUNW.rac_svm resource or the SUNW.rac_cvm resource are online.

375575 Devicegroup (%s) not healthy!

Description:

The volume is not available.

Solution:

Determine the status of the disk set or disk group and the volume. For Solaris Volume Manager for Sun Cluster volumes, run 'metastat -s'. For Veritas Volume Manager volumes, run 'vxprint'.

375650 Function: val_parfile - %s not specified in %s, which is required

Description:

The referenced necessary parameter is not mentioned in the parameter file.

Solution:

Specify the prameter as a key value pair in the parameter file.

376111 Unable to compose %s path. Sending SIGKILL now.

Description:

The STOP method was not able to construct the applications stop command. The STOP method will send SIGKILL to stop the application.

Solution:

Other messages will indicate what the underlying problem was such as no memory or a bad configuration.

376369 Invalid configuration. SUNWudlmr and SUNWudlm packages must be installed on this node when using the Oracle UDLM.

Description:

The required SUNWudlm and SUNWudlmr packages must be installed when using the Oracle UDLM.

Solution:

Install the SUNWudlm and SUNWudlmr packages from the distribution. If the problem persists, contact your Sun service representative for assistance in diagnosing and correcting the problem.

376596 Property "%s" should be of the form <filer name>:<absolute path to exported directory>

Description:

The form of the TargetFileSystem property is incorrect. For an NFS file system that is exported from a NAS device, the value of the property TargetFileSystem must begin with the NAS device name, followed by a colon (:) and the full path to the directory that the device is exporting.

Solution:

Correct the value of the property and repeat the operation.

376905 Failed to retrieve WLS extension properties.Will shutdown the WLS using sigkill

Description:

Failed to retrieve the WLS exension properties that are needed to do a smooth shutdown. The WLS stop method however will go ahead and kill the WLS process.

Solution:

Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Sun service provider for assistance in diagnosing the problem.

376974 Error in initialization; exiting.

Description:

The cl_apid was unable to start-up. There should be other error message with more detailed explanations of the specific problems.

Solution:

Save a copy of the /var/adm/messages files on all nodes and contact your authorized Sun service provider for assistance in diagnosing and correcting the problem.

377035 The path name %s associated with the FilesystemCheckCommand extension property is not a regular file.

Description:

HA Storage Plus found that the specified file was not a plain file, but of different type (directory, symbolic link, etc.).

Solution:

Correct the value of the FilesystemCheckCommand extension property by specifying a regular executable.

377347 CMM: Node %s (nodeid = %ld) is up; new incarnation number = %ld.

Description:

The specified node has come up and joined the cluster. A node is assigned a unique incarnation number each time it boots up.

Solution:

This is an informational message, no user action is needed.

377531 Stop saposcol under PMF times out.

Description:

Stopping the SAP OS collector process under the control of Process Monitor facility times out. This might happen under heavy system load.

Solution:

You might consider increase the stop time out value.

377897 Successfully started the service.

Description:

Informational message. SAP started up successfully.

Solution:

No action needed.

378220 Siebel gateway already running.

Description:

Siebel gateway was not expected to be running. This may be due to the gateway having started outside Sun Cluster control.

Solution:

Please shutdown the gateway instance manually, and retry the previous operation.

378360 Validate - DHCP directory %s does not exist

Description:

The DHCP resource could not validate that the DHCP directory defined in the /etc/inet/dhcpsvc.conf file for the PATH variable exists.

Solution:

Ensure that /etc/inet/dhcpsvc.conf has the correct entry for the PATH variable by configuring DHCP appropriately, i.e. as defined within the Sun Cluster 3.0 Data Service for DHCP.

378427 prog <%s> step <%s> terminated due to receipt of signal

Description:

ucmmd step terminated due to receipt of a signal.

Solution:

378807 clexecd: %s: sigfillset returned %d. Exiting.

Description:

clexecd program has encountered a failed sigfillset(3C) system call. The error message indicates the error number for the failure.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

378872 %s operation failed : %s.

Description:

Specified system operation could not complete successfully.

Solution:

This is as an internal error. Contact your authorized Sun service provider with the following information. 1) Saved copy of /var/adm/messages file. 2) Output of "ifconfig -a" command.

379450 reservation fatal error(%s) - fenced_node not specified

Description:

The device fencing program has suffered an internal error.

Solution:

379627 ct_pr_event_get_ppid: %s

Description:

The rpc.pmfd was unable to retrieve the parent pid from a contract event. The rpc.pmfd will continue to monitor the process, but the rpc.pmfd may have missed an event of interest.

Solution:

Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Sun service provider.

379820 INTERNAL ERROR in J2EE probe calling scds_fm_tcp_write(): %s.

Description:

The data service could not write to the J2EE engine port.

Solution:

Informational message. No user action is needed.

380205 No MDS Resource found for our mount-point.

Description:

No metadata server resource has been created to represent the specified file system.

Solution:

Ensure that a metadata server resource for the file system is created. For information about how to configure the shared QFS file system with Sun Cluster, see your Sun Cluster and documentation your Sun StorEdge QFS documentation.

380317 Failed to verify that all IPMP groups are in a stable state. Assuming this node cannot respond to client requests.

Description:

The state of the IPMP groups on the node could not be determined.

Solution:

Make sure all adapters and cables are working. Look in the /var/adm/messages file for message from the network monitoring daemon (pnmd).

380365 (%s) t_rcvudata, res %d, flag %d: tli error: %s

Description:

Call to t_rcvudata() failed. The "t_sndudata" man page describes possible error codes. udlmctl will exit.

Solution:

Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your Sun service representative.

380445 scds_pmf_stop() failed with error %s.

Description:

Shutdown through PMF returned an error.

Solution:

No user action needed.

380939 SCSLM scslm_init pthread_create error <%s>

Description:

Should never occur.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

381244 in libsecurity mkdir of %s failed: %s

Description:

The rpc.pmfd, rpc.fed or rgmd server was not able to create a directory to contain "cache" files for rpcbind information. The affected component should still be able to function by directly calling rpcbind.

Solution:

Save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

381386 Prog <%s> step <%s>: unkillable.

Description:

The specified callback method for the specified resource became stuck in the kernel, and could not be killed with a SIGKILL. The UCMM reboots the node to prevent the stuck node from causing unavailability of the services provided by UCMM.

Solution:

No action is required. This is normal behavior of the UCMM. Other syslog messages that occurred just before this one might indicate the cause of the method failure.

382169 Share path name %s not absolute.

Description:

A path specified in the dfstab file does not begin with "/"

Solution:

Only absolute path names can be shared with HA-NFS.

382252 Share path %s: file system %s is not mounted.

Description:

The specified file system, which contains the share path specified, is not currently mounted.

Solution:

Correct the situation with the file system so that it gets mounted.

382343 %s: Not root.

Description:

A user other than root attempted to run this program.

Solution:

If this error occurred during normal operation, save the contents of /var/adm/messages from all nodes and contact your Sun service representative for assistance in diagnosing and correcting the problem.

382460 Failed to obtain SAM-FS constituent volumes from mount point %s: %s.

Description:

HA Storage Plus was not able to determine the volumes that are part of this SAM-FS file system.

Solution:

Check the SAM-FS file system configuration. If the problem persists, contact your authorized Sun service provider.

382995 ioctl in negotiate_uid failed

Description:

Call to ioctl() failed. The "ioctl" man page describes possible error codes. ucmmd will exit and the node will abort.

Solution:

Save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

383045 dl_bind: bad ACK header %u

Description:

An unexpected error occurred. The acknowledgment header for the bind request (to bind to the physical device) is bad. We are trying to open a fast path to the private transport adapters.

Solution:

Reboot of the node might fix the problem.

383264 Function: validate - %s configured with address %s, please remove the address using zonecfg

Description:

There is an IP address conflict between the SUNW.LogicalHost resource and the configured zone.

Solution:

Remove the IP address from the zones configuration with the zonecfg command.

383583 Instance number <%s> does not consist of 2 numeric characters.

Description:

The instance number specified is not a valid SAP instance number.

Solution:

Specify a valid instance number.

383706 NULL value returned for the resource property %s.

Description:

NULL value was specified for the extension property of the resource.

Solution:

For the property name check the syslog message. Any of the following situations might have occurred. Different user action is needed for these different scenarios. 1) If a new resource is created or updated, check whether the value of the extension property is empty. If it is, provide a valid value by using clresource. 2) For all other cases, treat it as an Internal error. Contact your authorized Sun service provider.

383767 scha_cluster_close failed with %d

Description:

Call to close the cluster information handle failed. The second part of the message gives the error code.

Solution:

There could be other related error messages which might be helpful. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

384373 Failed to save old zpools.

Description:

The online update of the HAStoragePlus resource is not successful because of failure in saving the old zpools that were present before updating the resource.

Solution:

Check the syslog messages and try to resolve the problem. Try again to update the resource. If the problem persists, contact your authorized Sun service provider.

384549 CCR: Could not backup the CCR table %s errno = %d.

Description:

The indicated error occurred while backing up indicated CCR table on this node. The errno value indicates the nature of the problem. errno values are defined in the file /usr/include/sys/errno.h. An errno value of 28(ENOSPC) indicates that the root file system on the indicated node is full. Other values of errno can be returned when the root disk has failed(EIO) or some of the CCR tables have been deleted outside the control of the cluster software(ENOENT).

Solution:

There may be other related messages on this node, which may help diagnose the problem, for example: If the root file system is full on the node, then free up some space by removing unnecessary files. If the root disk on the afflicted node has failed, then it needs to be replaced. If the indicated CCR table was accidently deleted, then boot this node in -x mode to restore the indicated CCR table from other nodes in the cluster or backup. The CCR tables are located at /etc/cluster/ccr/.

384621 RDBMS probe successful

Description:

This message indicates that Fault monitor has successfully probed the RDBMS server

Solution:

No action required. This is informational message.

384629 Function: validate: Directory %s does not contain the PostgreSQL binaries

Description:

The directory mentioned in the PGROOT variable does not contain the PostgreSQL binaries in its bin directory.

Solution:

Provide the directory which does contain at least the PostgreSQL binaries in the path ./bin.

384651 Proxy monitor not running (%d)

Description:

The Monitor of a resource of type SUNW.scalable_rac_server_proxy is not running.

Solution:

None required. Informational message.

385407 t_alloc (open_cmd_port) failed with errno%d

Description:

Call to t_alloc() failed. The "t_alloc" man page describes possible error codes. ucmmd will exit and the node will abort.

Solution:

Save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

385550 Can't setup binding entries from node %d for GIF node %d

Description:

Failed to maintain client affinity for some sticky services running on the named server node due to a problem on the named GIF node. Connections from existing clients for those services might go to a different server node as a result.

Solution:

If client affinity is a requirement for some of the sticky services, say due to data integrity reasons, switchover all global interfaces (GIFs) from the named GIF node to some other node.

385655 reservation fatal error(%s) - Unable to retrieve DID device information

Description:

The device fencing program has suffered an internal error.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

385803 Nodelist must contain an even number of nodes.

Description:

The HADB resource must be configured to run on an even number of Sun Cluster nodes.

Solution:

Recreate the resource group and specify an even number of Sun Cluster nodes in the nodelist.

385902 pmf_search_children: Error signaling <%s>: %s

Description:

An error occured while rpc.pmfd attempted to send a signal to one of the processes of the given tag. The reason for the failure is also given. The signal was sent to the process as a result of some event external to rpc.pmfd. rpc.pmfd "intercepted" the signal, and is trying to pass the signal on to the monitored process.

Solution:

Save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

385991 monitor_check: fe_method_full_name() failed for resource <%s>, resource group <%s>, node <%s>

Description:

During execution of a scha_control(1HA,3HA) function, the rgmd daemon was unable to assemble the full method pathname for the MONITOR_CHECK method. This is considered a MONITOR_CHECK method failure. This in turn will prevent the attempted failover of the resource group from its current master to a new master.

Solution:

386072 chdir: %s

Description:

The rpc.pmfd server was not able to change directory. The message contains the system error. The server does not perform the action requested by the client, and an error message is output to syslog.

Solution:

Save the /var/adm/messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

386282 ccr_initialize failure

Description:

An attempt to start the scdpmd failed.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

386314 Failed to retrieve the resource handle for (%s): %s.

Description:

An error occurred while the handle for the resource was being retrieved.

Solution:

Investigate possible RGM errors or DSDL errors. Contact your authorized Sun service provider for assistance in diagnosing the problem.

386327 Stop Startup script using pmfadm failed. tag %s error=%s

Description:

The agent's attempt to stop a previous instance startup instruction that was issued to it failed.

Solution:

Contact your Sun support representative for further assistance.

386333 SCSLM <%s> meth 0x%x with running 0x%x

Description:

Should never occur.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

387003 CCR: CCR metadata not found.

Description:

The CCR is unable to locate its metadata.

Solution:

Boot the offending node in -x mode to restore the indicated table from backup or other nodes in the cluster. The CCR tables are located at /etc/cluster/ccr/.

387232 resource %s monitor enabled.

Description:

This is a notification from the rgmd that the operator has enabled monitoring on a resource. This message can be used by system monitoring tools.

Solution:

This is an informational message; no user action is needed.

387288 clcomm: Path %s online

Description:

A communication link has been established with another node.

Solution:

No action required.

387572 File %s should be readable and writable by %s.

Description:

A program required the specified file to be readable and writable by the specified user.

Solution:

Set correct permissions for the specified file to allow the specified user to read it and write to it.

388195 scf_handle_create failed: %s

Description:

An API call failed.

Solution:

388330 Text server stopped.

Description:

The Text server has been stopped by Sun Cluster HA for Sybase.

Solution:

This is an informational message, no user action is needed.

388555 Usage: %s [-c|-u] -R <resource-name> -T <type-name> -G <group-name> [-r <sys_def_prop>=<value> ...] [-x <ext_prop>=<value> ...] [-Z <zone-name>]

Description:

Incorrect arguments are passed to the callback method of a cluster data service agent.

Solution:

This error might occur while developing and testing a new agent, if a method is manually invoked with incorrect command line arguments. If seen on a production cluster, this message indicates an internal error. Contact your authorized Sun service provider for assistance in diagnosing and correcting the problem.

389071 Validate - Group mqbrkrs does not exist

Description:

The WebSphere MQ Broker resource failed to validate that the group mqbrkrs exists.

Solution:

Ensure that the group mqbrkrs exists.

389221 could not open configuration file: %s

Description:

The specified configuration file could not be opened.

Solution:

Check if the configuration file exists and has correct permissions. If the problem persists, contact your Sun Service representative.

389231 clcomm: inbound_invo::cancel:_state is 0x%x

Description:

The internal state describing the server side of a remote invocation is invalid when a cancel message arrives during processing of the remote invocation.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

389369 Validation failed. SYBASE ASE STOP_FILE %s is not executable.

Description:

File specified in the STOP_FILE extension property is not an executable file.

Solution:

Please check the permissions of file specified in the STOP_FILE extension property. File should be executable by the Sybase owner and root user.

389516 NULL value returned for the extension property %s.

Description:

NULL value was specified for the extension property of the resource.

Solution:

390130 Failed to allocate space for %s.

Description:

An internal error has occurred.

Solution:

Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Sun service provider for assistance in diagnosing the problem.

390212 Core files in ${SCCOREDIR}: ${CORES_FILES}

Description:

One of the daemon launched by /etc/init.d/bootcluster script has core dumped.

Solution:

Provide core dumps to your authorized Sun service provider. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

390422 Unable to contact sc_zonesd

Description:

The sc_canary process was unable to contact the sc_zonesd The process will be aborted and this zone will not be available to host applications.

Solution:

Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Sun service provider for assistance in diagnosing the problem.

390515 Function: validate - %s (%s) already in use on %s:%s for %s, please resolve this conflict

Description:

The logical host is used in another zone already. A logical host can not be used in two zones at the same time.

Solution:

Resolve the conflicting IP address configuration for your zones.

390782 lkcm_cfg: Unable to get new nodelist

Description:

Error when reading nodelist.

Solution:

This is an internal error. Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your Sun service representative.

391177 Failed to open %s: %s.

Description:

HA Storage Plus failed to open the specified file.

Solution:

Check the system configuration. If the problem persists, contact your authorized Sun service provider.

391240 RAC server %s is not running. Manual intervention is required.

Description:

The the fault monitor for the RAC server instance has identified that the instance is no longer running. The fault monitor does NOT attempt to restart or failover the resource or resource group.

Solution:

The cause of the instance failure should be investigated, and once rectified, the RAC server instance should be restarted.

391502 Database is still running after %d seconds. Selecting new Sun Cluster node to run the stop command.

Description:

The database is still running but the resource on the Sun Cluster node that was selected to run the hadbm stop command is now offline, possibly because of an error while running the hadbm command. A different Sun Cluster node will be selected to run the hadbm stop command again.

Solution:

This is an informational message, no user action is needed.

391738 (%s) bad poll revent: %x (hex)

Description:

Call to poll() failed. The "poll" man page describes possible error codes. udlmctl will exit.

Solution:

Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your Sun service representative.

392288 Unmounting the file systems is completed successfully.

Description:

Self explanatory.

Solution:

This is an informational message, no user action is needed.

392782 Failed to retrieve the property %s for %s: %s.

Description:

API operation has failed in retrieving the cluster property.

Solution:

For property name, check the syslog message. For more details about API call failure, check the syslog messages from other components.

392998 Fault monitor probe response time exceeded timeout (%d secs). The timeout for subsequent probes will be temporarily increased by 10%%

Description:

The time taken for the last fault monitor probe to complete was greater than the resource's configured probe timeout, so a timeout error occurred. The timeout for subsequent probes will be increased by 10% until the probe response time drops below 50% of the timeout, at which point the timeout will be reduced to it's configured value.

Solution:

The database should be investigated for the cause of the slow response and the problem fixed, or the resource's probe timeout value increased accordingly.

393934 Stopping the adaptive server with wait option.

Description:

The Sun Cluster HA for Sybase will attempt to shutdown the Sybase adaptive server using the wait option.

Solution:

This is an informational message, no user action is needed.

393957 Failed to read mount point on local node

Description:

During dual-partition upgrade in a live upgrade scenario, the mount point information is not present.

Solution:

Refer to documentation about recovering from a failed dual-partition upgrade in a live upgrade scenario.

393960 sigaction failed in set_signal_handler

Description:

The ucmmd has failed to initialize signal handlers by a call to sigaction(2). The error message indicates the reason for the failure. The ucmmd will produce a core file and will force the node to halt or reboot to avoid the possibility of data corruption.

Solution:

Save a copy of the /var/adm/messages files on all nodes and of the ucmmd core. Contact your authorized Sun service provider for assistance in diagnosing the problem.

394325 Received notice that IPMP group %s has failed.

Description:

The status of the named IPMP group has become degraded. If possible, the scalable resources currently running on this node with monitoring enabled will be relocated off of this node, if the IPMP group stays in a degraded state.

Solution:

Check the status of the IPMP group on the node. Try to fix the adapters in the IPMP group.

394661 Failed to stop the Node Agent %s and the server instances with SIGKILL.

Description:

The Stop method failed to stop the Node Agent and the Application Server instances even with SIGKILL.

Solution:

Manually stop or kill the Node Agent and Application Server instances.

395008 Error reading stopstate file.

Description:

The stopstate file could not be opened and read.

Solution:

Examine other syslog messages occurring around the same time on the same node, to see if the source of the problem can be identified.

395353 Failed to check whether the resource is a network address resource.

Description:

While retrieving the IP addresses from the network resources, the attempt to check whether the resource is a network resource or not has failed.

Solution:

395359 Function: validate: The Environment script %s is not a valid c shell script

Description:

The environment script spcified in the parameter file needs to be a valid c shell script, because the login shell of the PostgreSQL user is c shell compliant.

Solution:

Fix the environment script until it passes csh -n scriptname.

396727 Attempting to check for existence of %s pid %d resulted in error: %s.

Description:

HA-NFS fault monitor attempted to check the status of the specified process but failed. The specific cause of the error is logged.

Solution:

No action. HA-NFS fault monitor would ignore this error and would attempt this operation at a later time. If this error persists, check to see if the system is lacking the required resources (memory and swap) and add or free resources if required. Reboot the node if the error persists.

396901 clq_netapp: quorum open error: No %s data for quorum device was found in CCR --- quorum device %s will be unavailable.

Description:

The configuration information obtained from the CCR for the NetApp NAS device was missing one or more items of required data. The device will not be available.

Solution:

Remove the device using scconf, and try adding it again.

397020 Unix DLM abort failed

Description:

Failed to abort unix dlm. This is an error that can be ignored.

Solution:

None.

397340 Monitor initialization error. Unable to open resource: %s Group: %s: error %d

Description:

Error occured in monitor initialization. Monitor is unable to get resource information using API calls.

Solution:

Check syslog messages for errors logged from other system modules. Stop and start fault monitor. If error persists then disable fault monitor and report the problem.

397371 'dbmcli -d <LC_NAME> -n <logical host name> db_state' timed out.

Description:

The SAP utility listed timed out.

Solution:

Make sure the logical host name resource is online.

397940 INTERNAL ERROR in J2EE probe calling scds_fm_tcp_read(): %s.

Description:

The data service could not read the J2EE probe reply.

Solution:

Informational message. No user action is needed.

399037 mc_closeconn failed to close connection

Description:

The system has run out of resources that is required to process connection terminations for a scalable service.

Solution:

If cluster networking is required, add more resources (most probably, memory) and reboot.

399172 first probe for N1 Grid Service Provisioning System Tomcat was unsuccessful, try again in 5 seconds

Description:

The first probe for the Tomcat will be rescheduled in 5 seconds

Solution:

None

399216 clexecd: Got an unexpected signal %d in process %s (pid=%d, ppid=%d)

Description:

clexecd program got a signal indicated in the error message.

Solution:

clexecd program will exit and node will be halted or rebooted to prevent data corruption. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

399518 Unable to open door_path : %s

Description:

An internal error has occurred in the inter-process communication between Sun Cluster processes. Related error messages might be found near this one in the syslog output.

Solution:

Contact your authorized Sun service provider to determine whether a workaround or patch is available.

399548 %s failed with exit code %d.

Description:

The specified command returned the specified exit code.

Solution:

Examine other syslog messages occurring around the same time on the same node, to see if the source of the problem can be identified.

399552 "pmfctl -S": Error suspending pid %d for tag <%s>: %d

Description:

An error occured while rpc.pmfd attempted to suspend the monitoring of the indicated pid, possibly because the indicated pid has exited while attempting to suspend its monitoring.

Solution:

Check if the indicated pid has exited, if this is not the case, Save the syslog messages file. Contact your authorized Sun service provider to determine whether a workaround or patch is available.

399753 CCR: CCR data server failed to register with CCR transaction manager.

Description:

The CCR data server on this node failed to join the cluster, and can only serve readonly requests.

Solution:

There may be other related CCR messages on this and other nodes in the cluster, which may help diagnose the problem. It may be necessary to reboot this node or the entire cluster.