License Restrictions Warranty/Consequential Damages Disclaimer
Restricted Rights Notice
Hazardous Applications Notice
Trademark Notice
Third-Party Content, Products, and Services Disclaimer
Alpha and Beta Draft Documentation Notice
Revenue Recognition Notice
Introduction
Overview
Scope and Audience
Documentation Admonishments
Manual Organization
My Oracle Support (MOS)
Emergency Response
Related Publications
Customer Training
Locate Product Documentation on the Oracle Help Center Site
LSMS Overview
Introduction
LSMS Connectivity
LSMS Hardware Overview
LSMS Software Overview
Operating System Layer
Base Platform Software
Support/Base Utilities Components
LSMS Applications
Overview of High Availability
Hardware Redundancies
Software Availability Design
Enhancing High Availability with a Shadow LSMS
Understanding the Surveillance Feature
Controlling the Surveillance Feature
Starting the Surveillance Feature
Stopping the Surveillance Feature
Determining the Surveillance Status
Returning the Surveillance Feature to Last Valid State
Understanding Surveillance Notifications
Understanding the Service Assurance Feature
Understanding the SNMP Agent Process
Stopping the SNMP Agent
Starting the SNMP Agent
Determining the Status of the SNMP Agent
Logging SNMP Agent Actions
Configuring the SNMP Agent
SNMP Global Mode
SNMPv3 Access View Management
SNMPv3 Group Management
SNMPv3 User Management
NMS Configuration
Autonomous Events Trap Forwarding
Resynchronization
Connectivity between LSMS and NMS
Routine Procedures
Introduction
Using Login Sessions
Logging In to LSMS Server Command Line
Logging in from One Server to the Mate’s Command Line
Starting an Web-Based LSMS GUI Session
Logging Into the LSMS Console Window
Modifying Title Bar in LSMS Console Window
Powering On the LSMS
Powering Off the LSMS
Managing the System Clock
Automatically Controlling the LSMS Time Using NTP
Configuring the LSMS as an NTP Client
Verifying NTP Service
Troubleshooting NTP Problems
Reference Time Off By More Than Twenty Minutes
Violation of Maximum Oscillator Frequency in Network
Manually Controlling the LSMS Time Without an External NTP Source
Managing User Accounts
Non-Configurable Permission Groups
Configurable Permission Groups (LSMS Command Class Mgmt)
Permission Group Processing
Managing User Accounts on the Primary and Secondary Servers
Adding a User
Deleting a User
Changing a User Password
Setting the System Level Password Timeout Using the Command Line
Setting the System Level Password Timeout Using the GUI
Setting the User Level Password Timeout Using the Command Line
Setting the User Level Password Timeout Interval Using the GUI
Displaying All LSMS User Accounts
Viewing the Active User List
Terminating an Active User Session
Activating the SPID Security Feature
Preventive Maintenance
Introduction
Recommended Daily Monitoring
Once a Day Monitoring Activities
LSMS Database Defragmentation
Using Backup Procedures
Understanding How the LSMS Backs Up File Systems and Databases
Understanding the Backup Results
Backing Up the LSMS Manually
Stopping an Automatic or Manual Backup
Checking for Running Backups
Using Restore Procedures
Additional Tools for Monitoring the LSMS Hardware and the Network
Verifying Active Server Network Interfaces and NPAC Connections
Using the ifconfig Command
Using the traceroute Utility
Managing Automatic File Transfers
Displaying Remote Locations Used for Automatic File Transfers
Adding a New Remote Location for Automatic File Transfers
Deleting a Remote Location for Automatic File Transfers
Displaying Previously Scheduled Automatic File Transfers
Scheduling an Automatic File Transfer
Removing a Scheduled Automatic File Transfer
Restarting Software Processes
Introduction
Automatically Restarting Software Processes
Automatically Monitoring and Restarting EAGLE Agent Processes
Automatically Monitoring and Restarting NPAC Agent Processes
Automatically Monitoring and Restarting OSI Process
Automatically Monitoring and Restarting the Service Assurance Process
Automatically Monitoring and Restarting the rmtpmgr Process
Automatically Monitoring and Restarting the rmtpagent Process
Automatically Monitoring and Restarting Other Processes
Managing Server States
Introduction
Understanding Server States
Understanding Switchover
Understanding Automatic Switchover
Managing Server States Manually
Using the lsmsmgr Interface to Determine the Server Status
Using the hastatus Command to Determine the Server Status
Manually Switching Over from the Active Server to the Standby Server
Inhibiting a Standby Server
Starting a Server
Recovering from Site Failures
Introduction
Choosing a Disaster Backup Strategy
Synchronizing Data Between the Main LSMS and Shadow LSMS
Preparing for a Disaster Situation
Determining When to Switch to Shadow LSMS
Disaster Recovery Procedure Overview
Performing Disaster Recovery with an Active Shadow LSMS
Performing Disaster Recovery with an Inactive Shadow LSMS
Performing Disaster Recovery without a Shadow LSMS
Returning Operation from Shadow LSMS to Main LSMS
Resynchronizing After an Outage Between an NPAC and the LSMS
Reconnecting Network Elements
Reconnecting Network Elements Procedures
Verifying Recovery
Introduction
Verifying that the LSMS Is Fully Functional
Verifying the State of the Servers
Verifying the Processes Running on the Active Server
Verifying the GUI Operability on the Active Server
Field Replaceable Units
Introduction
E5-APP-B Card FRUs and Part Numbers
Removing and Replacing E5-APP-B Cards
Removing an E5-APP-B Card
Replacing an E5-APP-B Card
Removing and Replacing a Drive Module Assembly
Removing a Drive Module Assembly
Replacing a Drive Module Assembly
Commands
Introduction
Entering LSMS and Third-Party Application Commands
autoxfercfg
chglct
chkfilter
eagle
hastatus
import
keyutil
lsms
lsmsdb
lsmsSNMP
lsmssurv
massupdate
measdump
npac_db_setup
npacimport
report
resync_db_setup
SAagent
savelogs
service mysql status
spidsec
sup
sup_db_setup
survNotify
syscheck
Automatic Monitoring of Events
Introduction
Overview of Monitored Events
Overview of GUI Notifications
Format of GUI Notifications
Variables Used in GUI Notification Format Descriptions
Variables Used in Message Text String of GUI Notifications
Examples of GUI Notifications
Logging GUI Notifications
Overview of Surveillance Notifications
Variables Used in Surveillance Notification Format Descriptions
Variables Used in Message Text String of Surveillance Notifications
Example of a Surveillance Notification
Logging Surveillance Notifications
Overview of Traps
Logging SNMP Agent Actions
Event Descriptions
Platform Alarms
How to Decode Platform Alarms
Platform Alarms
Alarm Recovery Procedures
Major Platform Alarms
3000000000000001 – Server fan failure
3000000000000002 - Server Internal Disk Error
3000000000000008 - Server Platform Error
3000000000000010 - Server File System Error
3000000000000020 - Server Platform Process Error
3000000000000080 - Server Swap Space Shortage Failure
3000000000000100 - Server provisioning network error
3000000000001000 - Server Disk Space Shortage Error
3000000000002000 - Server Default Route Network Error
3000000000004000 - Server Temperature Error
3000000000008000 - Server Mainboard Voltage Error
3000000000010000 - Server Power Feed Error
3000000000020000 - Server Disk Health Test Error
3000000000040000 - Server Disk Unavailable Error
3000000000080000 - Device Error
3000000000100000 - Device Interface Error
3000000400000000 - Multipath device access link problem
3000000800000000 – Switch Link Down Error
3000001000000000 - Half-open Socket Limit
3000002000000000 - Flash Program Failure
3000004000000000 - Serial Mezzanine Unseated
3000000008000000 - Server HA Keepalive Error
3000000010000000 - DRBD block device can not be mounted
3000000020000000 - DRBD block device is not being replicated to peer
3000000040000000 - DRBD peer needs intervention
Minor Platform Alarms
5000000000000001 - Server Disk Space Shortage Warning
5000000000000002 - Server Application Process Error
5000000000000004 - Server Hardware Configuration Error
5000000000000008 - Server RAM Shortage Warning
5000000000000020 - Server Swap Space Shortage Warning
5000000000000040 - Server Default Router Not Defined
5000000000000080 – Server temperature warning
5000000000000100 - Server Core File Detected
5000000000000200 - Server NTP Daemon Not Synchronized
5000000000000400 - Server CMOS Battery Voltage Low
5000000000000800 - Server Disk Self Test Warning
5000000000001000 - Device Warning
5000000000002000 - Device Interface Warning
5000000000004000 - Server Reboot Watchdog Initiated
5000000000008000 - Server HA Failover Inhibited
5000000000010000 - Server HA Active To Standby Transition
5000000000020000 - Server HA Standby To Active Transition
5000000000040000 - Platform Health Check Failure
5000000000080000 - NTP Offset Check Failure
5000000000100000 - NTP Stratum Check Failure
5000000020000000 – Server Kernel Dump File Detected
5000000040000000 – TPD Upgrade Failed
5000000080000000 - Half Open Socket Warning Limit
5000000000200000 - SAS Presence Sensor Missing
5000000000400000 - SAS Drive Missing
5000000000800000 - DRBD failover busy
5000000001000000 - HP disk resync
Saving Logs Using the LSMS GUI or Command Line
Downloading Files from an NPAC to the LSMS
Overview
NPAC-LSMS Download Procedure Summary
Prerequisite Information
File Naming Conventions
NPAC-LSMS Download Procedure
Copying Files to Other Server If Switchover Occurs
Copying All Downloaded Files After Switchover
Copying Partially Downloaded Files After Switchover
Worksheets
Introduction
Recovery Preparation Worksheet
Query Server Maintenance Procedures
Introduction
LSMS Maintenance Procedures
Automatic Monitoring of Query Servers
Modify the MySQL Port for Query Servers
Check Connection Status of Directly Connected Query Servers
Maintain the Binary Log on Query Servers
Check MySQL Replication Status on Query Servers
Start MySQL Replication on Query Servers
Stop MySQL Replication on Query Servers
Check for Running Backups
Reload a Query Server Database from the LSMS
Reload a Query Server Database from Another Query Server
Clean Up After Failed or Interrupted Snapshot
Automated System Check
Query Server Error Log
Retrieving Information from LNP Database Fields
LNP Database Tables and Fields
Query Server Database Structure