Table of Contents

• List of Figures
• List of Tables
• Title and Copyright Information
• 1 Introduction
  • Overview
  • Scope and Audience
  • Documentation Admonishments
  • Manual Organization
  • Related Publications
  • Locate Product Documentation on the Oracle Help Center Site
• 2 LSMS Overview
  • Introduction
  • LSMS Connectivity
  • LSMS Hardware Overview
  • LSMS Software Overview
    • Operating System Layer
    • Base Platform Software
    • Support/Base Utilities Components
    • LSMS Applications
  • Overview of High Availability
    • Hardware Redundancies
    • Software Availability Design
  • Enhancing High Availability with a Shadow LSMS
  • Understanding the Surveillance Feature
    • Controlling the Surveillance Feature
      • Starting the Surveillance Feature
      • Stopping the Surveillance Feature
      • Determining the Surveillance Status
      • Returning the Surveillance Feature to Last Valid State
    • Understanding Surveillance Notifications
  • Understanding the Service Assurance Feature
  • Understanding the SNMP Agent Process
    • Stopping the SNMP Agent
    • Starting the SNMP Agent
    • Determining the Status of the SNMP Agent
    • Logging SNMP Agent Actions
  • Configuring the SNMP Agent
  • SNMP Global Mode
  • SNMPv3 Access View Management
  • SNMPv3 Group Management
  • SNMPv3 User Management
  • NMS Configuration
  • Autonomous Events Trap Forwarding
  • Resynchronization
  • Connectivity between LSMS and NMS
• 3 Routine Procedures
  • Introduction
  • Using Login Sessions
    • Logging In to LSMS Server Command Line
    • Logging in from One Server to the Mate’s Command Line
    • Starting an Web-Based LSMS GUI Session
    • Logging Into the LSMS Console Window
    • Modifying Title Bar in LSMS Console Window
  • Powering On the LSMS
  • Powering Off the LSMS
  • Managing the System Clock
    • Automatically Controlling the LSMS Time Using NTP
      • Configuring the LSMS as an NTP Client
      • Verifying NTP Service
      • Troubleshooting NTP Problems
        • Reference Time Off By More Than Twenty Minutes
        • Violation of Maximum Oscillator Frequency in Network
    • Manually Controlling the LSMS Time Without an External NTP Source
  • Managing User Accounts
    • Non-Configurable Permission Groups
    • Configurable Permission Groups (LSMS Command Class Mgmt)
      • Permission Group Processing
    • Managing User Accounts on the Primary and Secondary Servers
      • Adding a User
      • Deleting a User
      • Changing a User Password
      • Setting the System Level Password Timeout Using the Command Line
      • Setting the System Level Password Timeout Using the GUI
      • Setting the User Level Password Timeout Using the Command Line
      • Setting the User Level Password Timeout Interval Using the GUI
      • Displaying All LSMS User Accounts
      • Viewing the Active User List
      • Terminating an Active User Session
    • Activating the SPID Security Feature
• 4 Preventive Maintenance
  • Introduction
  • Recommended Daily Monitoring
    • Once a Day Monitoring Activities
  • LSMS Database Defragmentation
  • Using Backup Procedures
    • Understanding How the LSMS Backs Up File Systems and Databases
    • Understanding the Backup Results
    • Backing Up the LSMS Manually
    • Stopping an Automatic or Manual Backup
    • Checking for Running Backups
  • Using Restore Procedures
  • Additional Tools for Monitoring the LSMS Hardware and the Network
    • Verifying Active Server Network Interfaces and NPAC Connections
      • Using the ifconfig Command
      • Using the traceroute Utility
  • Managing Automatic File Transfers
    • Displaying Remote Locations Used for Automatic File Transfers
    • Adding a New Remote Location for Automatic File Transfers
    • Deleting a Remote Location for Automatic File Transfers
    • Displaying Previously Scheduled Automatic File Transfers
    • Scheduling an Automatic File Transfer
    • Removing a Scheduled Automatic File Transfer
• 5 Restarting Software Processes
  • Introduction
  • Automatically Restarting Software Processes
    • Automatically Monitoring and Restarting EAGLE Agent Processes
    • Automatically Monitoring and Restarting NPAC Agent Processes
    • Automatically Monitoring and Restarting OSI Process
    • Automatically Monitoring and Restarting the Service Assurance Process
    • Automatically Monitoring and Restarting the rmtpmgr Process
    • Automatically Monitoring and Restarting the rmtpagent Process
    • Automatically Monitoring and Restarting Other Processes
• 6 Managing Server States
  • Introduction
  • Understanding Server States
  • Understanding Switchover
  • Understanding Automatic Switchover
  • Managing Server States Manually
    • Using the lsmsmgr Interface to Determine the Server Status
    • Using the hastatus Command to Determine the Server Status
    • Manually Switching Over from the Active Server to the Standby Server
    • Inhibiting a Standby Server
    • Starting a Server
• 7 Recovering from Site Failures
  • Introduction
  • Choosing a Disaster Backup Strategy
  • Synchronizing Data Between the Main LSMS and Shadow LSMS
  • Preparing for a Disaster Situation
  • Determining When to Switch to Shadow LSMS
  • Disaster Recovery Procedure Overview
  • Performing Disaster Recovery with an Active Shadow LSMS
  • Performing Disaster Recovery with an Inactive Shadow LSMS
  • Performing Disaster Recovery without a Shadow LSMS
  • Returning Operation from Shadow LSMS to Main LSMS
  • Resynchronizing After an Outage Between an NPAC and the LSMS
  • Reconnecting Network Elements
    • Reconnecting Network Elements Procedures
• 8 Verifying Recovery
  • Introduction
  • Verifying that the LSMS Is Fully Functional
    • Verifying the State of the Servers
    • Verifying the Processes Running on the Active Server
    • Verifying the GUI Operability on the Active Server
• 9 Field Replaceable Units
  • Introduction
  • E5-APP-B Card FRUs and Part Numbers
  • Removing and Replacing E5-APP-B Cards
    • Removing an E5-APP-B Card
    • Replacing an E5-APP-B Card
  • Removing and Replacing a Drive Module Assembly
    • Removing a Drive Module Assembly
    • Replacing a Drive Module Assembly
• A Commands
  • Introduction
  • Entering LSMS and Third-Party Application Commands
    • autoxfercfg
    • chglct
    • chkfilter
    • eagle
    • hastatus
    • import
    • keyutil
    • lsms
    • lsmsdb
    • lsmsSNMP
    • lsmssurv
    • massupdate
    • measdump
    • npac_db_setup
    • npacimport
    • report
    • resync_db_setup
    • SAagent
    • savelogs
    • service mysql status
    • spidsec
    • sup
    • sup_db_setup
    • survNotify
    • syscheck
• B Automatic Monitoring of Events
  • Introduction
  • Overview of Monitored Events
  • Overview of GUI Notifications
    • Format of GUI Notifications
      • Variables Used in GUI Notification Format Descriptions
    • Variables Used in Message Text String of GUI Notifications
    • Examples of GUI Notifications
    • Logging GUI Notifications
  • Overview of Surveillance Notifications
    • Variables Used in Surveillance Notification Format Descriptions
    • Variables Used in Message Text String of Surveillance Notifications
    • Example of a Surveillance Notification
    • Logging Surveillance Notifications
  • Overview of Traps
    • Logging SNMP Agent Actions
  • Event Descriptions
  • Platform Alarms
    • How to Decode Platform Alarms
    • Platform Alarms
    • Alarm Recovery Procedures
    • Major Platform Alarms
      • 3000000000000001 – Server fan failure
      • 3000000000000002 - Server Internal Disk Error
      • 3000000000000008 - Server Platform Error
      • 3000000000000010 - Server File System Error
      • 3000000000000020 - Server Platform Process Error
      • 3000000000000080 - Server Swap Space Shortage Failure
      • 3000000000000100 - Server provisioning network error
      • 3000000000001000 - Server Disk Space Shortage Error
      • 3000000000002000 - Server Default Route Network Error
      • 3000000000004000 - Server Temperature Error
      • 3000000000008000 - Server Mainboard Voltage Error
      • 3000000000010000 - Server Power Feed Error
      • 3000000000020000 - Server Disk Health Test Error
      • 3000000000040000 - Server Disk Unavailable Error
      • 3000000000080000 - Device Error
      • 3000000000100000 - Device Interface Error
      • 3000000400000000 - Multipath device access link problem
      • 3000000800000000 – Switch Link Down Error
      • 3000001000000000 - Half-open Socket Limit
      • 3000002000000000 - Flash Program Failure
      • 3000004000000000 - Serial Mezzanine Unseated
      • 3000000008000000 - Server HA Keepalive Error
      • 3000000010000000 - DRBD block device can not be mounted
      • 3000000020000000 - DRBD block device is not being replicated to peer
      • 3000000040000000 - DRBD peer needs intervention
    • Minor Platform Alarms
      • 5000000000000001 - Server Disk Space Shortage Warning
      • 5000000000000002 - Server Application Process Error
      • 5000000000000004 - Server Hardware Configuration Error
      • 5000000000000008 - Server RAM Shortage Warning
      • 5000000000000020 - Server Swap Space Shortage Warning
      • 5000000000000040 - Server Default Router Not Defined
      • 5000000000000080 – Server temperature warning
      • 5000000000000100 - Server Core File Detected
      • 5000000000000200 - Server NTP Daemon Not Synchronized
      • 5000000000000400 - Server CMOS Battery Voltage Low
      • 5000000000000800 - Server Disk Self Test Warning
      • 5000000000001000 - Device Warning
      • 5000000000002000 - Device Interface Warning
      • 5000000000004000 - Server Reboot Watchdog Initiated
      • 5000000000008000 - Server HA Failover Inhibited
      • 5000000000010000 - Server HA Active To Standby Transition
      • 5000000000020000 - Server HA Standby To Active Transition
      • 5000000000040000 - Platform Health Check Failure
      • 5000000000080000 - NTP Offset Check Failure
      • 5000000000100000 - NTP Stratum Check Failure
      • 5000000020000000 – Server Kernel Dump File Detected
      • 5000000040000000 – TPD Upgrade Failed
      • 5000000080000000 - Half Open Socket Warning Limit
      • 5000000000200000 - SAS Presence Sensor Missing
      • 5000000000400000 - SAS Drive Missing
      • 5000000000800000 - DRBD failover busy
      • 5000000001000000 - HP disk resync
    • Saving Logs Using the LSMS GUI or Command Line
• C Downloading Files from an NPAC to the LSMS
  • Overview
    • NPAC-LSMS Download Procedure Summary
  • Prerequisite Information
  • File Naming Conventions
  • NPAC-LSMS Download Procedure
  • Copying Files to Other Server If Switchover Occurs
    • Copying All Downloaded Files After Switchover
    • Copying Partially Downloaded Files After Switchover
• D Worksheets
  • Introduction
  • Recovery Preparation Worksheet
• E Query Server Maintenance Procedures
  • Introduction
  • LSMS Maintenance Procedures
    • Automatic Monitoring of Query Servers
    • Modify the MySQL Port for Query Servers
    • Check Connection Status of Directly Connected Query Servers
    • Maintain the Binary Log on Query Servers
    • Check MySQL Replication Status on Query Servers
    • Start MySQL Replication on Query Servers
    • Stop MySQL Replication on Query Servers
    • Check for Running Backups
    • Reload a Query Server Database from the LSMS
    • Reload a Query Server Database from Another Query Server
    • Clean Up After Failed or Interrupted Snapshot
  • Automated System Check
  • Query Server Error Log
  • Retrieving Information from LNP Database Fields
  • LNP Database Tables and Fields
  • Query Server Database Structure
• F Resolution Of Known Customer Issues