Table of Contents

• Title and Copyright Information
• My Oracle Support
• What's New in This Guide
• 1 Introduction
  • 1.1 Overview
  • 1.2 Scope and Audience
  • 1.3 Documentation Admonishments
  • 1.4 Manual Organization
  • 1.5 Related Publications
  • 1.6 Locate Product Documentation on the Oracle Help Center Site
• 2 Maintenance
  • 2.1 Introduction
  • 2.2 Preventive Maintenance
    • 2.2.1 Daily Maintenance Procedures
      • 2.2.1.1 Backing Up the RTDB
      • 2.2.1.2 Transferring RTDB Backup File
      • 2.2.1.3 Automatic RTDB Backup
  • 2.3 System Health Check Overview
    • 2.3.1 Health Check Outputs
  • 2.4 Running the System Health Check
    • 2.4.1 Running syscheck from the Command line
    • 2.4.2 Running syscheck Through the ELAP GUI
    • 2.4.3 Running syscheck Using the syscheck Login
• 3 Problem Detection and Reporting
  • 3.1 Detecting and Reporting Problems
  • 3.2 E5-APP-B Card LEDs
  • 3.3 Displaying Errors on ELAP GUI
  • 3.4 Unsolicited Alarm and Information Messages
• 4 Recovery Support
  • 4.1 Recovering from Problems
    • 4.1.1 Restoring the RTDB from Backup Files
  • 4.2 Recovering From Alarms
    • 4.2.1 Decode Alarm Strings
    • 4.2.2 Determine Alarm Cause
• 5 Platform and Application Alarms
  • 5.1 Alarm Categories
  • 5.2 MPS Alarm Recovery Procedures
  • 5.3 Critical Platform Alarms
    • 5.3.1 1000000000002000 - Uncorrectable ECC Memory Error
    • 5.3.2 1000000000008000 – Server NTP Daemon lost NTP synchronization for extended time
    • 5.3.3 1000000000010000 – Server's time has gone backwards
  • 5.4 Critical Application Alarms
    • 5.4.1 2000000000000001 - LSMS DB Maintenance Required
  • 5.5 Major Platform Alarms
    • 5.5.1 3000000000000001 – Server fan failure
    • 5.5.2 3000000000000002 - Server Internal Disk Error
    • 5.5.3 3000000000000008 - Server Platform Error
    • 5.5.4 3000000000000010 - Server File System Error
    • 5.5.5 3000000000000020 - Server Platform Process Error
    • 5.5.6 3000000000000080 - Server Swap Space Shortage Failure
    • 5.5.7 3000000000000100 - Server provisioning network error
    • 5.5.8 3000000000000200 – Server Eagle Network A error
    • 5.5.9 3000000000000400 – Server Eagle Network B error
    • 5.5.10 3000000000000800 – Server Sync network error
    • 5.5.11 3000000000001000 - Server Disk Space Shortage Error
    • 5.5.12 3000000000002000 - Server Default Route Network Error
    • 5.5.13 3000000000004000 - Server Temperature Error
    • 5.5.14 3000000000008000 - Server Mainboard Voltage Error
    • 5.5.15 3000000000010000 - Server Power Feed Error
    • 5.5.16 3000000000020000 - Server Disk Health Test Error
    • 5.5.17 3000000000040000 - Server Disk Unavailable Error
    • 5.5.18 3000000000080000 - Device Error
    • 5.5.19 3000000000100000 - Device Interface Error
    • 5.5.20 3000000000200000 - Correctable ECC Memory Error
    • 5.5.21 3000000400000000 - Multipath device access link problem
    • 5.5.22 3000000800000000 – Switch Link Down Error
    • 5.5.23 3000001000000000 - Half-open Socket Limit
    • 5.5.24 3000002000000000 - Flash Program Failure
    • 5.5.25 3000004000000000 - Serial Mezzanine Unseated
    • 5.5.26 3000000008000000 - Server HA Keepalive Error
    • 5.5.27 3000000010000000 - DRBD block device can not be mounted
    • 5.5.28 3000000020000000 - DRBD block device is not being replicated to peer
    • 5.5.29 3000000040000000 - DRBD peer needs intervention
    • 5.5.30 3000020000000000 - Server NTP Daemon never synchronized
  • 5.6 Major Application Alarms
    • 5.6.1 4000000000000001 - Mate ELAP Unavailable
    • 5.6.2 4000000000000002 - RTDB Mate Unavailable
    • 5.6.3 4000000000000004 - Congestion
    • 5.6.4 4000000000000008 - File System Full
    • 5.6.5 4000000000000010 - Log Failure
    • 5.6.6 4000000000000040 - Fatal Software Error
    • 5.6.7 4000000000000080 - RTDB Corrupt
    • 5.6.8 4000000000000100 - RTDB Inconsistent
    • 5.6.9 4000000000000200 - RTDB Incoherent
    • 5.6.10 4000000000000800 - Transaction Log Full
    • 5.6.11 4000000000001000 - RTDB 100% Full
    • 5.6.12 4000000000002000 - RTDB Resynchronization In Progress
    • 5.6.13 4000000000004000 - RTDB Reload Is Required
    • 5.6.14 4000000000400000 - LVM Snapshot detected that is too old
    • 5.6.15 4000000000800000 - LVM Snapshot detected that is too full
    • 5.6.16 4000000001000000 - LVM Snapshot detected with invalid attributes
    • 5.6.17 4000000002000000 - DRBD Split Brain
    • 5.6.18 4000000010000000 - An instance of Snapmon already running
  • 5.7 Minor Platform Alarms
    • 5.7.1 1000000000000001 – Breaker panel feed unavailable
    • 5.7.2 5000000000000001 - Server Disk Space Shortage Warning
    • 5.7.3 5000000000000002 - Server Application Process Error
    • 5.7.4 5000000000000004 - Server Hardware Configuration Error
    • 5.7.5 5000000000000008 - Server RAM Shortage Warning
    • 5.7.6 5000000000000020 - Server Swap Space Shortage Warning
    • 5.7.7 5000000000000040 - Server Default Router Not Defined
    • 5.7.8 5000000000000080 – Server temperature warning
    • 5.7.9 5000000000000100 - Server Core File Detected
    • 5.7.10 5000000000000200 - Server NTP Daemon Not Synchronized
    • 5.7.11 5000000000000400 - Server CMOS Battery Voltage Low
    • 5.7.12 5000000000000800 - Server Disk Self Test Warning
    • 5.7.13 5000000000001000 - Device Warning
    • 5.7.14 5000000000002000 - Device Interface Warning
    • 5.7.15 5000000000004000 - Server Reboot Watchdog Initiated
    • 5.7.16 5000000000008000 - Server HA Failover Inhibited
    • 5.7.17 5000000000010000 - Server HA Active To Standby Transition
    • 5.7.18 5000000000020000 - Server HA Standby To Active Transition
    • 5.7.19 5000000000040000 - Platform Health Check Failure
    • 5.7.20 5000000000080000 - NTP Offset Check Failure
    • 5.7.21 5000000000100000 - NTP Stratum Check Failure
    • 5.7.22 5000000020000000 – Server Kernel Dump File Detected
    • 5.7.23 5000000040000000 – TPD Upgrade Failed
    • 5.7.24 5000000080000000– Half Open Socket Warning Limit
    • 5.7.25 5000000000200000 - SAS Presence Sensor Missing
    • 5.7.26 5000000000400000 - SAS Drive Missing
    • 5.7.27 5000000000800000 - DRBD failover busy
    • 5.7.28 5000000001000000 - HP disk resync
    • 5.7.29 5000000400000000 – NTP Source Server is not able to provide correct time
  • 5.8 Minor Application Alarms
    • 5.8.1 4000000000020000 - Automatic RTDB Backup is not configured
    • 5.8.2 6000000000000010 - Minor Software Error
    • 5.8.3 6000000000000200 - RTDB Backup Failed
    • 5.8.4 6000000000000400 - Automatic RTDB Backup Failed
    • 5.8.5 6000000000000800 - Automatic Backup cron entry modified
    • 5.8.6 6000000000002000 - Configurable Quantity Threshold Exceeded
    • 5.8.7 6000000000020000 - Automatic RTDB Backup is not configured
• 6 Field Replaceable Units
  • 6.1 Introduction
  • 6.2 Safety Information
  • 6.3 E5-APP-B Card FRUs and Part Numbers
  • 6.4 Removing and Replacing E5-APP-B Cards
    • 6.4.1 Removing an E5-APP-B Card
    • 6.4.2 Replacing an E5-APP-B Card
  • 6.5 Removing and Replacing a Drive Module Assembly
    • 6.5.1 Removing a Drive Module Assembly
    • 6.5.2 Replacing a Drive Module Assembly
• A General Procedures
  • A.1 Introduction
  • A.2 Accessing the ELAP GUI Interface
  • A.3 Connecting to the Server Command Line
    • A.3.1 Using ssh to Connect to the Server Command Line
    • A.3.2 Connecting a Local Access Terminal to Server’s Serial Port
  • A.4 Accessing the ELAP Text Interface
  • A.5 Saving Logs Using the ELAP GUI
  • A.6 Restarting the ELAP Software
  • A.7 Rebooting the MPS
  • A.8 Resolution of Known Issues