Identify PSH-Detected Faults With fmdump

The fmdump command<Command displays the list of faults detected by the Solaris PSH facility and identifies the faulty FRU for a particular EVENT_ID (UUID).

1. Check the event log using the fmdump command with -v for verbose output.

   # fmdump -v -u fd940ac2-d21e-c94a-f258-f8a9bb69d05b
   TIME                 UUID                                 SUNW-MSG-ID
   Jul 31 12:47:42.2008 fd940ac2-d21e-c94a-f258-f8a9bb69d05b SUN4V-8000-JA
     100%  fault.cpu.ultraSPARC-T2.misc_regs
    
           Problem in: cpu:///cpuid=16/serial=5D67334847
              Affects: cpu:///cpuid=16/serial=5D67334847
                FRU: hc://:serial=101083:part=541215101/motherboard=0
                  Location: MB

   In this example, the following information is provided about the detected fault:

   • Date and time of the fault (Jul 31 12:47:42.2008)

   • Universal Unique Identifier (UUID). The UUID is unique for every fault (fd940ac2-d21e-c94a-f258-f8a9bb69d05b)

   • Message identifier, which can be used to obtain additional fault information (SUN4V-8000-JA)

   • Details about the faulted FRU. This includes the FRU’s part number (part=541215101) and serial number (serial=101083). The Location field provides the name of the FRU. In this example, the FRU name is MB, meaning the motherboard.

2. Use the message ID to obtain more information about this type of fault.
   1. In a browser, go to the Predictive Self-Healing Knowledge Article web site:

      http://www.sun.com/msg

   2. Obtain the message ID from the console output or the ILOM show faulty command.
   3. Enter the message ID in the SUNW-MSG-ID field, and click Lookup.

      In the following example, the message ID SUN4V-8000-JA provides information for corrective action:

      CPU errors exceeded acceptable levels
      Type
          Fault
      Severity
          Major
      Description
          The number of errors associated with this CPU has exceeded
          acceptable levels.
      Automated Response
          The fault manager will attempt to remove the affected CPU from
          service.
      Impact
          System performance may be affected.
       
      Suggested Action for System Administrator
          Schedule a repair procedure to replace the affected CPU, the
          identity of which can be determined using fmdump -v -u 
          <EVENT_ID>.
       
      Details
          The Message ID:  SUN4V-8000-JA indicates diagnosis has
          determined that a CPU is faulty. The Solaris fault manager 
          arranged an automated attempt to disable this CPU....

3. Follow the suggested actions to repair the fault.