JavaScript is required to for searching.
Skip Navigation Links
Exit Print View
Sun Server X2-8 Product Documentation
search filter icon
search icon

Document Information

Using This Documentation

Sun Server X2-8 Name Change

Product Downloads

Get Software and Firmware Downloads

Documentation and Feedback

About This Documentation

Change History

Hardware Installation and Product Notes

Product Notes

Overview of the Sun Server X2-8 Product Notes

Supported Software and Firmware

Hardware Issues

Oracle Solaris Operating System Issues

Linux Issues

Oracle VM Issues

Windows Operating System Issues

ESX Issues

Oracle ILOM Issues

BIOS Issues

Oracle Hardware Installation Assistant

Documentation Errata

Requesting Physical Media

Hardware Installation

Installation Overview

Front and Back Features and Components

Front Features and Components

Back Features and Components

Unpacking the Server and Identifying the Rack Mounting Hardware

How to Identify Your Rack Mounting Kit

How to Unpack the Server

Installing the Server In the Rack Using the Standard Rack Mounting Kit

Tools and Staff Required

Installing Optional Equipment

Compatible Racks

Contents of the Standard Rack Mounting Kit

Location of the Rack Mounting Kit and the Shipping Bracket Kit

Installing the Server In a Rack Using the Standard Rack Mounting Kit

How to Remove Components to Reduce Weight

How to Replace the Components in the Server

How to Install the Standard Rack Mounting Hardware in a Rack

How to Insert the Server Into the Rack

Removing and Installing the Standard Rack Mounting Kit Shipping Brackets

How to Remove the Standard Rack Mounting Kit Shipping Brackets

How to Install the Standard Rack Mounting Kit Shipping Brackets

Installing the Server in the Rack Using the Universal Rack Mounting Kit

Tools and Staff Required

Installing Optional Equipment

Compatible Racks

Contents of the Universal Rack Mounting Kit

Installing the Server in a Rack Using the Universal Rack Mounting Kit

How to Remove Components to Reduce Weight

How to Replace the Components in the Server

How to Install the Universal Rack Mounting Hardware in a Square-Hole Rack

How to Install the Universal Rack Mounting Hardware in a Round-Hole Rack

How to Insert the Server Into the Rack

Installing and Removing the Universal Shipping Brackets

How to Install the Universal Shipping Brackets

How to Remove the Universal Shipping Brackets

Removing the Server from the Rack

How to Remove the Server from the Rack

How to Remove the Rackmounting Hardware from the Rack

Cabling and Power

Attaching Administration (SP) Cables

Cabling NEMs and PCIe EMs

How to Cable the NEMs and PCIe EMs

Powering the Server On and Off

How to Apply Standby Power for Initial Service Processor Configuration

How to Power On All Server Components

How to Power Off the Server

Getting Service for Your Server

How to Find the Server's Serial Number

Determining Your Server Management Strategy

Oracle Integrated Lights Out Manager

Oracle Hardware Management Pack

Oracle Hardware Installation Assistant

Configuring the Preinstalled Solaris Operating System

Configuring the Preinstalled Oracle Solaris OS

Installation Worksheet

How to Connect to the Server Using the Server's IP Address

(Optional) How to Redirect the Console Output to the Video Port

How to Connect to the Server Using a Serial Capture Program

Oracle Solaris OS Information Products and Training

Configuring the Preinstalled Oracle Linux Operating System

Oracle Linux Configuration Worksheet

Configure the Preinstalled Oracle Linux OS

Register and Update Your Oracle Linux OS

Configuring the Preinstalled Oracle VM Software

How to Configure Oracle VM

Configuration Worksheets

Oracle VM Server Configuration Worksheet

Oracle VM Manager Configuration Worksheet

Getting Started With Oracle VM

How to Configure the VM Network Interfaces

Oracle VM Passwords

Communicating With Oracle ILOM and the System Console

Server Connections

About Oracle ILOM SP IP Addresses and the Oracle ILOM Interfaces

Determining the SP IP Address

How to Get the SP IP Address by Using the BIOS Setup Utility

How to Get the SP IP Address by Using a Serial Connection and the CLI

Connecting to Oracle ILOM

How to Connect to Oracle ILOM CLI Using the Serial Management Port

How to Connect to the Oracle ILOM CLI Using SSH

How to Connect to the Oracle ILOM Web Interface

Connecting to the System Console

How to Connect to the Server Locally (Physical Console)

How to Connect to the Host's Serial Console Using the Oracle ILOM Command-Line Interface

How to Connect Remotely Using the Oracle ILOM Web Interface

I/O and Interrupt Resource Allocation

Option ROM and I/O Space Allocation

How to Determine Whether You Need to Allocate Option ROM and I/O Space

How to Configure Option ROM and I/O Space Allocation

Allocating MSI Interrupt Space (Oracle Solaris OS Only)

How to Identify and Fix Interrupt Resource Shortages

Sun Server X2-8 Specifications

Physical Specifications for the Sun Server X2-8

Power Specifications for the Sun Server X2-8

Environmental Specifications

Acoustic Specifications

Requesting Physical Media

How to Request Physical Media Online

How To Request Physical Media by Phone

Operating System Installation

Oracle Solaris Operating System

Introduction to Oracle Solaris OS Installation

Preparing for OS Installation

Creating a Virtual Disk

Installing Solaris OS

Linux

Linux Installation Task Map

Oracle Hardware Installation Assistant (OHIA)

Preparing for OS Installation

Selecting a Media Delivery Method

Installing Oracle Linux

Installing Red Hat Enterprise Linux

Installing SUSE Linux Enterprise Server

Configuring a Linux Server to Support PXE Installation

Identifying Logical and Physical Network Interface Names for Linux OS Configuration

Windows

Windows Server OS Installation Planning

Preparing For Windows OS Installation

Oracle Hardware Installation Assistant (OHIA)

Downloading Server Software

Configuring a Remote Console

Creating a Virtual Disk

Installing Windows Server

Updating Critical Drivers and Installing Supplemental Software

Incorporating Windows Server 2008 Device Drivers Into WIM Images for WDS

Identifying Network Interfaces in Windows

Oracle VM

Introduction to Oracle VM Installation

Preparing for OS Installation

Installing Oracle VM

ESX

Installing VMware ESX 4.1

Installing VMware ESXi 4.1 and ESXi 5 Installable

Booting From OS Distribution Media

Administration, Diagnostics, and Service

ILOM Supplement

Determining Your Server Management Strategy

Oracle ILOM Documentation

Updating Firmware

Server-Specific Oracle ILOM Features

Identifying and Clearing Faults

Recovering a Lost Oracle ILOM Password

Monitoring Hardware and Environmental Sensors

Diagnostics Guide

Overview of the Diagnostics Guide

Introduction to System Diagnostics

Troubleshooting the Server

Troubleshooting DIMM Problems

BIOS POST

Using Oracle ILOM to Monitor the Host

Creating a Data Collector Snapshot

Using SunVTS Diagnostics Software

Performing Pc-Check Diagnostic Tests

U-Boot Diagnostic Start-Up Tests

Service Manual

Sun Server X2-8 Service Manual Overview

Server and Component Overview

Power and Reset

Removing and Installing Components

Sun Server X2-8 Service Procedures and Information

Sun Server X2-8 Specifications

Requesting Physical Media

Index

How to Identify and Fix Interrupt Resource Shortages

When you encounter a shortage of I/O interrupts on level 6, Oracle recommends that you assign one of the drivers to interrupt level 5 or 4.

The following table shows the I/O devices, ports, and interrupts in an eight–socket system.

Device
Driver
Number of Ports
Number of Interrupts
Maximum per driver = 16
Maximum on level 6 = 32
Onboard NIC (required)
igb
2 per CPU module/8 total
4 per CPU module/16 total
Dual-port 10 Gb Ethernet EM
ixgbe
2 per EM/16 total
4 per EM/32 total
FEM
ixgbe
2 per FEM/8 total
4 per FEM/16 total
Quad-port 1 Gb Ethernet EM
e1000g
4 per EM/32 total
8 per EM/64 total
REM (1 per server)
mr_sas
1
1
  1. Boot your server.

    Boot messages appear.

    The examples in this procedure show a system where ixgbe and igb are both on interrupt level 6, which is the default. In this system, ixgbe requires 24 interrupts and igb requires 16, for a total of 40. However, level 6 provides only 31.

  2. Look for the following error messages, which appear on the screen, and in the file /var/adm/messages.

    On the console:

    Feb 25 15:45:04 mpk12-3214-189-156 pcplusmp: WARNING: No interrupt vector: 
    pciex8086,10f7 instance 1
    Feb 25 15:45:04 mpk12-3214-189-156 pcplusmp: WARNING: Sharing vectors: 
    pciex8086,10f7 instance 1 and SCI
    Feb 25 15:45:06 mpk12-3214-189-156 pcplusmp: WARNING: No interrupt vector: 
    pciex8086,10f7 instance 5
    Feb 25 15:45:06 mpk12-3214-189-156 pcplusmp: WARNING: Sharing vectors: 
    pciex8086,10f7 instance 1 and pciex8086,10f7 instance 5

    In /var/adm/messages:

    Feb 25 15:44:53 mpk12-3214-189-156 ixgbe: [ID 611667 kern.info] 
    NOTICE: ixgbe7: Insufficient interrupt handles available: 1
    Feb 25 15:44:53 mpk12-3214-189-156 ixgbe: [ID 611667 kern.info] 
    NOTICE: ixgbe7: Allocate MSI-X failed, trying MSI interrupts...
    Feb 25 15:44:53 mpk12-3214-189-156 ixgbe: [ID 611667 kern.info] 
    NOTICE: ixgbe7: MSI-X not used, force rx and tx queue number to 1

    Look at the messages in /var/adm/messages to identify the driver that requires more interrupts than are available. In this example, it is ixgbe.

  3. Once you have determined that some devices do not have interrupts, use the commands devfsadm -C and mdb -k to show which interrupts are assigned to a particular level.

    The following output shows a system that requires 24 interrupts for ixgbe, and 16 for igb, both of which are on level 6. To satisfy the needs of both requires 40 interrupts; however only 31 are available. The display shows the 31 that are assigned.

    Also note that only one interrupt is assigned to interrupt level (IPL) 5, leaving 30 available for other devices.

    # devfsadm -C 
    # mdb -k
    Loading modules: [ unix krtld genunix specfs dtrace cpu.generic uppc pcplusmp ufs ip 
    hook neti sctp arp usba uhci s1394 nca fcp fctl lofs emlxs qlc zfs nfs random sppp md 
    cpc crypto fcip logindmux ptm ]
    
    > ::interrupts
    >   
    IRQ  Vector IPL Bus   Type  CPU Share APIC/INT# ISR(s)
    4    0xb0   12  ISA   Fixed 9   1     0x0/0x4   asyintr
    9    0x81   9   PCI   Fixed 1   1     0x0/0x9   acpi_wrapper_isr
    11   0xd1   14  PCI   Fixed 2   1     0x0/0xb   hpet_isr
    16   0x88   9   PCI   Fixed 12  1     0x0/0x10  uhci_intr
    18   0x86   9   PCI   Fixed 10  2     0x0/0x12  uhci_intr, ehci_intr
    19   0x8a   9   PCI   Fixed 14  3     0x0/0x13  ahci_intr, uhci_intr, uhci_intr
    21   0x89   9   PCI   Fixed 13  1     0x0/0x15  uhci_intr
    23   0x87   9   PCI   Fixed 11  2     0x0/0x17  uhci_intr, ehci_intr
    28   0x40   5   PCI   Fixed 4   1     0x1/0x4   mrsas_isr
    32   0x20   2         IPI   ALL 1     -         cmi_cmci_trap
    120  0x82   7         MSI   3   1     -         pepb_intr_handler
    121  0x30   4         MSI   5   1     -         pepb_intr_handler
    122  0x31   4         MSI   5   1     -         pepb_intr_handler
    123  0x84   7         MSI   6   1     -         pepb_intr_handler
    124  0x85   7         MSI   6   1     -         pepb_intr_handler
    125  0x32   4         MSI   7   1     -         pepb_intr_handler
    126  0x83   7         MSI   8   1     -         pepb_intr_handler
    127  0x33   4         MSI   15  1     -         pepb_intr_handler
    128  0x8c   7         MSI   16  1     -         pepb_intr_handler
    129  0x8d   7         MSI   16  1     -         pepb_intr_handler
    130  0x34   4         MSI   17  1     -         pepb_intr_handler
    131  0x35   4         MSI   17  1     -         pepb_intr_handler
    132  0x8b   7         MSI   18  1     -         pepb_intr_handler
    133  0x36   4         MSI   19  1     -         pepb_intr_handler
    134  0x8e   7         MSI   20  1     -         pepb_intr_handler
    135  0x38   4         MSI   21  1     -         pepb_intr_handler
    136  0x39   4         MSI   21  1     -         pepb_intr_handler
    137  0x60   6         MSI-X 22  1     -         ixgbe_intr_legacy
    138  0x61   6         MSI-X 23  1     -         igb_intr_rx
    139  0x62   6         MSI-X 24  1     -         igb_intr_tx_other
    140  0x63   6         MSI-X 25  1     -         igb_intr_rx
    141  0x64   6         MSI-X 26  1     -         igb_intr_tx_other
    142  0x65   6         MSI-X 27  1     -         igb_intr_rx
    143  0x66   6         MSI-X 28  1     -         0
    144  0x67   6         MSI-X 29  1     -         igb_intr_rx
    145  0x68   6         MSI-X 30  1     -         ixgbe_intr_msix
    146  0x69   6         MSI-X 31  1     -         ixgbe_intr_msix
    147  0x6a   6         MSI-X 32  1     -         ixgbe_intr_msix
    148  0x6b   6         MSI-X 33  1     -         ixgbe_intr_msix
    149  0x6c   6         MSI-X 34  1     -         ixgbe_intr_msix
    150  0x6d   6         MSI-X 35  1     -         ixgbe_intr_msix
    151  0x6e   6         MSI-X 36  1     -         ixgbe_intr_msix
    152  0x6f   6         MSI-X 37  1     -         ixgbe_intr_msix
    153  0x70   6         MSI-X 38  1     -         ixgbe_intr_msix
    154  0x71   6         MSI-X 39  1     -         ixgbe_intr_msix
    155  0x72   6         MSI-X 40  1     -         igb_intr_tx_other
    156  0x73   6         MSI-X 41  1     -         igb_intr_rx
    157  0x74   6         MSI-X 42  1     -         igb_intr_tx_other
    158  0x75   6         MSI-X 43  1     -         igb_intr_rx
    159  0x76   6         MSI-X 44  1     -         igb_intr_tx_other
    160  0xa0   0         IPI   ALL 0     -         poke_cpu
    161  0x77   6         MSI-X 45  1     -         igb_intr_rx
    162  0x78   6         MSI-X 46  1     -         igb_intr_tx_other
    163  0x79   6         MSI-X 47  1     -         igb_intr_rx
    164  0x7a   6         MSI-X 48  1     -         ixgbe_intr_msix
    165  0x7b   6         MSI-X 49  1     -         ixgbe_intr_msix
    166  0x7c   6         MSI-X 50  1     -         ixgbe_intr_msix
    167  0x7d   6         MSI-X 51  1     -         ixgbe_intr_msix
    168  0x7e   6         MSI   53  1     -         ixgbe_intr_msi
    192  0xc0   13        IPI   ALL 1     -         xc_serv
    208  0xd0   14        IPI   ALL 1     -         kcpc_hw_overflow_intr
    209  0xd3   14        IPI   ALL 1     -         cbe_fire
    210  0xd4   14        IPI   ALL 1     -         cbe_fire
    240  0xe0   15        IPI   ALL 1     -         xc_serv
    241  0xe1   15        IPI   ALL 1     -         apic_error_intr

    Use Control D to return to the shell.

  4. Reassign one of the drivers to a different interrupt level.
    1. Modify the driver’s .conf file to reassign the interrupts for one or more drivers to a different level.

      This example reassigns the igb driver to level 5 by adding the following line to /kernel/drv/igb.conf.

      interrupt-priorities = 5;
    2. Reboot the system.

      The server displays POST messages, and interrupts are assigned to the new level.

    3. View the boot messages or the contents of /var/adm/messages for the error messages similar to those shown in Step 2.

      If no error messages appear, the procedure was successful.

  5. After reassigning the interrupts, to view the reassigned interrupts, run the mdb -k command.

    The following example shows the system from Step 3 after igb has been reassigned to interrupt level (IPL) 5. As a result, the system is able to assign 24 interrupts to ixgbe.

    # devfsadm -C 
    # mdb -k
    Loading modules: [ unix krtld genunix specfs dtrace cpu.generic uppc pcplusmp ufs ip 
    hook neti sctp arp usba uhci s1394 nca fcp fctl lofs emlxs qlc zfs nfs random sppp md 
    cpc crypto fcip logindmux ptm ]
    
    > ::interrupts
    
    >   
    IRQ  Vector IPL Bus   Type  CPU Share APIC/INT# ISR(s)
    4    0xb0   12  ISA   Fixed 9   1     0x0/0x4   asyintr
    9    0x81   9   PCI   Fixed 1   1     0x0/0x9   acpi_wrapper_isr
    11   0xd1   14  PCI   Fixed 2   1     0x0/0xb   hpet_isr
    16   0x88   9   PCI   Fixed 12  1     0x0/0x10  uhci_intr
    18   0x86   9   PCI   Fixed 10  2     0x0/0x12  uhci_intr, ehci_intr
    19   0x8a   9   PCI   Fixed 14  3     0x0/0x13  ahci_intr, uhci_intr, uhci_intr
    21   0x89   9   PCI   Fixed 13  1     0x0/0x15  uhci_intr
    23   0x87   9   PCI   Fixed 11  2     0x0/0x17  uhci_intr, ehci_intr
    28   0x40   5   PCI   Fixed 4   1     0x1/0x4   mrsas_isr
    32   0x20   2         IPI   ALL 1     -         cmi_cmci_trap
    120  0x82   7         MSI   3   1     -         pepb_intr_handler
    121  0x30   4         MSI   5   1     -         pepb_intr_handler
    122  0x31   4         MSI   5   1     -         pepb_intr_handler
    123  0x84   7         MSI   6   1     -         pepb_intr_handler
    124  0x85   7         MSI   6   1     -         pepb_intr_handler
    125  0x32   4         MSI   7   1     -         pepb_intr_handler
    126  0x83   7         MSI   8   1     -         pepb_intr_handler
    127  0x33   4         MSI   15  1     -         pepb_intr_handler
    128  0x8c   7         MSI   16  1     -         pepb_intr_handler
    129  0x8d   7         MSI   16  1     -         pepb_intr_handler
    130  0x34   4         MSI   17  1     -         pepb_intr_handler
    131  0x35   4         MSI   17  1     -         pepb_intr_handler
    132  0x8b   7         MSI   18  1     -         pepb_intr_handler
    133  0x36   4         MSI   19  1     -         pepb_intr_handler
    134  0x8e   7         MSI   20  1     -         pepb_intr_handler
    135  0x38   4         MSI   21  1     -         pepb_intr_handler
    136  0x39   4         MSI   21  1     -         pepb_intr_handler
    137  0x41   5         MSI-X 22  1     -         igb_intr_tx_other
    138  0x42   5         MSI-X 23  1     -         igb_intr_rx
    139  0x43   5         MSI-X 62  1     -         igb_intr_tx_other
    140  0x44   5         MSI-X 63  1     -         igb_intr_rx
    141  0x45   5         MSI-X 64  1     -         igb_intr_tx_other
    142  0x46   5         MSI-X 65  1     -         igb_intr_rx
    143  0x47   5         MSI-X 66  1     -         igb_intr_tx_other
    144  0x48   5         MSI-X 67  1     -         igb_intr_rx
    145  0x60   6         MSI-X 68  1     -         ixgbe_intr_msix
    146  0x61   6         MSI-X 69  1     -         ixgbe_intr_msix
    147  0x62   6         MSI-X 70  1     -         ixgbe_intr_msix
    148  0x63   6         MSI-X 71  1     -         ixgbe_intr_msix
    149  0x64   6         MSI-X 72  1     -         ixgbe_intr_msix
    150  0x65   6         MSI-X 73  1     -         ixgbe_intr_msix
    151  0x66   6         MSI-X 74  1     -         ixgbe_intr_msix
    152  0x67   6         MSI-X 75  1     -         ixgbe_intr_msix
    153  0x68   6         MSI-X 76  1     -         ixgbe_intr_msix
    154  0x69   6         MSI-X 77  1     -         ixgbe_intr_msix
    155  0x49   5         MSI-X 78  1     -         igb_intr_tx_other
    156  0x4a   5         MSI-X 79  1     -         igb_intr_rx
    157  0x6a   6         MSI-X 80  1     -         ixgbe_intr_msix
    158  0x6b   6         MSI-X 81  1     -         ixgbe_intr_msix
    159  0x4b   5         MSI-X 82  1     -         igb_intr_tx_other
    160  0xa0   0         IPI   ALL 0     -         poke_cpu
    161  0x4c   5         MSI-X 83  1     -         igb_intr_rx
    162  0x4d   5         MSI-X 84  1     -         igb_intr_tx_other
    163  0x4e   5         MSI-X 85  1     -         igb_intr_rx
    164  0x4f   5         MSI-X 86  1     -         igb_intr_tx_other
    165  0x50   5         MSI-X 87  1     -         igb_intr_rx
    166  0x6c   6         MSI-X 88  1     -         ixgbe_intr_msix
    167  0x6d   6         MSI-X 89  1     -         ixgbe_intr_msix
    168  0x6e   6         MSI-X 90  1     -         ixgbe_intr_msix
    169  0x6f   6         MSI-X 91  1     -         ixgbe_intr_msix
    170  0x70   6         MSI-X 92  1     -         ixgbe_intr_msix
    171  0x71   6         MSI-X 93  1     -         ixgbe_intr_msix
    172  0x72   6         MSI-X 94  1     -         ixgbe_intr_msix
    173  0x73   6         MSI-X 95  1     -         ixgbe_intr_msix
    174  0x74   6         MSI-X 96  1     -         ixgbe_intr_msix
    175  0x75   6         MSI-X 97  1     -         ixgbe_intr_msix
    176  0x76   6         MSI-X 98  1     -         ixgbe_intr_msix
    177  0x77   6         MSI-X 99  1     -         ixgbe_intr_msix
    192  0xc0   13        IPI   ALL 1     -         xc_serv
    208  0xd0   14        IPI   ALL 1     -         kcpc_hw_overflow_intr
    209  0xd3   14        IPI   ALL 1     -         cbe_fire
    210  0xd4   14        IPI   ALL 1     -         cbe_fire
    240  0xe0   15        IPI   ALL 1     -         xc_serv
    241  0xe1   15        IPI   ALL 1     -         apic_error_intr

    Use Control-D to return to the shell.