| Skip Navigation Links | |
| Exit Print View | |
|
Sun Fire X4800 Server Installation Guide Sun Fire X4800 Server Documentation |
| Skip Navigation Links | |
| Exit Print View | |
|
|
Sun Fire X4800 Server Installation Guide Sun Fire X4800 Server Documentation |
About This Documentation (PDF and HTML)
Front and Back Features and Components
Unpacking the Server and Identifying the Rack Mounting Hardware
How to Identify Your Rack Mounting Kit
Installing the Server In the Rack Using the Standard Rack Mounting Kit
Contents of the Standard Rack Mounting Kit
Location of the Rack Mounting Kit and the Shipping Bracket Kit
Installing the Server In a Rack Using the Standard Rack Mounting Kit
Removing and Installing the Standard Rack Mounting Kit Shipping Brackets
Installing the Server In the Rack Using the Universal Rack Mounting Kit
Contents of the Universal Rack Mounting Kit
Installing the Server in a Rack Using the Universal Rack Mounting Kit
Installing and Removing the Universal Rack Mounting Kit Shipping Brackets
Removing the Server From the Rack
How to Remove the Server From the Rack
How to Remove the Rack Mounting Hardware from the Rack
Attaching Administration (SP) Cables
Powering the Server On and Off
Getting Service for Your Server
How to Find the Server's Serial Number
Setting Up the Preinstalled Solaris Operating System
Configuring the Preinstalled Oracle Solaris OS
How to Connect to the Server Using the Server's IP Address
(Optional) How to Redirect the Console Output to the Video Port
How to Connect to the Server Using a Serial Capture Program
Oracle Solaris OS Information Products and Training
Communicating With the ILOM and the System Console
About ILOM SP IP Addresses and the ILOM Interfaces
Connecting to the System Console
I/O and Interrupt Resource Allocation
Option ROM and I/O Space Allocation
How to Determine Whether You Need to Allocate Option ROM and I/O Space
How to Configure I/O Space Allocation
Allocating MSI Interrupt Space (Oracle Solaris OS Only)
Sun Fire X4800 Server Specifications
Physical Specifications for the Sun Fire X4800 Server
When you encounter a shortage of I/O interrupts on level 6, Oracle recommends that you assign one of the drivers to interrupt level 5 or 4.
Interrupt level 5 is the first priority
Interrupt level 4 is next
The following table shows the I/O devices, ports, and interrupts in an eight–socket system.
|
Boot messages appear.
The examples in this procedure show a system where ixgbe and igb are both on interrupt level 6, which is the default. In this system, ixgbe requires 24 interrupts and igb requires 16, for a total of 40. However, level 6 provides only 31.
On the console:
Feb 25 15:45:04 mpk12-3214-189-156 pcplusmp: WARNING: No interrupt vector: pciex8086,10f7 instance 1 Feb 25 15:45:04 mpk12-3214-189-156 pcplusmp: WARNING: Sharing vectors: pciex8086,10f7 instance 1 and SCI Feb 25 15:45:06 mpk12-3214-189-156 pcplusmp: WARNING: No interrupt vector: pciex8086,10f7 instance 5 Feb 25 15:45:06 mpk12-3214-189-156 pcplusmp: WARNING: Sharing vectors: pciex8086,10f7 instance 1 and pciex8086,10f7 instance 5
In /var/adm/messages:
Feb 25 15:44:53 mpk12-3214-189-156 ixgbe: [ID 611667 kern.info] NOTICE: ixgbe7: Insufficient interrupt handles available: 1 Feb 25 15:44:53 mpk12-3214-189-156 ixgbe: [ID 611667 kern.info] NOTICE: ixgbe7: Allocate MSI-X failed, trying MSI interrupts... Feb 25 15:44:53 mpk12-3214-189-156 ixgbe: [ID 611667 kern.info] NOTICE: ixgbe7: MSI-X not used, force rx and tx queue number to 1
Look at the messages in /var/adm/messages to identify the driver that requires more interrupts than are available. In this example, it is ixgbe.
The following output shows a system that requires 24 interrupts for ixgbe, and 16 for igb, both of which are on level 6. To satisfy the needs of both requires 40 interrupts;, however only 31 are available. The display shows the 31 that are assigned.
Also note that only one interrupt is assigned to interrupt level (IPL) 5, leaving 30 available for other devices.
# devfsadm -C # mdb -k Loading modules: [ unix krtld genunix specfs dtrace cpu.generic uppc pcplusmp ufs ip hook neti sctp arp usba uhci s1394 nca fcp fctl lofs emlxs qlc zfs nfs random sppp md cpc crypto fcip logindmux ptm ] > ::interrupts > IRQ Vector IPL Bus Type CPU Share APIC/INT# ISR(s) 4 0xb0 12 ISA Fixed 9 1 0x0/0x4 asyintr 9 0x81 9 PCI Fixed 1 1 0x0/0x9 acpi_wrapper_isr 11 0xd1 14 PCI Fixed 2 1 0x0/0xb hpet_isr 16 0x88 9 PCI Fixed 12 1 0x0/0x10 uhci_intr 18 0x86 9 PCI Fixed 10 2 0x0/0x12 uhci_intr, ehci_intr 19 0x8a 9 PCI Fixed 14 3 0x0/0x13 ahci_intr, uhci_intr, uhci_intr 21 0x89 9 PCI Fixed 13 1 0x0/0x15 uhci_intr 23 0x87 9 PCI Fixed 11 2 0x0/0x17 uhci_intr, ehci_intr 28 0x40 5 PCI Fixed 4 1 0x1/0x4 mrsas_isr 32 0x20 2 IPI ALL 1 - cmi_cmci_trap 120 0x82 7 MSI 3 1 - pepb_intr_handler 121 0x30 4 MSI 5 1 - pepb_intr_handler 122 0x31 4 MSI 5 1 - pepb_intr_handler 123 0x84 7 MSI 6 1 - pepb_intr_handler 124 0x85 7 MSI 6 1 - pepb_intr_handler 125 0x32 4 MSI 7 1 - pepb_intr_handler 126 0x83 7 MSI 8 1 - pepb_intr_handler 127 0x33 4 MSI 15 1 - pepb_intr_handler 128 0x8c 7 MSI 16 1 - pepb_intr_handler 129 0x8d 7 MSI 16 1 - pepb_intr_handler 130 0x34 4 MSI 17 1 - pepb_intr_handler 131 0x35 4 MSI 17 1 - pepb_intr_handler 132 0x8b 7 MSI 18 1 - pepb_intr_handler 133 0x36 4 MSI 19 1 - pepb_intr_handler 134 0x8e 7 MSI 20 1 - pepb_intr_handler 135 0x38 4 MSI 21 1 - pepb_intr_handler 136 0x39 4 MSI 21 1 - pepb_intr_handler 137 0x60 6 MSI-X 22 1 - ixgbe_intr_legacy 138 0x61 6 MSI-X 23 1 - igb_intr_rx 139 0x62 6 MSI-X 24 1 - igb_intr_tx_other 140 0x63 6 MSI-X 25 1 - igb_intr_rx 141 0x64 6 MSI-X 26 1 - igb_intr_tx_other 142 0x65 6 MSI-X 27 1 - igb_intr_rx 143 0x66 6 MSI-X 28 1 - 0 144 0x67 6 MSI-X 29 1 - igb_intr_rx 145 0x68 6 MSI-X 30 1 - ixgbe_intr_msix 146 0x69 6 MSI-X 31 1 - ixgbe_intr_msix 147 0x6a 6 MSI-X 32 1 - ixgbe_intr_msix 148 0x6b 6 MSI-X 33 1 - ixgbe_intr_msix 149 0x6c 6 MSI-X 34 1 - ixgbe_intr_msix 150 0x6d 6 MSI-X 35 1 - ixgbe_intr_msix 151 0x6e 6 MSI-X 36 1 - ixgbe_intr_msix 152 0x6f 6 MSI-X 37 1 - ixgbe_intr_msix 153 0x70 6 MSI-X 38 1 - ixgbe_intr_msix 154 0x71 6 MSI-X 39 1 - ixgbe_intr_msix 155 0x72 6 MSI-X 40 1 - igb_intr_tx_other 156 0x73 6 MSI-X 41 1 - igb_intr_rx 157 0x74 6 MSI-X 42 1 - igb_intr_tx_other 158 0x75 6 MSI-X 43 1 - igb_intr_rx 159 0x76 6 MSI-X 44 1 - igb_intr_tx_other 160 0xa0 0 IPI ALL 0 - poke_cpu 161 0x77 6 MSI-X 45 1 - igb_intr_rx 162 0x78 6 MSI-X 46 1 - igb_intr_tx_other 163 0x79 6 MSI-X 47 1 - igb_intr_rx 164 0x7a 6 MSI-X 48 1 - ixgbe_intr_msix 165 0x7b 6 MSI-X 49 1 - ixgbe_intr_msix 166 0x7c 6 MSI-X 50 1 - ixgbe_intr_msix 167 0x7d 6 MSI-X 51 1 - ixgbe_intr_msix 168 0x7e 6 MSI 53 1 - ixgbe_intr_msi 192 0xc0 13 IPI ALL 1 - xc_serv 208 0xd0 14 IPI ALL 1 - kcpc_hw_overflow_intr 209 0xd3 14 IPI ALL 1 - cbe_fire 210 0xd4 14 IPI ALL 1 - cbe_fire 240 0xe0 15 IPI ALL 1 - xc_serv 241 0xe1 15 IPI ALL 1 - apic_error_intr
Use Control D to return to the shell.
This example reassigns the igb driver to level 5 by adding the following line to /kernel/drv/igb.conf.
interrupt-priorities = 5;
The server displays POST messages, and interrupts are assigned to the new level.
If no error messages appear, the procedure was successful.
The following example shows the system from Step 3 after igb has been reassigned to interrupt level (IPL) 5. As a result, the system is able to assign 24 interrupts to ixgbe.
# devfsadm -C # mdb -k Loading modules: [ unix krtld genunix specfs dtrace cpu.generic uppc pcplusmp ufs ip hook neti sctp arp usba uhci s1394 nca fcp fctl lofs emlxs qlc zfs nfs random sppp md cpc crypto fcip logindmux ptm ] > ::interrupts > IRQ Vector IPL Bus Type CPU Share APIC/INT# ISR(s) 4 0xb0 12 ISA Fixed 9 1 0x0/0x4 asyintr 9 0x81 9 PCI Fixed 1 1 0x0/0x9 acpi_wrapper_isr 11 0xd1 14 PCI Fixed 2 1 0x0/0xb hpet_isr 16 0x88 9 PCI Fixed 12 1 0x0/0x10 uhci_intr 18 0x86 9 PCI Fixed 10 2 0x0/0x12 uhci_intr, ehci_intr 19 0x8a 9 PCI Fixed 14 3 0x0/0x13 ahci_intr, uhci_intr, uhci_intr 21 0x89 9 PCI Fixed 13 1 0x0/0x15 uhci_intr 23 0x87 9 PCI Fixed 11 2 0x0/0x17 uhci_intr, ehci_intr 28 0x40 5 PCI Fixed 4 1 0x1/0x4 mrsas_isr 32 0x20 2 IPI ALL 1 - cmi_cmci_trap 120 0x82 7 MSI 3 1 - pepb_intr_handler 121 0x30 4 MSI 5 1 - pepb_intr_handler 122 0x31 4 MSI 5 1 - pepb_intr_handler 123 0x84 7 MSI 6 1 - pepb_intr_handler 124 0x85 7 MSI 6 1 - pepb_intr_handler 125 0x32 4 MSI 7 1 - pepb_intr_handler 126 0x83 7 MSI 8 1 - pepb_intr_handler 127 0x33 4 MSI 15 1 - pepb_intr_handler 128 0x8c 7 MSI 16 1 - pepb_intr_handler 129 0x8d 7 MSI 16 1 - pepb_intr_handler 130 0x34 4 MSI 17 1 - pepb_intr_handler 131 0x35 4 MSI 17 1 - pepb_intr_handler 132 0x8b 7 MSI 18 1 - pepb_intr_handler 133 0x36 4 MSI 19 1 - pepb_intr_handler 134 0x8e 7 MSI 20 1 - pepb_intr_handler 135 0x38 4 MSI 21 1 - pepb_intr_handler 136 0x39 4 MSI 21 1 - pepb_intr_handler 137 0x41 5 MSI-X 22 1 - igb_intr_tx_other 138 0x42 5 MSI-X 23 1 - igb_intr_rx 139 0x43 5 MSI-X 62 1 - igb_intr_tx_other 140 0x44 5 MSI-X 63 1 - igb_intr_rx 141 0x45 5 MSI-X 64 1 - igb_intr_tx_other 142 0x46 5 MSI-X 65 1 - igb_intr_rx 143 0x47 5 MSI-X 66 1 - igb_intr_tx_other 144 0x48 5 MSI-X 67 1 - igb_intr_rx 145 0x60 6 MSI-X 68 1 - ixgbe_intr_msix 146 0x61 6 MSI-X 69 1 - ixgbe_intr_msix 147 0x62 6 MSI-X 70 1 - ixgbe_intr_msix 148 0x63 6 MSI-X 71 1 - ixgbe_intr_msix 149 0x64 6 MSI-X 72 1 - ixgbe_intr_msix 150 0x65 6 MSI-X 73 1 - ixgbe_intr_msix 151 0x66 6 MSI-X 74 1 - ixgbe_intr_msix 152 0x67 6 MSI-X 75 1 - ixgbe_intr_msix 153 0x68 6 MSI-X 76 1 - ixgbe_intr_msix 154 0x69 6 MSI-X 77 1 - ixgbe_intr_msix 155 0x49 5 MSI-X 78 1 - igb_intr_tx_other 156 0x4a 5 MSI-X 79 1 - igb_intr_rx 157 0x6a 6 MSI-X 80 1 - ixgbe_intr_msix 158 0x6b 6 MSI-X 81 1 - ixgbe_intr_msix 159 0x4b 5 MSI-X 82 1 - igb_intr_tx_other 160 0xa0 0 IPI ALL 0 - poke_cpu 161 0x4c 5 MSI-X 83 1 - igb_intr_rx 162 0x4d 5 MSI-X 84 1 - igb_intr_tx_other 163 0x4e 5 MSI-X 85 1 - igb_intr_rx 164 0x4f 5 MSI-X 86 1 - igb_intr_tx_other 165 0x50 5 MSI-X 87 1 - igb_intr_rx 166 0x6c 6 MSI-X 88 1 - ixgbe_intr_msix 167 0x6d 6 MSI-X 89 1 - ixgbe_intr_msix 168 0x6e 6 MSI-X 90 1 - ixgbe_intr_msix 169 0x6f 6 MSI-X 91 1 - ixgbe_intr_msix 170 0x70 6 MSI-X 92 1 - ixgbe_intr_msix 171 0x71 6 MSI-X 93 1 - ixgbe_intr_msix 172 0x72 6 MSI-X 94 1 - ixgbe_intr_msix 173 0x73 6 MSI-X 95 1 - ixgbe_intr_msix 174 0x74 6 MSI-X 96 1 - ixgbe_intr_msix 175 0x75 6 MSI-X 97 1 - ixgbe_intr_msix 176 0x76 6 MSI-X 98 1 - ixgbe_intr_msix 177 0x77 6 MSI-X 99 1 - ixgbe_intr_msix 192 0xc0 13 IPI ALL 1 - xc_serv 208 0xd0 14 IPI ALL 1 - kcpc_hw_overflow_intr 209 0xd3 14 IPI ALL 1 - cbe_fire 210 0xd4 14 IPI ALL 1 - cbe_fire 240 0xe0 15 IPI ALL 1 - xc_serv 241 0xe1 15 IPI ALL 1 - apic_error_intr
Use Control D to return to the shell.
|