Oracle Solaris Might Run Out of MSI-X
Vectors
Issue:
Oracle Solaris limits the number of MSI-X vectors to 32 per IPL.
Network interface cards (NICs) and host bus adapters (HBAs) are all
assigned to IPL 6. If there are a large number of adapters in the
Sun Fire X4470 Server that use MSI-X for interrupts, you might run out of
MSI-X vectors. If this occurs, the system sends a message similar to
the following:
Apr 15 23:22:54 ban21uut058spare2 pcplusmp: [ID 475383
kern.warning] WARNING: No interrupt vector: pciex8086,10fb
instance 1
Apr 15 23:22:54 ban21uut058spare2 pcplusmp: [ID 383221
kern.warning] WARNING: Sharing vectors: pciex8086,10fb instance
11 and pciex8086,10fb instance 1
Affected Operating
Systems:
-
Oracle Solaris 10 8/11
-
Oracle Solaris 10 9/10
Workaround:
-
Download Oracle Solaris patch 146025-01.
For Solaris patches, go to:
https://support.oracle.com
-
Edit the /etc/system file to add the
following line:
set
pcplusmp:apic_adjipl_option=2
-
Reboot the system.
If you have difficulty installing Oracle Solaris because of this
issue before you apply the workaround above, you can free up MSIs by
excluding the driver for the card that is most numerous in the
system.
For example, the following procedure excludes the 10 Gigabit
Ethernet card driver:
-
At the GRUB prompt, enter e to
edit.
-
Scroll down to
kernel$ /platform/i86pc/multiboot -B
$ZFS-BOOTFS
-
Enter e again, and append:
ixgbe-disable=true
The resulting line should be similar to the following:
kernel$ /platform/i86pc/multiboot -B
$ZFS-BOOTFS,ixgbe-disable=true
-
Press Enter.
-
Enter b to boot the system.
|