For Oracle Solaris 11.1 and Oracle Solaris 11.2, Oracle Virtual Networking host drivers have a debug tool called xsigo-support. This script collects and dumps information for monitoring and troubleshooting your host-software installation. Oracle collects this information for debugging, or asks you to run the tool to gather the information and then send it to Oracle Technical Support. The xsigo-support script resides on the host server at this location:
/opt/orclovn/bin/xsigo-support
As a result, if you are requested to send output of the xsigo-support script to Oracle Technical Support, you will need to put the output into a file before forwarding it to Oracle Technical Support.
Because the output of the xsigo-support script is usually large, it can scroll off the console screen. You can pipe the output to "more" to get more manageable amounts of output.
Use the --help suffix to display the keyword options:
./xsigo-support --help
By default, the xsigo-support script output is sent to a bzip2 file, which is a tarred file with the .bz2 extension.
For example:
/opt/orclovn/bin/xsigo-support Creating Xsigo support package ./xsigo-support-sparc2-2013-03-13--09.55.09.tar.bz2 Done
Unzipping the bz2 file shows the individual files that are collected while the xsigo-support script runs.
bzip2 -d xsigo-support-sparc2-2013-03-xsigo-support-sparc2-2013-03-08-- 10.59.49.tar.bz2 xsigo-support-sparc2-2013-03-13--09.55.09.tar.bz2 root@sparc2:~# tar xvf xsigo-support-sparc2-2013-03-13--09.55.09.tar.bz2 x xsigo-support-sparc2-2013-03-13--09.55.09, 0 bytes, 0 tape blocks x xsigosupport- sparc2-2013-03-13--09.55.09/etc, 0 bytes, 0 tape blocks x xsigo-supportsparc2- 2013-03-13--09.55.09/etc/path_to_inst.txt, 7099 bytes, 14 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/etc/release.txt, 220 bytes, 1 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/etc/name_to_major.txt, 2751 bytes, 6 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/etc/driver_aliases.txt, 14717 bytes, 29 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/etc/system.txt, 1946 bytes, 4 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/var, 0 bytes, 0 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/var/log, 0 bytes, 0 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/var/log/xsadmd.log, 101776 bytes, 199 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/var/crash, 0 bytes, 0 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/var/crash/mdb-stackregs-0.txt, 3673 bytes, 8 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/var/crash/mdb-msgbuf-0.txt, 17712 bytes, 35 tape blocks x xsigo-support-sparc2-2013-03-13-- 09.55.09/var/crash/mdb-system-0.txt, 128 bytes, 1 tape blocks x xsigo-supportsparc2- 2013-03-13--09.55.09/var/crash/mdb-panicinfo-0.txt, 1033 bytes, 3 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/var/adm, 0 bytes, 0 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/var/adm/messages.0, 108822711 bytes, 212545 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/var/adm/messages.1, 1556288980 bytes, 3039627 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/var/adm/messages, 39325 bytes, 77 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds, 0 bytes, 0 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/svcs.txt, 7318 bytes, 15 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/threadlist-v.txt, 320083 bytes, 626 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/kstat-m-xsvhba.txt, 32 bytes, 1 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/mdb-k.txt, 84 bytes, 1 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/pkglist. txt, 36418 bytes, 72 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/dladm-show-link.txt, 573 bytes, 2 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/ps-e.txt, 94 bytes, 1 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/isainfok. txt, 35 bytes, 1 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/iostat.txt, 1293 bytes, 3 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/top.txt, 12532 bytes, 25 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/dladm-show-phys.txt, 830 bytes, 2 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/scanpci-v.txt, 17247 bytes, 34 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/prtconf-Dv.txt, 185977 bytes, 364 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/kstat-m-sd.txt, 8241 bytes, 17 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/ifconfig-a.txt, 1431 bytes, 3 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/vmstat.txt, 1293 bytes, 3 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/modinfo.txt, 15753 bytes, 31 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/cfgadm-a.txt, 3285 bytes, 7 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/svcs-xv.txt, 25 bytes, 1 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/pkginfo-l.txt, 149335 bytes, 292 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/kstat-m-xsvnic.txt, 32 bytes, 1 tape blocks x xsigo-support-sparc2-2013-03-13--09.55.09/xsigo-cmds/ipadm.txt, 1326 bytes, 3 tape blocks
Sample contents of xsigo-supportand related comments follow.
The output of pkginfo -1 displays a listing of installed packages:
Output of 'pkginfo -l' -->
...
PKGINST: ORCLovnk
NAME: Xsigo Virtual IO drivers
CATEGORY: system
ARCH: i386
VERSION: 5.0.0-SL
BASEDIR: /
VENDOR: Oracle Corp.
DESC: Xsigo Virtual Adapter Drivers
PSTAMP: solbuild0120090918093550
INSTDATE: Sep 18 2009 10:05
HOTLINE: Please contact Oracle representative
EMAIL: support@oracle.com
STATUS: completely installed
FILES: 12 installed pathnames
5 shared pathnames
5 directories
4 executables
4080 blocks used (approx)
PKGINST: ORCLovnu
NAME: Oracle Virtual IO Applications
CATEGORY: application
ARCH: i386
VERSION: 5.0.0-SL
BASEDIR: /
VENDOR: Oracle Corp.
DESC: Xsigo Virtual Adapter Applications
PSTAMP: solbuild0120090918093551
INSTDATE: Sep 18 2009 10:05
HOTLINE: Please contact Oracle representative
EMAIL: support@oracle.com
STATUS: completely installed
FILES: 21 installed pathnames
1 shared pathnames
8 directories
8 executables
9668 blocks used (approx)
...
See the output of modinfo for IB and Oracle virtual resource information.
The following output is displayed for InfiniBand information modules:
... 86 ffffffffefcc8000 ba20 7 1 ib (IB nexus 1.28) 87 ffffffffefcd4000 a6b0 - 1 ibdm (InfiniBand Device Manager 1.26) 88 ffffffffefcdf000 11748 - 1 ibtl (IB Transport Layer v1.14) 89 ffffffffefcf0000 69b68 - 1 ibmf (IB Agent Interfaces 2.0) 90 ffffffffefd3a000 74468 8 1 hermon (ConnectX IB Driver) ...
The following output is displayed for Oracle virtual resource modules:
...
162 fffffffff012b000 3a80 227 1 xstn (Xsigo Transport nexus driver v1)
163 ffffffffefc54920 848 22 1 sy (Indirect driver for tty 'sy' 1.)
165 fffffffff08d2000 6c72f0 34 1 nvidia (nvidia Sep 19 2007 16:12:36)
167 fffffffff0598000 f7f0 - 1 xstl (Xsigo Transport services v0.2)
...
226 fffffffff0813000 15858 229 1 xsvhba (Xsigo Virtual HBA)
...
238 ffffffffefed2000 67d8 228 1 xsvnic (Xsvnic GLDv3 Driver)
...
The following additional InfiniBand port information is present:
Output of 'cfgadm -a | grep IB-VPPA' --> ib::24E89097FEE21D,ffff,ipib IB-VPPA connected configured ok ib::24E89097FEE21D,ffff,xstn IB-VPPA connected configured ok ib::24E89097FEE21E,ffff,ipib IB-VPPA connected configured ok ib::24E89097FEE21E,ffff,xstn IB-VPPA connected configured ok
Firmware version and additional device information is available for the HCA(s) in the host:
Output of 'cxflash -l' -->
List of available devices:
Device[0], /devices/pci@0,0/pci8086,3410@9/pci15b3,673c@0:devctl
Class [IB]
GUID: System Image - 0024e89097fee21f
Node Image - 0024e89097fee21c
Port 1 - 0024e89097fee21d
Port 2 - 0024e89097fee21e
Firmware revision : 2.7.0000
No HW information available
This information shows a dual port HCA is installed, and the HCA is running the supported version of firmware.
The kernel log shows the buffer information being dumped by different drivers.
> dmesg Thu Sep 24 15:29:51 PDT 2009 Sep 24 13:44:41 snarf xsvhba: [ID 824248 kern.notice] NOTICE: <vhba vh4> xsvhba_delayed_connect: Retrying DATA Connect Sep 24 13:44:41 snarf xsvhba: [ID 461420 kern.notice] NOTICE: <vhba vh4> xsvhba_delayed_connect: Connect failed. rval: 13, handle : ffffffffa925e980 Sep 24 13:44:41 snarf xsvhba: [ID 744828 kern.notice] NOTICE: <vhba vh4> xsvhba_chan_state_change: DATA:XSTL_CHAN_STATE_DISCONNECTED Sep 24 13:44:41 snarf xsvhba: [ID 440485 kern.warning] WARNING: <vhba vh4> xsvhba_send_xcm_msg: xstl_chan_write failed: rlen = -8 Sep 24 13:44:42 snarf xsvhba: [ID 824248 kern.notice] NOTICE: <vhba vh6> xsvhba_delayed_connect: Retrying DATA Connect Sep 24 13:44:42 snarf xsvhba: [ID 461420 kern.notice] NOTICE: <vhba vh6> xsvhba_delayed_connect: Connect failed. rval: 13, handle : ffffffffa92589c0 Sep 24 13:44:42 snarf xsvhba: [ID 744828 kern.notice] NOTICE: <vhba vh6> xsvhba_chan_state_change: DATA:XSTL_CHAN_STATE_DISCONNECTED ...
Displaying kernel log information for a specific Oracle component (in this case XSTN):
> dmesg | grep xstn Oct 26 09:15:12 snarf xstn: [ID 835877 kern.notice] NOTICE: xstn1: xcm channel state change to 2 on rec 1 Oct 26 10:34:24 snarf xstn: [ID 835877 kern.notice] NOTICE: xstn0: xcm channel state change to 16 on rec 0 Oct 26 10:37:37 snarf xstn: [ID 835877 kern.notice] NOTICE: xstn0: xcm channel state change to 2 on rec 0 >
All the current Oracle processes are displayed:
Output of 'svcs xsadmd' -->
STATE STIME FMRI
online 17:21:30 svc:/application/xsadmd:default
Network device information:
Output of 'ifconfig -a' -->
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232
index 1
inet 127.0.0.1 netmask ff000000
bnx0: flags=201004843<UP,BROADCAST,RUNNING,MULTICAST,DHCP,IPv4,CoS> mtu 1500
index 2
inet 192.168.10.191 netmask fffff800 broadcast 192.168.15.255
ether 0:23:ae:fd:80:d4
xsvnic2: flags=201000842<BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 3
inet 0.0.0.0 netmask 0
ether 0:13:97:2:50:8f
...
The bnx0 device is the physical NIC in the host. The xsvnix2 is the Oracle virtual NIC.
Currently loaded Oracle host drivers:
For general information, use the output of pkginfo while grepping for XSIGO.
This is case sensitive.
> pkgrepoinfo | grep XSIGO system ORCLovnk Xsigo Virtual IO drivers application ORCLovnu Xsigo Virtual IO Applications
For more detailed information, use the output of pkginfo for the currently installed driver. For example, to show a detailed listing of a named package that was completely installed.
> pkginfo -il ORCLovnu
PKGINST: ORCLovnu
NAME: Oracle Virtual Networking Applications
CATEGORY: application
ARCH: i386
VERSION: 5.0.0-SL
BASEDIR: /
VENDOR: Oracle
DESC: Oracle Virtual Network Adapter Applications
PSTAMP: solbuild0120090918093551
INSTDATE: Sep 18 2012 10:05
HOTLINE: Please contact Oracle representative
EMAIL: support@oracle.com
STATUS: completely installed
FILES: 21 installed pathnames
1 shared pathnames
8 directories
8 executables
9668 blocks used (approx)
Oracle service modules are loaded and running:
Output of svcs xsadmd--> STATE STIME FMRI online 17:21:30 svc:/application/xsadmd:default
You can also check console messages in /var/adm/messages:
> vi /var/adm/messages "/var/adm/messages" 13847 lines, 1833733 characters Oct 20 03:10:01 snarf syslogd: line 24: WARNING: loghost could not be resolv ed Oct 20 12:46:17 snarf e1000g: [ID 801725 kern.info] NOTICE: pciex8086,108c - e1000g[0] : link down Oct 20 12:46:36 snarf e1000g: [ID 801725 kern.info] NOTICE: pciex8086,108c - e1000g[0] : link up, 100 Mbps, full duplex Oct 20 12:46:36 snarf /sbin/dhcpagent[44]: [ID 967406 daemon.warning] refres hing state on e1000g0 Oct 20 12:46:37 snarf /sbin/dhcpagent[44]: [ID 778557 daemon.warning] config ure_v4_lease: no IP broadcast specified for e1000g0, making best guess Oct 21 12:59:34 snarf xstn: [ID 835877 kern.notice] NOTICE: xstn0: xcm chann el state change to 16 on rec 0 ...