Restore a PCIe Card Configuration on an I/O Domain

Language:

After the PCIe card has been physically replaced, verify that the card is now visible to Oracle VM Manager.

# ldm ls-io pcie-slot

For example:

# ldm ls-io pci_45
NAME                         TYPE   BUS      DOMAIN   STATUS
---------------              ----   -----    -------  ------
pci_45                       BUS    pci_45   primary   IOV
[pci@32d]
/SYS/CMIOU9/PCIE2            PCIE   pci_45   primary   OCC
[pci@32d/pci@1]
    SUNW,qlc@0/fp/disk
    SUNW,qlc@0/fp@0,0
    SUNW,qlc@0,1/fp/disk
    SUNW,qlc@0,1/fp@0,0
/SYS/CMIOU9/PCIE2/IOVFC.PF0   PF     pci_45   primary
[pci@32d/pci@1/SUNW,qlc@0]
    maxvfs = 16
/SYS/CMIOU9/PCIE2/IOVFC.PF1   PF     pci_45   primary
[pci@32d/pci@1/SUNW,qlc@0,1]
    maxvfs = 16

If you stopped the I/O domain to prepare it for removal, restart the domain.
```
# ldm start ldg4
LDom ldg4 started
```

Ensure that the backup file stored the correct configuration information.

# cat /var/tmp/vf_config.txt
NAME                                       TYPE   BUS      DOMAIN    STATUS
----                                       ----   ---      ------    ------
pci_45                                     BUS    pci_45   primary   IOV
[pci@32d]
/SYS/CMIOU9/PCIE2                          PCIE   pci_45   primary   OCC
[pci@32d/pci@1]
    SUNW,qlc@0/fp/disk
    SUNW,qlc@0/fp@0,0
    SUNW,qlc@0,1/fp/disk
    SUNW,qlc@0,1/fp@0,0/ssd@w20350080e518b846,1f
    fibre-channel@0,2
    fibre-channel@0,3
    fibre-channel@0,4
    fibre-channel@0,5
...

/SYS/CMIOU9/PCIE2/IOVFC.PF0.VF0            VF     pci_45   ldg4
[pci@32d/pci@1/SUNW,qlc@0,2]
    Class properties [FIBRECHANNEL]
        port-wwn = 10:00:00:14:4f:f8:74:85
        node-wwn = 20:00:00:14:4f:f8:74:85
        bw-percent = 0
...

/SYS/CMIOU9/PCIE2/IOVFC.PF0.VF3            VF     pci_45   ldg4
[pci@32d/pci@1/SUNW,qlc@0,5]
    Class properties [FIBRECHANNEL]
        port-wwn = 10:00:00:14:4f:fb:27:29
        node-wwn = 20:00:00:14:4f:fb:27:29
        bw-percent = 0
#

Manually create each virtual function using the properties saved in the test file you created.
Note - Because the system assigns virtual function names, you must create new virtual functions in the order of the names the system assigns. For example, if four virtual functions are created, VF0–VF3, you must create VF0 and its associated property values first so the system will assign the properties to a virtual function with a name ending in VF0.

See Prepare a PCIe Card For Removal for examples of the test file. Refer to the Oracle VM Server for SPARC documentation for the syntax of the create-vf command.

Verify that the virtual functions were created.

Note - The following example shows only an excerpt of the output.

# ldm ls-io -l pci_45
NAME                                       TYPE   BUS      DOMAIN    STATUS
----                                       ----   ---      ------    ------
pci_45                                     BUS    pci_45   primary   IOV
[pci@32d]
/SYS/CMIOU9/PCIE2                          PCIE   pci_45   primary   OCC
[pci@32d/pci@1]
    SUNW,qlc@0/fp/disk
    SUNW,qlc@0/fp@0,0
    SUNW,qlc@0,1/fp/disk
    SUNW,qlc@0,1/fp@0,0/ssd@w20350080e518b846,1f
    fibre-channel@0,2
    fibre-channel@0,3
    fibre-channel@0,4
    fibre-channel@0,5
...

/SYS/CMIOU9/PCIE2/IOVFC.PF0.VF0            VF     pci_45   ldg4
[pci@32d/pci@1/SUNW,qlc@0,2]
    Class properties [FIBRECHANNEL]
        port-wwn = 10:00:00:14:4f:f8:74:85
        node-wwn = 20:00:00:14:4f:f8:74:85
        bw-percent = 0
...

/SYS/CMIOU9/PCIE2/IOVFC.PF0.VF3            VF     pci_45   ldg4
[pci@32d/pci@1/SUNW,qlc@0,5]
    Class properties [FIBRECHANNEL]
        port-wwn = 10:00:00:14:4f:fb:27:29
        node-wwn = 20:00:00:14:4f:fb:27:29
        bw-percent = 0
#

Assign each virtual function to the same domains on the new card to which they were assigned on the replaced card.
When all virtual functions have been recreated, assign them to the same domains recorded in the file saved in Prepare a PCIe Card For Removal, for example.
```
# ldm add-io /SYS/CMIOU9/PCIE2/IOVFC.PF0.VF0 ldg4
# ldm add-io /SYS/CMIOU9/PCIE2/IOVFC.PF0.VF1 ldg4
# ldm add-io /SYS/CMIOU9/PCIE2/IOVFC.PF0.VF2 ldg4
# ldm add-io /SYS/CMIOU9/PCIE2/IOVFC.PF0.VF3 ldg4
```

Verify that the virtual functions have been added to all I/O domains, for example:

# ldm ls-io /SYS/CMIOU9/PCIE2
NAME                                       TYPE   BUS      DOMAIN    STATUS
----                                       ----   ---      ------    ------
/SYS/CMIOU9/PCIE2                          PCIE   pci_45   primary   OCC
/SYS/CMIOU9/PCIE2/IOVFC.PF0                PF     pci_45   primary
/SYS/CMIOU9/PCIE2/IOVFC.PF1                PF     pci_45   primary
/SYS/CMIOU9/PCIE2/IOVFC.PF0.VF0            VF     pci_45   ldg4
/SYS/CMIOU9/PCIE2/IOVFC.PF0.VF1            VF     pci_45   ldg4
/SYS/CMIOU9/PCIE2/IOVFC.PF0.VF2            VF     pci_45   ldg4
/SYS/CMIOU9/PCIE2/IOVFC.PF0.VF3            VF     pci_45   ldg4

In this example, the virtual functions listed under the TYPE column now displays a domain name.

Related Information

Oracle VM Server for SPARC documentation (http://www.oracle.com/goto/vm-sparc/docs)
Prepare a PCIe Card For Removal