Oracle® Enterprise Manager Ops Center

Creating IPMP Groups in Oracle Solaris 11 Non-Global Zone on Oracle SuperCluster

12c Release 3 (12.3.0.0.0)

E63733-01

October 2015

This guide provides an end-to-end example for how to use Oracle Enterprise Manager Ops Center.

Introduction

Oracle Enterprise Manager Ops Center provides comprehensive lifecycle management for Oracle Solaris and Linux operating systems in your data center.

IP Multipath (IPMP) provides physical interface failure detection, transparent network access failover, and packet load spreading for systems with multiple interfaces. Oracle Enterprise Manager Ops Center provides an option to create IPMP groups. You can configure one or more interfaces into an IPMP group. The group functions like an IP interface with data addresses to send and receive network traffic. When an underlying interface in the group fails, the data addresses are redistributed among the remaining underlying active interfaces in the group. Thus, the group maintains network connectivity despite an interface failure. With IPMP, network connectivity is always available, provided a minimum of one interface is usable for the group.

IPMP groups can be created in a zone, server pool, and also as a standalone outside of Oracle SuperCluster.

In this document, you learn how to create IPMP groups on Ethernet and InfiniBand interfaces for Oracle Solaris 11 non-global zone on Oracle SuperCluster.

See Related Resources for links to related information and articles about discovering and managing other assets.

The following sections are described in detail:

- Setup the Network

- Create an IPMP Group for Ethernet Interface

- Create an IPMP Group for InfiniBand Interface

- Verify the IPMP Group

Pre-requisites

The following are the prerequisites before you start the procedure:

- Oracle SuperCluster discovered and managed by Oracle Enterprise Manager Ops Center.

- Agent-managed Oracle Solaris 11 global zone.

- Server pool for Oracle Solaris 11 non-global zones.

- Zone without a network interface created in the server pool for Oracle Solaris 11 non-global zones.

- Oracle Solaris version S11.1 SRU 10.0.5.0. or higher.

- Logical Domains Manager version 3.1.0.0.24 or higher.

Setup the Network

Perform the following steps to setup the network for creating an IPMP group.

1. Log in to Oracle Enterprise Manager Ops Center.

2. In the Navigation pane, under Assets, select Server Pools.

3. In the server pool, select the non-global zone (without a network interface) where you want to create an IPMP group.

Note:
Oracle Enterprise Manager Ops Center can assign only one interface to Oracle SuperCluster non-global zones.

4. Shut down the non-global zone server pool. In the Actions pane, click Shutdown Zone. Click Shutdown Zone again to confirm.

After the zone is shutdown, it is displayed in the navigation pane as shown in the following figure.

5. Connect two network interfaces to the non-global zone. Perform the following steps to connect the network interfaces.

1. In the Navigation pane, select the non-global zone.

2. In the Actions pane, click Connect Network. The Connect Networks to Zone window opens.

3. Click the Add icon to create an empty network field.

4. In the Network field, select a network to connect to the zone.

5. In the NIC field, select a network interface card.

6. Click the Add icon to create an empty network field to add a standby network.

7. In the Network field, select the same network that you selected in step 5d to connect to the zone.

8. In the NIC field, select another network interface card.
The network interface card must be different from the one you selected before.

9. Click Connect Networks.

10. In the selected non-global zone, navigate to Network > Network Connectivity and verify if the networks connected are present in the Network Interface Connectivity table.

6. In the Actions pane, click Boot Zone to boot the non-global zone. Click Boot Zone again to confirm.

Create an IPMP Group for Ethernet Interface

Perform the following steps to create an IPMP group for an Ethernet interface. Use the Ops Center Administrator role to perform the following steps.

1. Select the non-global zone.

2. In the center pane, click Networks, then select the IPMP Groups tab.

3. Click the Add icon to create an IPMP group. The Create IPMP Group wizard opens.

4. In the Specify IPMP Group screen, enter the required values.

1. In the IPMP Group Name field, enter a name for the IPMP group.

Note:
The IPMP name must consist of a string followed by a numeric value. For example, ipmp1. If you want to create more groups, increase the numeric value. For example, ipmp2, ipmp3, ipmp4, and so on.

2. In the Network field, select a network from the drop-down list.

3. In the Gateway field, select the check box Add Default Route to Gateway.

4. In the Media Type field, select Ethernet.

5. In the IPMP Group Members field, select the networks from the Available Networks column and move them to the IPMP Group Members column.

6. Click Next.

5. In the Specify NIC Settings screen, select the first network interface to serve as standby. Select the check box against the network in the Standby Interface field, then click Next. Leave the check box against the second network interface unchecked.

6. In the Specify Data Addresses screen, click the Add icon and enter an unused IP address of the IPMP group, then click Next.

7. Review the Summary, then click Finish.

Create an IPMP Group for InfiniBand Interface

Perform the following steps to create an IPMP group for an InfiniBand interface. Use the Ops Center Administrator role to perform the following steps.

Note:
Creation of IPMP on Oracle Solaris 10 non-global zone is not supported.

1. Select the non-global zone.

2. In the center pane, click Networks, then select the IPMP Groups tab.

3. Click the Add icon to create an IPMP group. The Create IPMP Group wizard opens.

4. In the Specify IPMP Group screen, enter the required values.

1. In the IPMP Group Name field, enter a name for the IPMP group.

Note:
The IPMP name must consist of a string followed by a numeric value. For example, ipmp1. If you want to create more groups, increase the numeric value. For example, ipmp2, ipmp3, ipmp4, and so on.

2. In the Network field, select a InfiniBand network from the drop-down list.

3. In the Media Type field, select InfiniBand.

4. In the P-Key field, the value is populated by default.

- If the default value starts with 8 or higher, do not edit.

- If the default value starts with 0 - 7, then edit the P-Key value and add 8 to the first digit.

The P-Key value must be similar as shown in the following example.

Table 1 Example P-Key Values

Default Value

Correct Value

0x0503

0x8503

0x3333

0xB333

0x7FFF

0xFFFF

0x8503

0x8503

0xABCD

0xABCD

5. In the IPMP Group Members field, select the networks from the Available Networks column and move them to the IPMP Group Members column.

6. Click Next.

5. In the Specify NIC Settings screen, select the first network interface to serve as standby. Select the check box against the network in the Standby Interface field, then click Next. Leave the check box against the second network interface unchecked.

6. In the Specify Data Addresses screen, click the Add icon and enter an unused IP address of the IPMP group, then click Next.

7. Review the Summary, then click Finish.

Verify the IPMP Group

After the job completes, you can perform the following checks to verify if the IPMP group has been created.

- Verify if the IPMP group is successfully created. Perform the following steps:

1. In the Navigation pane, select the non-global zone.

2. In the center pane, click Networks, then select the IPMP Groups tab.
The newly created IPMP group is displayed.

- Login to the non-global zone using the command line interface to check if the group is created.

- (Optional) Reboot the non-global zone to verify if the IPMP configuration is preserved after reboot.
Type init 6

- Use the following commands to display the IPMP configuration:

1. Type ipmpstat -g

2. Type ipadm

- Test the network connectivity by performing the following steps:

1. Login to the non-global zone and type ping -s <IP_outside_of_SSC>.

2. Login to the Operating System outside of Oracle SuperCluster and type ping -s <IP_entered_in_Data_Addresses>.

What's Next

Now that the IPMP group is configured, the non-global zone's connectivity is always available. IPMP also provides load spreading for the outbound network traffic across the network interfaces in the group.

Related Resources

For more information, see the Oracle Enterprise Manager Ops Center Documentation Library at http://docs.oracle.com/cd/E59957_01/index.htm.

Documentation Accessibility

For information about Oracle's commitment to accessibility, visit the Oracle Accessibility Program website at http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.

Access to Oracle Support

Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.

Oracle Enterprise Manager Ops Center Creating an IPMP Group in Oracle Solaris 11 Non-Global Zone on Oracle SuperCluster, 12c Release 3 (12.3.0.0.0)

E63733-01

Copyright © 2007, 2015, Oracle and/or its affiliates. All rights reserved.

This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited.

The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable:

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open Group.

This software or hardware and documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.

Oracle Legal Notices

Copyright Notice

Copyright © 1994-2017, Oracle and/or its affiliates. All rights reserved.

License Restrictions Warranty/Consequential Damages Disclaimer

This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited.

Warranty Disclaimer

The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.

Restricted Rights Notice

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable:

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

Hazardous Applications Notice

This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.

Trademark Notice

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open Group.

Third-Party Content, Products, and Services Disclaimer

This software or hardware and documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.

Pre-General Availability Draft Documentation Notice

If this document is in public or private pre-General Availability status:

This documentation is in pre-General Availability status and is intended for demonstration and preliminary use only. It may not be specific to the hardware on which you are using the software. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to this documentation and will not be responsible for any loss, costs, or damages incurred due to the use of this documentation.

Private Pre-General Availability Draft Documentation Notice

If this document is in private pre-General Availability status:

The information contained in this document is for informational sharing purposes only and should be considered in your capacity as a customer advisory board member or pursuant to your pre-General Availability trial agreement only. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described in this document remains at the sole discretion of Oracle.

This document in any form, software or printed matter, contains proprietary information that is the exclusive property of Oracle. Your access to and use of this confidential material is subject to the terms and conditions of your Oracle Master Agreement, Oracle License and Services Agreement, Oracle PartnerNetwork Agreement, Oracle distribution agreement, or other license agreement which has been executed by you and Oracle and with which you agree to comply. This document and information contained herein may not be disclosed, copied, reproduced, or distributed to anyone outside Oracle without prior written consent of Oracle. This document is not part of your license agreement nor can it be incorporated into any contractual agreement with Oracle or its subsidiaries or affiliates.

Documentation Accessibility

For information about Oracle's commitment to accessibility, visit the Oracle Accessibility Program website at http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.

Access to Oracle Support

Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.