Contents

Sun Blade 6048 Switched InfiniBand Network ExpressModule User’s Guide

820-2189-10

Contents

Regulatory Compliance Statements

Safety Agency Compliance Statement

1. Introduction to the Sun Blade 6048 Switched InfiniBand Network ExpressModule

1.1 Product Features

1.2 Platform and Operating System Support

1.3 IB NEM Indicators, Buttons, and Ports

2. Replacing the Sun Blade 6048 Switched InfiniBand Network ExpressModule

2.1 Replacing IB NEM Hardware

2.1.1 Replace IB NEM in a Powered-On Chassis

2.1.2 Install IB NEM in a Powered-On Chassis

2.2 Verifying Installation

2.2.1 Verify Hardware Installation

2.2.2 Verify Installation Using the ILOM Web Interface

2.2.3 Verify Installation Using the ILOM CLI

2.2.4 Verify Component Status Using the LEDs

2.3 Verify Installation on Linux

2.4 Troubleshooting a Hot-Remove Operation

2.4.1 Troubleshoot Using the ILOM Web Interface

2.4.2 Troubleshoot Using the ILOM CLI

3. InfiniBand Software Overview

3.1 InfiniBand Software for Linux

3.1.1 OpenFabrics Enterprise Distribution for Linux

3.1.2 Installing the InfiniBand Drivers on Linux

3.1.2.1 Install IB Drivers From Linux Distribution Source

3.1.2.2 Install the OFED Package

3.1.2.3 Verify Driver Installation on Linux

3.2 Running OpenSM

4. Internet Protocol Over InfiniBand

4.1 Configuring IPoIB on Linux

4.1.1 Install IPoIB Driver

4.1.2 Change IPoIB Configuration Without Rebooting

4.1.3 Change IB Startup Behavior on Linux

5. Updating the Sun Blade 6048 Switched InfiniBand Network ExpressModule Firmware

5.1 Updating IB NEM Firmware for Linux

5.1.1 Update IB NEM Firmware for Linux

5.1.2 Update The IB NEM Integrated Switches’ Firmware

A. InfiniBand Cables

A.1 Active and Passive DDR Copper Cables

Copyright © 2008, Sun Microsystems, Inc. All Rights Reserved.