PCI Cards on the PCI Auxilliary Board

Slot 0 and Slot 1 are 133MHZ PCI-X slots and support form factor PCI-X cards. The maximum power for each slot is 25 Watts.

Slot 2 and Slot 3 are x8 PCIe slots that have x16 mechanical connectors. These slots support form factor PCIe cards, and support the highest power 75 Watt PCIe card. However, only one 75 Watt PCIe card can be installed in the server. It is suggested to install the 75 Watt card in Slot 2 for better cooling.

PCI Cards on the PCI Mezzanine Assembly

PCIe Slots 4-9 are x8 PCIe slots and support low profile PCIe cards and Max power for each slot is 25 Watts. PCIe Slot 4 and PCIe Slot 5 are combination slots with XAUI4 and XAUI5.

If a XAUI card is installed in the XAUI4 slot, the PCIe Slot 4 cannot be used, and the Ethernet Port 1 on the motherboard will be disabled. If a XAUI card is installed in the XAUI5 slot, the PCIe Slot 5 cannot be used and the Ehternet Port 0 on the motherboard will be disabled.

High Bandwidth PCIe Card Installation

To balance the PCIe bus bandwidth from the upstream of the PCIe buses, it is suggested to limit the numbers of high bandwidth PCIe cards installed in the server. It is also suggested to install the high bandwidth PCIe cards in the assigned slots. The following are two examples:

Example 1 – If one or two XAUI cards are installed in the server, it is suggested to install two high bandwidth PCIe cards: one in Slot 2 and in Slot 8.

Example 2 – If there are no XAUI cards installed in the server, it is suggested to install four high bandwidth PCIe cards: one in Slot 2, 4, 8, and 9.

Infrastructure Boards

The Sun Netra T5440 server has the following boards installed in the chassis:

• Motherboard – The motherboard includes two CMP modules, slots for 16 FB‐DIMMs, memory control subsystems, and all service processor (ILOM) logic. In addition, a removable SCC module contains all MAC addresses, host ID, and ILOM configuration data. When replacing the motherboard, the SCC module can be transferred to a new board to retain system configuration data. However, your OpenBoot PROM configuration information is stored on the NVRAM on the motherboard, and the NVRAM cannot be transferred to the new motherboard, so you should record your OpenBoot PROM configuration information before replacing the motherboard.

  The service processor (ILOM) subsystem controls the server power and monitors server power and environmental events. The ILOM controller draws power from the server’s 3.3V standby supply rail, which is available whenever the system is receiving main input power, even when the system is turned off.

  
  

  ---

  Note - CPUs can not be upgraded or replaced on the motherboard. If a CPUs fails, the motherboard must be replaced as a field-replaceable unit (FRU).

  ---

  
  

• Memory mezzanine assembly – This is an option that requires purchasing an upgrade. This assembly provides an additional 16 memory slots.

• Power distribution board – This board distributes main 12V power from the power supplies to the rest of the system. This board is directly connected to the motherboard through a bus bar and ribbon cable.

• Power supply backplane – This board carries 12V power from the power supplies to the power distribution board with a pair of bus bars.

• Fan power boards – This board carries power to the system fan modules, and is cabled to the power distribution board.

• SAS backplane – This board includes the connectors for the 12 SAS hard drives.

  Each drive has its own Power/Activity, Fault, and Ready-to-Remove LEDs.

• System Alarm Board – This board contains the interconnect for the front I/O board, Power and Locator buttons, and system/component status LEDs.

• PCI auxiliary board (PCI_AUX) – This board has two PCIe slots and two PCI-X slots to support full length and full height PCIe/PCI-X cards. One Intel 41210 PCIe to PCI-X chip is used to convert the PCIe bus to two PCI-X buses. One PLX8525 PCIe switch is used to expand two PCIe slots. All the PCIe signal/buses are from the PCI mezzanine board, through the cables.

• PCI mezzanine board (PCI_MEZZ) – This board is designed with six x8 PCIe slots and two XAUI slots (combo) to support six low profile PCIe cards or four low profile PCIe cards and two XAUI cards. One PLX8533 PCIe switch is used to expand the PCIe slots.

• DVD interface board – This board connects the optical media drive to the motherboard.

• PCIe/XAUI risers – There are three risers per system, each attached to the rear of the motherboard.

  
  

  ---

  Note - 10‐Gbit Ethernet XAUI cards are only supported in Slots 4 and 5.

  ---

  
  

System Cables

The Sun Netra T5440 server has the following cables:

• Ribbon cable, connected between the power distribution board (PDB) and the motherboard

• One SAS cable connects from MB to SAS expander board

• Two power and signals cables are used between PDB and PCI_AUX board

• One x4 PCIe cable, one x8 PCIe cable, and power cable are connected between the PCI Mezz board and the PCI-AUX board

• A power cable connects the fan board and the PDB

• An alarm cable connects the PDB to the DB15 connector in the rear of the server

• A cable is used to connect the PDB to the SYS/Alarm LED board in the front of the server

Issue With Opening the Front Bezel

---

Caution - Do not open the fron bezel while the server is on a flat surface. If opened on a flat surface, the bezel hinges will break.

---

The server must either be rackmounted, OR the front of the server (including bezel hinges) must extend over the edge of a table or desktop surface before opening the bezel.

Front Panel Component Access

FIGURE 1-1 and FIGURE 1-2 depicts front panel features on the server. For a detailed description of front panel controls and LEDs, see Front Panel LEDs.

Front Panel LEDs

TABLE 1-2 describes the front panel system LEDs and controls.

TABLE 1-2   Front Panel LEDs and Controls

LED or Button	Icon	Description
Locator LED and button(White)		The Locator LED enables you to find a particular system. The LED is activated using one of the following methods: The ALOM CMT command setlocator on. The ILOM command set /SYS/LOCATE value=Fast_Blink Manually press the Locator button to toggle the Locator LED on or off. This LED provides the following indications: Off – Normal operating state. Fast blink – System received a signal as a result of one of the methods previously mentioned, indicating that it is active.
Service Required LED(Amber)		If on, indicates that service is required. POST and ILOM are two diagnostics tools that can detect a fault or failure resulting in this indication. The ILOM show faulty command provides details about any faults that cause this indicator to light. Under some fault conditions, individual component fault LEDs are lit in addition to the system Service Required LED.
Power OK LED(Green)		Provides the following indications: Off – Indicates that the system is not running in its normal state. System power might be on or in standby mode. The service processor might be running. Steady on – Indicates that the system is powered on and is running in its normal operating state. No service actions are required. Fast blink – Indicates the system is running at a minimum level in standby and is ready to be quickly returned to full function. The service processor is running. Slow blink – Indicates that a normal transitory activity is taking place. Slow blinking could indicate that the system diagnostics are running, or that the system is booting.
Power button		The recessed Power button toggles the system on or off. If the system is powered off, press once to power on. If the system is powered on, press once to initiate a graceful system shutdown. If the system is powered on, press and hold for 4 seconds to initiate an emergency shutdown. For more information about powering on and powering off the system, refer to the Sun Netra Server Adminstration Guide.

Rear Panel Component Access

FIGURE 1-3 shows rear panel features on the server. For a detailed description of PCIe slots, refer to the Sun Netra T5440 Server Service Manual.

Rear Panel LEDs

TABLE 1-2 describes the front panel system LEDs and controls.

TABLE 1-3   Rear Panel LEDs and Controls

LED or Button	Icon	Description
Locator LED and button(White)		The Locator LED enables you to find a particular system. The LED is activated using one of the following methods: The ALOM CMT command setlocator on. The ILOM command set /SYS/LOCATE value=Fast_Blink Manually press the Locator button to toggle the Locator LED on or off. This LED provides the following indications: Off – Normal operating state. Fast blink – System received a signal as a result of one of the methods previously mentioned, indicating that it is active.
Service Required LED(Amber)		If on, indicates that service is required. POST and ILOM are two diagnostics tools that can detect a fault or failure resulting in this indication. The ILOM show faulty command provides details about any faults that cause this indicator to light. Under some fault conditions, individual component fault LEDs are lit in addition to the system Service Required LED.
Power OK LED(Green)		Provides the following indications: Off – Indicates that the system is not running in its normal state. System power might be on or in standby mode. The service processor might be running. Steady on – Indicates that the system is powered on and is running in its normal operating state. No service actions are required. Fast blink – Indicates the system is running at a minimum level in standby and is ready to be quickly returned to full function. The service processor is running. Slow blink – Indicates that a normal transitory activity is taking place. Slow blinking could indicate that the system diagnostics are running, or that the system is booting.

Chip-Multithreaded Processor and Memory Technology

The UltraSPARC T2 Plus multicore processor is the basis of the Sun Netra T5440 server. The UltraSPARC T2 processor is based on chip multithreading (CMT) technology that is optimized for highly threaded transactional processing. The UltraSPARC T2 processor improves throughput while using less power and dissipating less heat than conventional processor designs.

Depending on the model purchased, each processor chip has four, six, or eight UltraSPARC cores. Each core has two integer pipelines. Each pipeline runs four threads, for a total of eight threads per core.

Additional processor components, such as L1 cache, L2 cache, memory access crossbar, memory controllers, and the I/O interface have been carefully tuned for optimal performance.

Performance Enhancements

The Sun Netra T5440 server expands the CoolThreads family to include dual socket systems. The server delivers extremely high compute density with up to 128 threads in 4 rack units.

The server provides advanced power management through the UltraSPARC T2 power management features that work at both the core and the memory levels of the processor. These features include the ability to reduce instruction issue rates, parking of idle threads and cores, and the ability to turn off clocks in both cores and memory to reduce power consumption.

In addition, the server offers the following features:

• High memory density with up to 256 (with full 32 slots) Gbytes in 4 rack units.

• High internal storage capacity with 1742 Gbytes available

• Robust I/O bandwidth with 8 lanes available in all of the PCIe slots.

• Eco-responsibility through the use of power supplies that are compliant with 80 Plus and Climate Savers computing initiatives.

Preinstalled Solaris Operating System

The Sun Netra T5440 server is preinstalled with the Solaris 10 OS, and offers the following Solaris OS features:

• Stability, high performance, scalability, and precision of a mature 64-bit operating system

• Support for over 5,000 leading technical and business applications, and thousands of Java based services

• Solaris Containers – Isolate software applications and services using flexible, software-defined boundaries

• DTrace – A comprehensive dynamic tracing framework for tuning applications and troubleshooting systemic problems in real time

• Predictive Self-Healing – Capability that automatically diagnoses, isolates, and recovers from many hardware and application faults

• Security – Advanced security features designed to protect the enterprise at multiple levels

• Network Performance – Completely rewritten TCP/IP stack dramatically improves the performance and scalability of your networked services

You can use the preinstalled Solaris 10 OS, or reinstall a supported version of the Solaris 10 OS from your network, CD, or downloaded copy. In some cases, if you reinstall the Solaris OS, you must also install patches. Refer to the Sun Netra T5440 Server Product Notes for information on the supported OS releases for your server.

Hardware-Assisted Cryptography

The UltraSPARC T2 Plus multicore, multithreaded, processors provide hardware-assisted acceleration of symmetric, asymmetric, hashing, and random number generation cryptographic operations as follows:

• Asymmetric algorithms – RSA, DSA, Diffie Hellman, and Elliptic Curve cryptography

• Symmetric algorithms – AES, 3DES, and RC$

• Hashing algorithms – SHA1, SHA256, and MD5

The Solaris 10 OS provides the multithreaded device driver that supports the hardware-assisted cryptography.

Support for Virtualization Through Logical Domains

The Sun Netra T5440 server supports the use of Logical Domains (LDoms) technology. Through the use of the Solaris OS and the built-in server firmware, and by installing the Logical Domains Manager software, you can virtualize the compute services that run on your server. LDoms technology is open source technology, and is included at no additional cost.

A logical domain is a discrete, logical grouping with its own operating system, resources, and identity within a single computer system. Each logical domain can be created, destroyed, reconfigured, and rebooted independently, without requiring a power cycle of the server.

You can run a variety of applications software in different logical domains and keep them independent for performance and security purposes.

Each logical domain can be managed as an entirely independent machine with its own resources, such as:

• Kernel, patches, and tuning parameters

• User accounts and administrators

• Network interfaces, MAC addresses, and IP addresses

Each logical domain can interact only with those server resources made available to it, and the configuration is controlled using the Logical Domains Manager.

For more information on Logical Domains, refer to the Logical Domains (LDoms) Administration Guide.

Remote Manageability With ILOM

The Integrated Lights Out Manager (ILOM) feature is a service processor, built into the server, that enables you to remotely manage and administer the server. The ILOM software is preinstalled as firmware, and initializes as soon as you apply power to the system.

ILOM enables you to monitor and control your server over an Ethernet connection (supports SSH), or by using a dedicated serial port for connection to a terminal or terminal server. ILOM provides a command-line interface and a browser-based interface to remotely administer geographically distributed or physically inaccessible machines. In addition, ILOM enables you to run diagnostics (such as POST) remotely that would otherwise require physical proximity to the server’s serial port.

You can configure ILOM to send email alerts of hardware failures and warnings, and other events related to the server. The ILOM circuitry runs independently of the server, using the server’s standby power. Therefore, ILOM firmware and software continue to function when the server operating system goes offline or when the server is powered off. ILOM monitors the following Sun Netra T5440 server conditions:

• CPU temperature conditions

• Hard drive status

• Enclosure thermal conditions

• Fan speed and status

• Power supply status

• Voltage conditions

• Faults detected by POST (power-on self-test)

• Solaris Predictive Self-Healing (PSH) diagnostic facilities

In addition to the ILOM CLI and browser interface (BI), you can set up the server to use an ALOM CMT compatibility CLI. The ALOM CMT compatibility CLI provides commands that approximate the ALOM CMT CLI that is a system controller interfaced provided on some previous servers.

For information about configuring and using the ILOM service processor, refer to the latest Integrated Lights Out Management (ILOM) User’s Guide and the Sun Integrated Lights Out Manager 2.0 (ILOM 2.0) Supplement for the Sun Netra T5440 Server.

High Levels of System Reliability, Availability, and Serviceability

Reliability, availability, and serviceability (RAS) are aspects of a system’s design that affect its ability to operate continuously and to minimize the time necessary to service the system. Reliability refers to a system’s ability to operate continuously without failures and to maintain data integrity. System availability refers to the ability of a system to recover to an operational state after a failure, with minimal impact. Serviceability relates to the time it takes to restore a system to service following a system failure. Together, reliability, availability, and serviceability features provide for near continuous system operation.

To deliver high levels of reliability, availability, and serviceability, the Sun Netra T5440 server offers the following features:

• Ability to disable individual threads and cores without rebooting

• Lower heat generation reduces hardware failures

• Hot-pluggable hard drives

• Redundant, hot-swappable power supplies (four)

• Redundant fan units (not hot-pluggable)

• Environmental monitoring

• Internal hardware drive mirroring (RAID 1)

• Error detection and correction for improved data integrity

• Easy access for most component replacements

Fault Management and Predictive Self Healing

The Sun Netra T5440 server provides the latest fault management technologies. The Solaris 10 OS architecture provides a means for building and deploying systems and services capable of Predictive Self-healing. Self-healing technology enables systems to accurately predict component failures and mitigate many serious problems before they actually occur. This technology is incorporated into both the hardware and software of the Sun Netra T5440 server.

At the heart of the predictive self-healing capabilities is the Solaris Fault Manager, a new service that receives data relating to hardware and software errors, and automatically and silently diagnoses the underlying problem. Once a problem is diagnosed, a set of agents automatically responds by logging the event, and if necessary, takes the faulty component offline. By automatically diagnosing problems, business-critical applications and essential system services can continue uninterrupted in the event of software failures, or major hardware component failures.

Rackmountable Enclosure

The Sun Netra T5440 server uses a space-saving, 4U-high, rackmountable enclosure that can be installed into a variety of industry standard racks.