GPU Expansion Rack Configuration

Private Cloud Appliance with GPU expansion provides a scalable platform to build AI and graphics intensive applications in the private cloud environment.

It's built to power the next generation of data center workloads, including:

• Generative AI inference: real time inferencing for multimodel generative AI pipelines (text, image, audio, video)

• LLM training and fine-tuning: accelerated performance for fine-tuning medium LLMs and training small LLMs with NVIDIA's transformer engine and FP8 support

• Graphics-intensive and VDI applications: 3D graphics and rendering workflows with NVIDIA’s RTX and ray tracing capabilities

• Digital twins using NVIDIA Omniverse: develop and operate complex 3D industrial digitization workflows

• Media streaming: increased encode/decode density and AV1 support for 4K video streaming

• HPC: scientific data analysis and simulation workloads with FP32 support

GPU expansions require appliance software version 3.0.2-b1325160 (March 2025) or newer. An X10-2c GPU expansion rack contains 1 to 6 X10-2c GPU L40S Compute Server nodes. To integrate with the base rack physical network infrastructure, two Cisco Nexus 9336C-FX2 leaf switches and a Cisco Nexus 9348GC-FXP management switch are installed. This rack does not include storage hardware.