Nvidia has launched a new wave of networking switches – the X800 series – designed for massive-scale AI and the world’s first networking platforms capable of end-to-end 800Gb/s throughput.

The company says the new switches, Nvidia Quantum-X800 InfiniBand and Nvidia Spectrum X800 Ethernet, push the boundaries of networking performance for computing and AI workloads. They feature software that further accelerates AI, cloud, data processing, and HPC applications in every type of data centre including those that incorporate the newly released Nvidia Blackwell architecture-based product lineup.

“Nvidia Networking is central to the scalability of our AI supercomputing infrastructure,” says Gilad Shainer, senior vice-president of Networking at Nvidia. “Nvidia X800 switches are end-to-end networking platforms that enable us to achieve trillion-parameter-scale generative AI essential for new AI infrastructures.”

Initial adopters of Quantum InfiniBand and Spectrum-X Ethernet include Microsoft Azure and Oracle Cloud Infrastructure.

“AI is a powerful tool to turn data into knowledge,” says Nidhi Chappell, vice-president of AI Infrastructure at Microsoft Azure. “Behind this transformation is the evolution of data centres into high-performance AI engines with increased demands for networking infrastructure. With new integrations of Nvidia networking solutions, Microsoft Azure will continue to build the infrastructure that pushes the boundaries of cloud AI.”

The Quantum-X800 platform sets a new standard in delivering the highest performance for AI-dedicated Infrastructure. It includes the Nvidia Quantum Q3400 switch and the Nvidia ConnectX(r)-8 SuperNIC, which together achieve an industry-leading end-to-end throughput of 800Gb/s. This is 5x higher bandwidth capacity and a 9x increase of 14.4Tflops of In-Network Computing with Nvidia’s Scalable Hierarchical Aggregation and Reduction Protocol (SHARPv4) compared to the previous generation.

The Spectrum-X800 platform delivers optimised networking performance for AI cloud and enterprise infrastructure. Utilising the Spectrum SN5600 800Gb/s switch and the Nvidia BlueField(r)-3 SuperNIC, the Spectrum-X800 platform provides advanced feature sets crucial for multi-tenant generative AI clouds and large enterprises.

Spectrum-X800 optimises network performance facilitating faster processing, analysis, and execution of AI workloads and thereby expediting the development, deployment, and time to market of AI solutions. Designed specifically for multi-tenant environments, Spectrum-X800 ensures performance isolation for each tenant’s AI workloads to maintain optimal and consistent performance levels, enhancing customer satisfaction and service quality.

Nvidia provides a comprehensive suite of network acceleration libraries, software development kits, and management software to optimise performance for trillion-parameter AI models.

This includes Nvidia Collective Communications Library (NCCL), which extends GPU parallel computing tasks to the Quantum-X800 network fabric, taking advantage of its powerful In-Network Computing capabilities with SHARPv4 supporting FP8, supercharging performance for large model training and generative AI.

Nvidia’s full-stack software approach provides advanced programmability, making data centre networks more flexible, reliable and responsive, ultimately increasing overall operational efficiency and supporting the needs of modern applications and services.