NVIDIA has announced that Dell Technologies, Hewlett Packard Enterprise (HPE), and Lenovo will be the first to integrate NVIDIA Spectrum-X™ Ethernet networking technologies for artificial intelligence (AI) into their server lineups to help enterprise customers speed up generative AI workloads.
Purpose-built for generative AI, Spectrum-X offers enterprises a new class of Ethernet networking that can achieve 1.6x higher networking performance for AI communication versus traditional Ethernet offerings.
The Top Three Are Leveraging NVIDIA
The new systems coming from three of the top system makers bring together Spectrum-X with NVIDIA Tensor Core GPUs, NVIDIA AI Enterprise software and NVIDIA AI Workbench software to provide enterprises the building blocks to transform their businesses with generative AI.
“Generative AI and accelerated computing are driving a generational transition as enterprises upgrade their data centers to serve these workloads,” said Jensen Huang, Founder of and CEO at NVIDIA. “Accelerated networking is the catalyst for a new wave of systems from NVIDIA’s leading server manufacturer partners to speed the shift to the era of generative AI.”
“Accelerated computing and networking are key to building systems to meet the demands of large language models and generative AI applications,” said Michael Dell, Chairman and CEO at Dell Technologies. “Through our collaboration, Dell Technologies and NVIDIA are providing customers with the infrastructure and software needed to quickly and securely extract intelligence from their data.”
“Generative AI will undoubtedly drive innovation across multiple industries,” said Antonio Neri, president and CEO of HPE. “These powerful new applications will require a fundamentally different architecture to support a variety of dynamic workloads. To enable customers to realize the full potential of generative AI, HPE is partnering with NVIDIA to build systems with the required power, efficiency and scalability to support these applications.”
“Generative AI can power unprecedented transformation but places unprecedented demands on enterprise infrastructure,” said Yuanqing Yang, Chairman and CEO at Lenovo. “Working closely with NVIDIA, Lenovo is building efficient, accelerated systems with the networking, computing and software needed to power modern AI applications.”
Networking Purpose-Built to Accelerate AI
For peak AI workload efficiency, Spectrum-X combines the extreme performance of the Spectrum-4 Ethernet switch; the NVIDIA BlueField®-3 SuperNIC, a new class of network accelerators for supercharging hyperscale AI workloads; and the acceleration software. Spectrum-X complements BlueField-3 DPUs, the world’s most advanced infrastructure computing platform.
Spectrum-4 is the world’s first 51Tb/sec Ethernet switch for AI, providing highly effective data throughput at scale and under load while minimizing network congestion for multi-tenant, AI cloud workloads. Its intelligent, fine-tuned routing technology enables maximum utilization of network infrastructure at all times.
BlueField-3 SuperNICs are designed for network-intensive, massively parallel computing, offering up to 400Gb/s RDMA over Converged Ethernet (RoCE) network connectivity between GPU servers and boosting performance for AI training and inference traffic on the east-west network inside the cluster. They also enable secure, multi-tenant data center environments, ensuring deterministic and isolated performance between tenant jobs. Boasting a power-efficient, half-height, half-length PCIe form factor, BlueField-3 SuperNICs are ideal for enterprise-class servers.
Acceleration software powering Spectrum-X features NVIDIA software development kits such as Cumulus Linux, Pure SONiC and NetQ—which together drive the platform’s breakthrough performance—and the NVIDIA DOCA™ software framework, which is at the heart of BlueField.
NVIDIA AI Enterprise provides frameworks, pretrained models and development tools for secure, stable and supported production AI. NVIDIA AI Workbench allows developers to quickly create, test and customize pretrained generative AI models on a PC or workstation —then scale them to virtually any data center or cloud.
NVIDIA Israel-1 Supercomputer Powered by Spectrum-X
Spectrum-X also enables the NVIDIA Israel-1 supercomputer, a reference architecture for next-generation AI systems. Israel-1 is a collaboration with Dell Technologies, using Dell PowerEdge XE9680 servers powered by the NVIDIA HGX™ H100 eight-GPU platform and BlueField-3 DPUs and SuperNICs with Spectrum-4 switches.
Availability
New systems from Dell, HPE and Lenovo featuring the complete NVIDIA AI stack are expected in the first quarter of next year.
Archive
- October 2024(44)
- September 2024(94)
- August 2024(100)
- July 2024(99)
- June 2024(126)
- May 2024(155)
- April 2024(123)
- March 2024(112)
- February 2024(109)
- January 2024(95)
- December 2023(56)
- November 2023(86)
- October 2023(97)
- September 2023(89)
- August 2023(101)
- July 2023(104)
- June 2023(113)
- May 2023(103)
- April 2023(93)
- March 2023(129)
- February 2023(77)
- January 2023(91)
- December 2022(90)
- November 2022(125)
- October 2022(117)
- September 2022(137)
- August 2022(119)
- July 2022(99)
- June 2022(128)
- May 2022(112)
- April 2022(108)
- March 2022(121)
- February 2022(93)
- January 2022(110)
- December 2021(92)
- November 2021(107)
- October 2021(101)
- September 2021(81)
- August 2021(74)
- July 2021(78)
- June 2021(92)
- May 2021(67)
- April 2021(79)
- March 2021(79)
- February 2021(58)
- January 2021(55)
- December 2020(56)
- November 2020(59)
- October 2020(78)
- September 2020(72)
- August 2020(64)
- July 2020(71)
- June 2020(74)
- May 2020(50)
- April 2020(71)
- March 2020(71)
- February 2020(58)
- January 2020(62)
- December 2019(57)
- November 2019(64)
- October 2019(25)
- September 2019(24)
- August 2019(14)
- July 2019(23)
- June 2019(54)
- May 2019(82)
- April 2019(76)
- March 2019(71)
- February 2019(67)
- January 2019(75)
- December 2018(44)
- November 2018(47)
- October 2018(74)
- September 2018(54)
- August 2018(61)
- July 2018(72)
- June 2018(62)
- May 2018(62)
- April 2018(73)
- March 2018(76)
- February 2018(8)
- January 2018(7)
- December 2017(6)
- November 2017(8)
- October 2017(3)
- September 2017(4)
- August 2017(4)
- July 2017(2)
- June 2017(5)
- May 2017(6)
- April 2017(11)
- March 2017(8)
- February 2017(16)
- January 2017(10)
- December 2016(12)
- November 2016(20)
- October 2016(7)
- September 2016(102)
- August 2016(168)
- July 2016(141)
- June 2016(149)
- May 2016(117)
- April 2016(59)
- March 2016(85)
- February 2016(153)
- December 2015(150)