Covering Disruptive Technology Powering Business in The Digital Age

image
Dell Technologies Expands Dell AI Factory with New PowerEdge Servers to Accelerate Enterprise AI Adoption
image
October 14, 2024 Press Releases

 

Dell Technologies expands the world’s broadest generative AI (GenAI) solutions portfolio with Dell AI Factory additions tailored for AMD environments. These solutions offer enterprises enhanced AI capabilities, including greater scalability and flexibility, to stay competitive in the evolving technology landscape.

“By integrating AMD technology into the latest Dell servers, AI solutions and services through the Dell AI Factory, we’re providing the performance and efficiencies enterprises need today and in the future,” said Arthur Lewis, president, Infrastructure Solutions Group, Dell Technologies. “Together with AMD, we are setting new standards in AI performance, giving enterprises powerful and cost-effective solutions essential for modern data-driven environments.”

“Our latest AMD EPYC processors and Instinct accelerators, provide Dell customers with advanced end-to-end solutions, at scale, that will speed AI deployments and power business critical IT infrastructure,” said Forrest Norrod, executive vice president and general manager, Data Center Solutions Group, AMD. “Our longstanding collaboration with Dell continues to deliver cutting edge solutions that help enhance operational efficiency and reduce time to value, fostering innovation across highly competitive industries.”

New Dell PowerEdge servers drive demanding AI workloads at scale

The additions to the Dell PowerEdge portfolio drive a wide range of AI use cases and traditional workloads and simplify server management and security. The platforms provide customisable and efficient solutions that simplify management and support high-performance workloads for modern enterprises:

  • Designed for enterprise AI workloads, the Dell PowerEdge XE7745 supports up to eight double-width or 16 single-width PCIe GPUs with AMD 5th Generation EPYC processors in a 4U air-cooled chassis. Purpose-built for AI inferencing, model fine-tuning and high performance computing, the internal GPU slots are paired with eight additional Gen 5.0 PCIe slots for network connectivity, creating dense, flexible configurations with 2x more DW PCIe GPU capacity[1]
  • The PowerEdge R6725 and R7725 servers are optimised for scalability with high performing AMD 5th Generation EPYC processors. The new DC-MHS chassis design enables enhanced air cooling and dual 500W CPUs, conquering tough thermal challenges for power and efficiency.[ii] These platforms maintain rigorous data analytics and AI workloads, with configurations optimised for scalability, and offer record-breaking performance for workloads like virtualisation, databases and AI.[iii] The R7725 offers up to 66% increased performance and up to 33% increased efficiency at the top of the stack.[iv]

All three platforms can support up to 50% more cores, with up to 37% increased performance per core resulting in greater performance, efficiency and improved TCO.[v] These gains consolidate up to seven 5-year-old servers into one server today, resulting in up to 65% lower CPU power consumption.[vi]

  • The PowerEdge R6715 and R7715 servers with AMD 5th Gen EPYC processors offer increased performance, efficiency and up to 37% increased drive capacity resulting in greater storage density.[vii] Available in various configuration options, the single-socket servers support double the memory with support for 24 DIMMs (2DPC), and meet diverse workload requirements and maximise performance in compact 1U and 2U chassis.[viii] The R6715 sees world record performance for AI and virtualisation tasks.[ix]

For customers deploying AI at scale, Dell Technologies will also continue to support all the latest AMD Instinct accelerators in Dell PowerEdge XE servers.

IT teams can remotely monitor, manage and update Dell PowerEdge servers with the updated Integrated Dell Remote Access Controller (iDRAC). With a faster processor, increased memory and dedicated security co-processor, iDRAC simplifies server management and security, allowing IT teams to respond with greater reliability and efficiency.

“The systems provided by Dell Technologies and AMD for OSF Healthcare allow us to deliver better services to our clinicians and patients, reduce our overall cost and help communities in need. When you have patient lives dependent on our platforms, it is critical that our systems remain stable and operational 24/7, 365 days a year,” said Joe Morrow, director, Technology Services, OSF Healthcare. “Because of these systems, we have significantly reduced Epic downtimes, empowering OSF Healthcare to provide superior healthcare services while ensuring security and scalability in our operations.”

Dell AI Factory enhancements simplify and speed GenAI deployments

The Dell AI Factory is designed to support diverse AI requirements with the world’s broadest AI solutions portfolio from desktop to data center to cloud, allowing organisations to right-size their AI investments:

  • Dell Generative AI Solutions with AMD using the Dell PowerEdge XE9680 server with AMD Instinct™ MI300X accelerators to deliver AI inferencing, retrieval augmented generation (RAG) and customisation. The integration simplifies AI deployment, enhances security, allows for scalable and modular architectures and reduces time to value by up to 86%, helping organisations optimise their AI investments.[x]

 

  • The Dell Enterprise Hub on Hugging Face now supports the Dell PowerEdge XE9680 with AMD Instinct MI300X accelerators, providing custom containers and scripts for easy, secure deployment of models such as Llama and Mixtral. These containerised models are uniquely optimised to boost inferencing performance based on the model and server and leverage the Hugging Face Text Generation Inference (TGI) back-end.
  • Dell Professional Services for Generative AI are expanding to support AMD environments. New Dell Implementation Services for GenAI Platform with AMD provide a tailored operational platform, including Kubernetes configuration, deployment of advanced AI frameworks and customer knowledge transfer on best practices to maximise ROI. From strategy development to data preparation, platform and model implementation and solution scaling, Dell professionals help customers achieve business outcomes with AI throughout the lifecycle.
(0)(0)

Archive