Covering Disruptive Technology Powering Business in The Digital Age

Written By: Jason Low, Regional Head of APAC, Iceotope

Liquid cooling will be more important than ever before.

Artificial intelligence (AI) is dominating the digital infrastructure industry and revolutionising how we interact with technology. From personalised recommendations on streaming platforms to autonomous vehicles navigating our roads, AI is seemingly everywhere, yet still in the early stages of its development.

This poses an important question: How are data centre operators managing the impact of AI?

Jason Low, Regional Head of APAC, Iceotope

Much of the initial focus has been on capacity as wholesale space in most major global data centre markets is limited due to a “land grab” by cloud providers to support AI workloads. What is also emerging are constraints on power infrastructure and the ability to meet sustainability objectives caused by AI.

Global headlines across Europe, Asia, and the US are showcasing the tension between power, sustainability, and data centre growth. The International Energy Agency (IEA) predicted that global electricity demand, driven by AI growth, is set to double by 2026.

This surge in power consumption poses significant challenges for data centre operators striving to maintain efficiency, sustainability, and total cost of ownership (TCO). The energy-intensive nature of AI exacerbates carbon emissions and the carbon footprint of data centres, amplifying environmental sustainability concerns.

Cloud Service Providers (CSPs) are particularly concerned about TCO optimisation as they grapple with the implications of AI on their operations. Similarly, telco operators in Europe and Asia prioritise improving TCO and sustainability while relying on data centres to support AI-driven services. Data centres must also allocate a greater proportion of their resources to cooling power-hungry CPUs and GPUs to meet the computational demand of AI workloads.

NVIDIA made headlines with the announcement of its 1200W Blackwell GPU, calling it “a new class of AI superchip.” The solution is designed to build and run real-time generative AI on trillion-parameter large language models. Because of this kind of compute density required for AI, as well as the overall rising thermal design power of IT equipment and the need for sustainable solutions, liquid cooling is rapidly emerging as the solution of choice for solving these challenges.

The Criticality of Liquid Cooling Systems in the Age of AI

Liquid cooling systems offer a more efficient means of dissipating heat compared to air cooling methods. By circulating a coolant fluid directly over the hottest components, heat is rapidly transferred away, maintaining optimal operating temperatures for AI systems. As chips continue to get hotter, data centre operators need to know they are future-proofing their infrastructure investment for 1000W CPUs and GPUs and beyond.

Therefore, choosing technologies that can meet the demands of processor and chip roadmaps and future server generations will be key.

Iceotope Labs recently conducted tests to validate how single-phase liquid cooling technology, like Precision Liquid Cooling, can go beyond the perceived 1000W limit to compete head-to-head with other cooling technologies.

“This surge in power consumption poses significant challenges for data centre operators striving to maintain efficiency, sustainability, and total cost of ownership (TCO). The energy-intensive nature of AI exacerbates carbon emissions and the carbon footprint of data centres, amplifying environmental sustainability concerns.”

Initially, the testing showed that single-phase liquid cooling demonstrated a constant thermal resistance at a given flow rate as the power was increased from 250W to 1000W. More excitingly, a second round of testing found continued consistent thermal resistance up to 1500W—a threshold not yet met within the industry.

It is exciting to see these results as it showcases single-phase liquid cooling technology as an indispensable solution for effectively managing the escalating thermal demands of AI workloads in data centres.

Liquid cooling is a leading solution for efficiently accommodating modern computing requirements. Embracing this technology enhances operational efficiency, lowers energy consumption, and aligns with emerging sustainability standards.

While much of the market has not reached 1500W operation yet, it is poised to do so soon. Liquid cooling efficiently dissipates heat from high computational power and denser hardware configurations, addressing the thermal challenges of AI and optimising performance, energy efficiency, and hardware reliability. It isindispensable for AI workloads and key to unlocking their future.

(0)(0)