Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

AI, Liquid Cooling And The Data Center Of The Future

Sep 11, 2023 - forbes.com
The rapid adoption of artificial intelligence (AI) in enterprises is driving a surge in demand for high-performance computing (HPC) and generative AI chips, leading to increased heat generation in data centers. Traditional air cooling methods are struggling to cope with the heat loads, especially with new chips like NVIDIA's latest GPU, which has a power consumption 160% higher than its predecessor. Liquid cooling technologies, including rear-door heat exchange, direct-to-chip, and emerging immersion cooling technologies, are being explored as solutions.

However, while liquid cooling is more effective and requires less infrastructure than air cooling, it also presents challenges such as upfront investment, complex implementation, potential for leaks, and regulatory considerations. Despite these challenges, liquid cooling can significantly reduce power usage and offer sustainability benefits. As the transition to liquid cooling becomes more critical, enterprises are advised to ensure their data center operators are prepared for this shift and have the necessary capacity and technology in place.

Key takeaways:

  • The rapid rise of generative artificial intelligence (AI) is increasing power demands and overtaxing traditional air cooling methods in data centers.
  • Liquid cooling technologies, including the growing-in-popularity rear-door heat exchange and direct-to-chip technologies, are available to meet this challenge.
  • Although liquid cooling systems require an upfront investment and can pose significant challenges, they can reduce facility power by nearly 20% and total data center power by more than 10%.
  • Data center operators who are investing in these strategies now will be well-positioned to help their customers meet these challenges head-on.
View Full Article

Comments (0)

Be the first to comment!