Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Nvidia unveils next-gen Blackwell GPUs with 25X lower costs and energy consumption

Mar 18, 2024 - venturebeat.com
Nvidia has unveiled its next-generation Blackwell graphics processing units (GPUs), promising up to 30 times performance increase for LLM inference workloads and 25 times better energy consumption. The Nvidia GB200 Grace Blackwell Superchip, part of the Grace Blackwell system, is expected to enable organizations to build and run real-time generative AI on large language models at significantly lower costs and energy consumption than its predecessor, Hopper. The Blackwell platform is set to introduce six pioneering technologies across various sectors, including data processing, engineering simulation, electronic design automation, computer-aided drug design, quantum computing, and generative AI.

The Blackwell platform, named after mathematician David Harold Blackwell, is expected to revolutionize computing across industries. The Nvidia GB200 Grace Blackwell Superchip connects two Nvidia B200 Tensor Core GPUs to the Nvidia Grace CPU over a 900GB/s ultra-low-power chip-to-chip link. The GB200 Superchip is a key component of the Nvidia GB200 NVL72, a multi-node, liquid-cooled, rack-scale system for the most compute-intensive workloads. The platform is expected to be adopted by major cloud providers, server manufacturers, and leading AI companies, including Amazon, Google, Meta, Microsoft, and OpenAI.

Key takeaways:

  • Nvidia has unveiled its next-generation Blackwell graphics processing units (GPUs), which promise up to 30 times performance increase for LLM inference workloads and 25 times better energy consumption.
  • The Blackwell platform introduces six pioneering technologies aimed at unlocking breakthroughs in data processing, engineering simulation, electronic design automation, computer-aided drug design, quantum computing, and generative AI.
  • Blackwell will be the world’s most powerful chip, featuring 208 billion transistors and a second-generation transformer engine.
  • The Nvidia GB200 Grace Blackwell Superchip forms the cornerstone of the NVIDIA GB200 NVL72, a rack-scale system boasting 1.4 exaflops of AI performance and 30TB of fast memory, with widespread adoption anticipated across major cloud providers, server manufacturers, and leading AI companies.
View Full Article

Comments (0)

Be the first to comment!