The NVIDIA Hopper architecture delivers a significant performance leap over its predecessor and continues to raise the bar through ongoing software enhancements. The H200 will be available in NVIDIA HGX H200 server boards with four- and eight-way configurations, compatible with both the hardware and software of HGX H100 systems. It will also be available in the NVIDIA GH200 Grace Hopper™ Superchip with HBM3e. Major cloud service providers, including Amazon Web Services, Google Cloud, Microsoft Azure, and Oracle Cloud Infrastructure, are expected to deploy H200-based instances starting next year.
Key takeaways:
- NVIDIA has announced the introduction of the NVIDIA HGX™ H200, a supercharged AI computing platform based on NVIDIA Hopper™ architecture.
- The NVIDIA H200 is the first GPU to offer HBM3e, delivering 141GB of memory at 4.8 terabytes per second, nearly double the capacity and 2.4x more bandwidth compared with its predecessor, the NVIDIA A100.
- H200-powered systems from the world’s leading server manufacturers and cloud service providers are expected to begin shipping in the second quarter of 2024.
- Amazon Web Services, Google Cloud, Microsoft Azure and Oracle Cloud Infrastructure will be among the first cloud service providers to deploy H200-based instances starting next year.