The ND MI300X v5 is a result of a long-term partnership between Microsoft and AMD, with the aim of optimizing the training and inferencing of large models. Customers can seamlessly switch to ND MI300X v5 from other ND-series VMs, as AMD’s open software platform, ROCm, contains all the necessary tools for accelerating compute-intensive applications. The new VM will be available for early access and will be part of the Azure portfolio soon.
Key takeaways:
- Microsoft has created a virtual machine (VM) with an unprecedented 1.5 TB of high bandwidth memory (HBM) that leverages the power of AMD’s flagship MI300X GPU, offering more choices for AI optimized VMs.
- The ND MI300X v5 VM is differentiated by the inclusion of 8 x AMD Instinct MI300X GPUs interconnected via Infinity Fabric 3.0 in each VM, offering industry leading HBM capacity and bandwidth.
- The ND MI300X v5 VM is the result of a long-term partnership between Microsoft and AMD, and customers can seamlessly switch to it from other ND-series VMs due to AMD’s open software platform, ROCm.
- Azure is developing the most flexible and extensible AI infrastructure, offering the best capabilities of industry partners and giving customers more options to meet their unique needs.