Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Open Compute Project

Oct 18, 2023 - opencompute.org
AMD, Arm, Intel, Meta, Microsoft, NVIDIA, and Qualcomm have formed the Microscaling Formats (MX) Alliance to standardize next-generation 6- and 4-bit data types for AI training and inferencing. The alliance aims to enhance the efficiency of AI calculations, accelerate model training and inference times, and reduce data movement over the interconnect. The initial MX specification introduces four data formats (MXFP8, MXFP6, MXFP4, and MXINT8) that are compatible with current AI stacks and enable fine-grain microscaling at the hardware level.

The MX Alliance has released the Microscaling Formats (MX) Specification v1.0 in an open, license-free format through the Open Compute Project Foundation (OCP) to encourage broad industry adoption. The release includes a white paper and emulation libraries to provide details on the data science approach and select results of MX in action. The initiative aims to foster innovation, collaboration, and widespread adoption in the AI landscape, and mitigate fragmentation and technology constraints that could otherwise stifle progress.

Key takeaways:

  • AMD, Arm, Intel, Meta, Microsoft, NVIDIA, and Qualcomm have formed the Microscaling Formats (MX) Alliance to standardize next-generation 6- and 4-bit data types for AI training and inferencing, which can enhance AI calculations efficiency and accelerate model training and inference times.
  • The MX Alliance has released the Microscaling Formats (MX) Specification v1.0 in an open, license-free format through the Open Compute Project Foundation (OCP) to encourage broad industry adoption and provide the foundation for potential future narrow-format innovations.
  • Open standards are critical in the evolving landscape of AI to foster innovation, collaboration, and widespread adoption, enabling consistent toolchains, model development, and interoperability across the AI ecosystem.
  • The Open Compute Project (OCP) is a collaborative Community of hyperscale data center operators, telecom, colocation providers and enterprise IT users, working with the product and solution vendor ecosystem to develop open innovations deployable from the cloud to the edge.
View Full Article

Comments (0)

Be the first to comment!