Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Nvidia releases its own brand of world models | TechCrunch

Jan 09, 2025 - techcrunch.com
Nvidia has announced the release of Cosmos World Foundation Models (Cosmos WFMs), a family of AI models inspired by human mental models of the world, at CES 2025. These models, which can predict and generate "physics-aware" videos, are available through Nvidia's API, NGC catalogs, GitHub, and Hugging Face. The Cosmos WFM family is divided into three categories: Nano for low latency applications, Super for high-performance baseline models, and Ultra for maximum quality outputs, with sizes ranging from 4 billion to 14 billion parameters. Nvidia is also releasing additional models for specific applications like augmented reality and autonomous vehicle development. The models were trained on 9,000 trillion tokens from diverse data sources, though Nvidia has faced allegations of using copyrighted YouTube videos without permission.

Despite Nvidia's claims of fair use, copyright experts question the legality of using such data for AI training. The Cosmos WFMs are not fully open source, as Nvidia has not disclosed all details about the training data or provided the tools to recreate the models. However, companies like Waabi, Wayve, Foretellix, and Uber are already piloting Cosmos WFMs for various applications, including AI models for self-driving vehicles. Nvidia CEO Jensen Huang expressed hopes that Cosmos will significantly impact robotics and industrial AI, similar to the influence of Llama in enterprise AI.

Key takeaways:

  • Nvidia announced the release of Cosmos World Foundation Models (WFMs) at CES 2025, designed for physics-based simulation and synthetic data generation.
  • Cosmos WFMs are available in three categories: Nano, Super, and Ultra, with model sizes ranging from 4 billion to 14 billion parameters.
  • The models are trained on 9,000 trillion tokens from diverse data sources, but Nvidia has not disclosed specific details about the training data's provenance.
  • Companies like Uber and Wayve are piloting Cosmos WFMs for applications in autonomous driving and robotics, although the models are not fully open source.
View Full Article

Comments (0)

Be the first to comment!