Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Ai2 releases new language models competitive with Meta's Llama | TechCrunch

Nov 27, 2024 - techcrunch.com
The nonprofit AI research organization Ai2 has released OLMo 2, the second family of models in its Open Language Model series. OLMo 2 meets the Open Source Initiative’s definition of open source AI, with the tools and data used to develop it being publicly available. The OLMo 2 family includes two models, one with 7 billion parameters (OLMo 7B) and one with 13 billion parameters (OLMo 13B), which can perform tasks like answering questions, summarizing documents, and writing code. Ai2 used a data set of 5 trillion tokens to train the models, resulting in models that are competitive with other open models like Meta’s Llama 3.1 release.

The OLMo 2 models and all of their components can be downloaded from Ai2’s website and are under Apache 2.0 license, meaning they can be used commercially. Despite recent debates over the safety of open models, Ai2 engineer Dirk Groeneveld believes the benefits of open models outweigh the potential harms, as they promote technical advancements, enable verification and reproducibility, and reduce concentration of power by creating more equitable access.

Key takeaways:

  • Ai2, the nonprofit AI research organization, has released OLMo 2, the second family of models in its OLMo series, which meets the Open Source Initiative’s definition of open source AI.
  • The OLMo 2 family includes two models: one with 7 billion parameters (OLMo 7B) and one with 13 billion parameters (OLMo 13B), which can perform a range of text-based tasks.
  • To train the models, Ai2 used a data set of 5 trillion tokens, resulting in models that are competitive with other open models like Meta’s Llama 3.1 release.
  • The OLMo 2 models and all of their components can be downloaded from Ai2’s website and are under Apache 2.0 license, meaning they can be used commercially.
View Full Article

Comments (0)

Be the first to comment!