Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Is GPT-5 in trouble? Report suggests that AI has plateaued | Digital Trends

Nov 12, 2024 - digitaltrends.com
The next-generation Orion model of OpenAI's ChatGPT, rumored to be arriving by the end of the year, may not live up to expectations, according to a report from The Information. The report, citing anonymous OpenAI employees, suggests that the Orion model has shown a smaller improvement over its predecessor, GPT-4, particularly in coding applications, though it is stronger in general language capabilities. The report also highlights a dwindling supply of high-quality text and other data for training new models, leading to a training data bottleneck.

In response to this, OpenAI has created a "foundations team" to explore alternatives such as synthetic training data. The Orion model, originally thought to be the code name for GPT-5, is now expected to arrive in 2025. However, concerns about the power infrastructure's ability to support the model's operation have been raised.

Key takeaways:

  • OpenAI's next-generation Orion model of ChatGPT may not be as advanced as expected, showing only a small improvement over its predecessor, GPT-4.
  • The AI industry is facing a bottleneck due to a dwindling supply of high-quality text and other data for training new models.
  • OpenAI has created a 'foundations team' to find solutions to the lack of appropriate training data, potentially using synthetic training data.
  • Orion, originally thought to be the code name for OpenAI's GPT-5, is expected to arrive in 2025, but there are concerns about whether there will be enough power to support it without overloading electrical grids.
View Full Article

Comments (0)

Be the first to comment!