Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

OpenAI thinks superhuman AI is coming -- and wants to build tools to control it | TechCrunch

Dec 14, 2023 - techcrunch.com
OpenAI's Superalignment team is working on controlling AI systems that are smarter than humans. The team, led by OpenAI co-founder and chief scientist Ilya Sutskever, is developing ways to steer, regulate, and govern superintelligent AI systems. The team is currently building governance and control frameworks that might apply to future powerful AI systems. They are using a weaker AI model to guide a more advanced model in desirable directions.

OpenAI is launching a $10 million grant program to support technical research on superintelligent alignment. A portion of the funding will come from former Google CEO and chairman Eric Schmidt. The Superalignment team assured that both OpenAI’s research and the work of others who receive grants and prizes from OpenAI on superalignment-related work will be shared publicly.

Key takeaways:

  • OpenAI's Superalignment team is working on how to control AI that's smarter than humans, a concept that has sparked debate within the AI research community.
  • The team is led by OpenAI co-founder and chief scientist Ilya Sutskever, who is reportedly still heading the team despite controversy surrounding Sam Altman's return to the company.
  • The Superalignment team is using a weaker AI model to guide a more advanced model in desirable directions, a method they believe could help align superintelligent AI systems and make them safe.
  • OpenAI is launching a $10 million grant program to support technical research on superintelligent alignment, with a portion of the funding coming from former Google CEO and chairman Eric Schmidt.
View Full Article

Comments (0)

Be the first to comment!