Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

The Download: the mystery of LLMs, and the EU’s Big Tech crackdown

Mar 04, 2024 - technologyreview.com
The article discusses the mystery surrounding the functioning of large language models, particularly their ability to learn tasks in unexpected ways. Researchers at OpenAI, Yuri Burda and Harri Edwards, discovered that these models could learn to perform basic arithmetic, but only after being shown examples repeatedly over an extended period. This phenomenon, termed 'grokking', is one of several that have left researchers puzzled, as these models often behave in ways that contradict textbook math. Despite the success of deep learning, the fundamental technology behind AI, there is still no clear understanding of how or why it works.

The article also highlights various stories about technology, including the EU's plans to end self-regulation for Big Tech, the escalating US-China trade secret war, Apple's failed driverless car project, and the potential threat of data-stealing worms from generative AI. It also mentions the debate around AI consciousness, the misuse of lab testing monkeys, and the suggestion to treat COVID-19 like the flu. The piece concludes with a quote from Roberto Cingolani, CEO of Italian defense company Leonardo, expressing his concern about the lack of human control over ongoing wars.

Key takeaways:

  • Large language models can perform impressive tasks, but researchers are still unsure exactly why they work as they do.
  • Researchers at OpenAI discovered that large language models could learn to perform basic arithmetic, but it took much longer than expected, a phenomenon they called "grokking".
  • Despite the success of deep learning, the fundamental technology behind today's AI boom, there is still a lack of understanding about how and why it works.
  • There are several recommended articles related to the mysteries of AI, its history, the concept of machine consciousness, and the potential for AI to become conscious.
View Full Article

Comments (0)

Be the first to comment!