Sutskever also drew parallels between AI scaling and evolutionary biology, suggesting that AI might find new scaling approaches similar to how hominid brains evolved differently from other mammals. During a Q&A session, he was asked about creating incentive mechanisms for AI development that align with human freedoms. While he hesitated to provide a definitive answer, he acknowledged the unpredictability of AI's future and encouraged speculation on the topic.
Key takeaways:
- Ilya Sutskever, OpenAI's cofounder, predicts the end of pre-training as we know it due to the finite amount of human-generated content available online.
- Sutskever suggests that future AI models will be more "agentic" and capable of reasoning, making them less predictable and more autonomous.
- He compares the scaling of AI systems to evolutionary biology, suggesting that AI might discover new approaches to scaling beyond current methods.
- Sutskever expresses uncertainty about creating incentive mechanisms for AI development that align with human freedoms, noting the unpredictability of future AI developments.