Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Apple researchers achieve breakthroughs in multimodal AI as company ramps up investments

Mar 17, 2024 - venturebeat.com
Apple researchers have developed new methods for training large language models on both text and images, which could significantly advance artificial intelligence and future Apple products. The research paper, titled “MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training,” demonstrates how combining different types of training data and model architectures can lead to state-of-the-art performance on a range of AI benchmarks. The MM1 models, trained on a diverse dataset spanning visual and linguistic information, excelled at tasks like image captioning, visual question answering, and natural language inference.

Apple is reportedly increasing its investments in artificial intelligence to compete with rivals like Google, Microsoft, and Amazon. The company is on track to spend $1 billion per year on AI development, and is working on a large language model framework called “Ajax” and a chatbot known as “Apple GPT.” The goal is to integrate these technologies into Siri, Messages, Apple Music, and other apps and services. The company is expected to unveil new AI-powered features and developer tools at the Worldwide Developers Conference in June.

Key takeaways:

  • Apple researchers have developed new methods for training large language models on both text and images, which could significantly advance artificial intelligence and future Apple products.
  • The choice of image encoder and the resolution of input images have a major impact on model performance, suggesting that continued scaling and refinement of the visual components of these models will be key to further advancements.
  • Apple is ramping up its investments in artificial intelligence, with plans to spend $1 billion per year on AI development, in an effort to catch up with rivals like Google, Microsoft, and Amazon.
  • Apple's MM1 research shows that the company has the talent and resources to make cutting-edge advances in AI, but it remains to be seen if the notoriously secretive company can move quickly enough to keep pace in the escalating AI arms race.
View Full Article

Comments (0)

Be the first to comment!