Apple's usage of AWS's custom chips could signal to other companies that non-Nvidia training approaches can work. AWS CEO Matt Garman said that Apple had been an early adopter and beta-tester for the company's Trainium chips. In addition to AWS, Apple has also used Google Cloud's TPU chips to train its iPhone AI service, Apple Intelligence. The company plans to integrate with OpenAI's ChatGPT later this month and enhance Siri's abilities next year.
Key takeaways:
- Apple is currently using Amazon Web Services' custom artificial intelligence chips for services like search and is considering using Amazon's latest AI chip, Trainium2, to pretrain its models.
- Apple has been using AWS for more than a decade for services including Siri, Apple Maps and Apple Music, and has seen a 40% efficiency gain from using Amazon's Inferentia and Graviton chips.
- Apple's use of custom chips could signal to other companies that non-Nvidia training approaches can work, potentially leading to more efficient processing and lower costs.
- Apple Intelligence, a series of services that can summarize notifications, rewrite emails and generate new emojis, does most of its processing on an iPhone, iPad or Mac chip, and sends complicated queries to Apple-operated servers using its own M-series chips.