Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Copilot Vision, Microsoft's AI tool that can read your screen, launches in preview | TechCrunch

Dec 05, 2024 - techcrunch.com
Microsoft has begun a limited U.S. preview of Copilot Vision, an AI tool that can understand and respond to questions about websites visited using Microsoft Edge. The tool, part of the opt-in Copilot Labs program, can analyze text and images on web pages to answer queries, summarize and translate text, and perform tasks like highlighting discounted products. It can also act as a game assistant. The service requires a subscription to Microsoft’s Copilot Pro plan, which costs $20 per month.

Microsoft has emphasized that Copilot Vision deletes data after each session and does not store or use processed audio, images, or text to train models. The tool is currently limited to a pre-approved list of "popular" sites and is blocked from paywalled and "sensitive" content. Microsoft has faced legal disputes over AI tools, including a suit from The New York Times alleging that Microsoft allowed users to bypass its paywall via the Copilot chatbot on Bing. The company has stated that Copilot Vision will respect sites' "machine-readable controls on AI".

Key takeaways:

  • Microsoft has launched a U.S.-only preview of Copilot Vision, an AI tool that can understand and respond to questions about websites browsed using Microsoft Edge.
  • Copilot Vision can analyze text and images on web pages to answer queries, summarize and translate text, and perform tasks like highlighting discounted products or assisting in games.
  • Microsoft emphasizes that Copilot Vision deletes data after every session and does not store or use processed audio, images, or text to train models in this preview release.
  • The tool is currently limited to a pre-approved list of 'popular' sites and does not work on paywalled or 'sensitive' content, with Microsoft taking a cautious approach due to legal disputes with news outlets.
View Full Article

Comments (0)

Be the first to comment!