Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

ChatGPT now understands real-time video, seven months after OpenAI first demoed it | TechCrunch

Dec 12, 2024 - techcrunch.com
OpenAI has released real-time video capabilities for ChatGPT, enhancing its Advanced Voice Mode with vision. This feature allows users subscribed to ChatGPT Plus, Team, and Pro to point their phones at objects and receive near-real-time responses from ChatGPT. It can also interpret what's on a device's screen through screen sharing, offering explanations for settings menus or suggestions for math problems. The rollout begins immediately and will conclude in a week, but ChatGPT Enterprise and Edu subscribers will have to wait until January, and there's no timeline for users in the EU, Switzerland, Iceland, Norway, and Liechtenstein.

In a demo on CNN's 60 Minutes, OpenAI president Greg Brockman showcased the feature's ability to understand drawings, although it made a mistake on a geometry problem, indicating potential for errors. The release of Advanced Voice Mode with vision was delayed multiple times due to premature announcements and readiness issues. Initially launched without visual analysis, OpenAI has since focused on expanding the voice-only experience to more platforms and EU users. Additionally, OpenAI introduced a "Santa Mode," adding Santa's voice as a preset in the Advanced Voice Mode, accessible via a snowflake icon in ChatGPT.

Key takeaways:

```html
  • OpenAI has released real-time video capabilities for ChatGPT, allowing users to interact with objects and screen content using Advanced Voice Mode with vision.
  • The feature is available to ChatGPT Plus, Team, and Pro subscribers, but not yet to ChatGPT Enterprise, Edu subscribers, or users in the EU and certain other countries.
  • Advanced Voice Mode with vision can interpret drawings and settings menus, but it has shown some inaccuracies, such as making mistakes in geometry problems.
  • OpenAI has also introduced a "Santa Mode" in ChatGPT, adding a festive voice option for users.
```
View Full Article

Comments (0)

Be the first to comment!