YouTube’s new auto-dubbing feature is now available for knowledge-focused content | TechCrunch
Dec 10, 2024 - techcrunch.com
YouTube has expanded its AI-powered auto-dubbing feature to hundreds of thousands more channels, enhancing accessibility by generating translated audio tracks for videos. Initially introduced at Vidcon last year, the tool was tested with a limited group of creators and is now available for channels focused on informational content, such as cooking or sewing tutorials. The feature supports multiple languages, including English, French, German, Hindi, Indonesian, Italian, Japanese, Portuguese, and Spanish, and will soon be available for other content types.
The auto-dubbing tool utilizes Google’s Gemini capabilities to mimic human speech, though YouTube acknowledges potential inaccuracies as the technology is still developing. The company is committed to improving the feature and values user feedback. Additionally, YouTube is preparing to release an update called “Expressive Speech,” which aims to better replicate the creator's tone, emotions, and environmental ambiance.
Key takeaways:
YouTube's auto-dubbing feature is expanding to hundreds of thousands more channels, initially focusing on informational content.
The tool supports multiple languages, including English, French, German, Hindi, Indonesian, Italian, Japanese, Portuguese, and Spanish.
Auto-dubbing utilizes Google's Gemini capabilities but may not always perform perfectly as it is still in early development stages.
YouTube plans to introduce an "Expressive Speech" update to better replicate the creator's tone and emotions.
