Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

D-ID launches an AI video translation tool that includes voice cloning and lip sync | TechCrunch

Aug 22, 2024 - news.bensbites.com
AI video creation platform D-ID has launched a tool that translates videos into other languages using AI technologies, while also cloning the speaker’s voice and altering their lip movements to match the translated words. This technology builds on D-ID's previous work in animating and vocalizing old family photos. The company, which recently raised $25 million in Series B funding, is offering the AI Video Translate tech to its subscribers for free, with 30 languages currently available.

The new technology is expected to help customers save on localization costs when scaling their campaigns globally. It will compete with other solutions for both dubbing and AI video. D-ID's Video Translation technology will be available through D-ID Studio and its API, with a one-month trial being offered. The company specifies that videos should be between 10 seconds and 5 minutes in length, under 2GB in size, and feature only one person in the frame for best results.

Key takeaways:

  • D-ID, an AI video creation platform, has launched a tool that translates videos into other languages, clones the speaker’s voice, and alters their lip movements to match the translated words.
  • The company has raised $25 million in Series B funding in 2022 and is targeting its increasing number of enterprise customers in the U.S. who use its technology to create AI-powered videos.
  • The AI Video Translate tech, currently offered for free to D-ID subscribers, supports automatic translation of videos into 30 languages, including Arabic, Mandarin, Japanese, Hindi, Spanish, and French.
  • D-ID's new Video Translation technology will be available through D-ID Studio and its API, with a one-month trial being offered. The technology works best with videos featuring one person facing the camera, with a duration between 10 seconds and 5 minutes, and a file size under 2GB.
View Full Article

Comments (0)

Be the first to comment!