The technology behind BodyTalk involves audio-based translation, voice mimicry, and video modification to fit the new words and phrasing. The company plans to expand further in media, specifically in areas like sports, education, marketing, healthcare, and medicine. Despite competition from other AI-based translation services like Vimeo and Eleven Labs, Panjaya believes there is a significant market for more natural native-language content. TED, one of Panjaya's clients, reported that talks dubbed using Panjaya's tooling have seen increased views of 115%, with completion rates doubling for translated videos.
Key takeaways:
- Panjaya, a startup specializing in generative AI for translation, has unveiled its product BodyTalk, a hyperrealistic, AI-based dubbing tool for videos that can recreate a person's original voice in a new language.
- The company has raised its first outside funding of $9.5 million and is led by deep learning specialists Hilik Shani and Ariel Shalom, with Guy Piekarz, who previously sold a startup to Apple, as CEO.
- BodyTalk can offer translations in 29 languages and modifies the speaker's physical movements in the video to match the new speech patterns.
- Panjaya's current focus is on B2B clients, including JFrog and TED media organization, with plans to expand in areas like sports, education, marketing, healthcare, and medicine.