Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Spotify is going to clone podcasters’ voices — and translate them to other languages

Sep 25, 2023 - theverge.com
Spotify has introduced a new AI-powered voice translation feature that can translate podcasts into other languages using the podcaster's own voice. The feature, which uses OpenAI's voice transcription tool Whisper, is currently being tested with a select group of podcasters to translate their episodes into Spanish, French, and soon, German. The tool goes beyond simple speech-to-text translation, as it can reproduce the translated podcast in a synthesized version of the original podcaster's voice.

OpenAI is also likely involved in the voice replication aspect of this feature. The AI firm has launched a tool that can create human-like audio from text and a few seconds of sample speech. However, due to safety and privacy concerns, the availability of this tool will be intentionally limited. Spotify has not yet provided details on when or how widely it plans to make the translation tool available.

Key takeaways:

  • Spotify has introduced a new AI-powered voice translation feature that can translate podcasts into other languages using the podcaster's own voice.
  • The company has partnered with several podcasters to translate their episodes into Spanish and French, with plans to add German in the coming weeks.
  • The technology behind this feature is OpenAI’s voice transcription tool Whisper, which can transcribe English speech and translate other languages into English.
  • OpenAI is also launching a tool that can create “human-like audio from just text and a few seconds of sample speech,” but its availability will be limited due to safety and privacy concerns.
View Full Article

Comments (0)

Be the first to comment!