Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

NVIDIA Speech and Translation AI Models Set Records for Speed and Accuracy | NVIDIA Technical Blog

Apr 18, 2024 - developer.nvidia.com
NVIDIA's AI models for speech and translation are leading the field in performance and innovation. The NVIDIA Parakeet automatic speech recognition (ASR) models and the NVIDIA Canary multilingual, multitask ASR and translation model are currently topping the Hugging Face Open ASR Leaderboard. Additionally, a multilingual P-Flow-based text-to-speech (TTS) model won the LIMMITS ’24 challenge by synthesizing a speaker’s voice into seven languages using a short audio clip.

The Parakeet family of models offers robust English speech transcription with options for different customer applications, accuracy, speed, and other requirements. The Parakeet-TDT model excels in transcribing spoken English while running 64% faster than the second-best Parakeet model. The Canary model transcribes and translates English, German, French, and Spanish speech with state-of-the-art accuracy. The P-Flow model enables the creation of custom voices, offering a fast and data-efficient solution for personalized speech synthesis.

Key takeaways:

  • NVIDIA's Parakeet and Canary models are leading in the field of speech and translation AI, topping the Hugging Face Open ASR Leaderboard.
  • The Parakeet models provide robust English speech transcription with options for different customer applications, accuracy, speed, and other requirements.
  • The Canary model is a multilingual multitasking model that transcribes and translates English, German, French, and Spanish speech.
  • NVIDIA's P-Flow model won the LIMMITS '24 voice challenge by creating a customized high-quality personalized voice for a speaker using a speech prompt as short as three seconds.
View Full Article

Comments (0)

Be the first to comment!