Omniverse Audio2Face

Audio2Face Overview

Audio2Face by NVIDIA Omniverse is a generative AI application that simplifies the process of animating 3D characters' facial characteristics to match any voice-over track. This tool is versatile and can be used for games, films, real-time digital assistants, or just for fun. It uses a pre-trained Deep Neural Network to drive the 3D vertices of your character mesh, creating facial animations in real-time. The application also allows for post-processing edits to fine-tune the performance of your character. Audio2Face is also capable of processing any language and is continuously updated to support more languages.

Audio2Face Highlights

• Audio2Face is preloaded with a 3D character model, "Digital Mark", which can be animated with your audio track, making it easy to get started.
• The application allows for real-time facial animation authoring, with the option to run the results live or bake them out.
• Audio2Face enables character transfer, allowing you to retarget to any 3D human or human-esque face, making character swapping quick and easy.