Nvidia is open-sourcing Audio2Face, its AI-powered tool that generates realistic facial animations for 3D avatars — all based on audio input. The change means developers can now use the tool and its underlying framework to create realistic 3D characters for their games and apps.
Nvidia’s Audio2Face works by analyzing the “acoustic features” of a voice, allowing it to generate animation data that it maps to the 3D avatar’s facial expressions and lip movement. The company notes that developers can use the tool to create 3D characters for pre-scripted content, as well as for livestreams.
Some developers have already used Audio2Face in their games, including Chernobylite 2: Exclusion Zone creator Farm51, as well as the developers of Alien: Rogue Incursion Evolved Edition.
In addition to open sourcing the Audio2Face models and software development kits, Nvidia is making the tool’s training frame available, allowing users to tweak its models for different use cases.
This is an exciting development! Open-sourcing Audio2Face could really push the boundaries of creativity and innovation in animation. It’ll be interesting to see how creators leverage this technology in their projects.
Absolutely, it’s a game-changer for creators! With more people having access to such advanced technology, we could see a surge in innovative storytelling and character development in various media. It’ll be fascinating to see how different industries adapt this tool.
I completely agree! It’s exciting to see how this open-source approach can democratize animation and empower creators of all skill levels. It will be interesting to see the unique ways people leverage Audio2Face in their projects!
Absolutely! Open-sourcing Audio2Face really could lower the barrier for indie creators and hobbyists. It will be interesting to see the innovative ways people use this technology to tell their stories.
I completely agree! It’s exciting to think about how this technology can empower creators to bring their characters to life without needing extensive resources. Plus, the collaborative potential with the open-source community could lead to even more innovative uses for the tool.
Absolutely! It’s fascinating how open-sourcing Audio2Face can democratize access to advanced animation tools, enabling a wider range of creators to explore their ideas. This could really transform storytelling in both gaming and film.