news

nvidia launches ace unreal engine 5 plug-in to create realistic digital humans

2024-10-07

한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina

it house reported on october 7 that nvidia ace (avatar cloud engine) is a set of technologies that can help developers use generative ai to create lifelike virtual digital characters. with the support of ace, ordinary non-player characters (npcs) can be transformed into dynamic interactive characters that can initiate conversations or guide players to find new tasks.

at the 2024 seattle unreal festival, nvidia released a new unreal engine 5 device-side plug-in for nvidia ace, making it easier for developers to build and deploy ai-driven metahuman characters on windows pcs.

according to it house, a plug-in called audio2face-3d can generate accurate lip synchronization and facial expressions in real time based on audio input, making digital people's expressions more natural and vivid.

it is worth mentioning that ace technology not only generates realistic facial animations, but also has powerful contextual understanding capabilities. with retrieval augmented generation (rag) technology, digital humans are able to respond more naturally and logically based on conversation history and context.

this integration with unreal engine 5 allows developers to more easily apply ace technology to game development. nvidia also provides sample projects to provide developers with a clear guide to help them get started quickly.