news

한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina

① NVIDIA released the first device-side small language model (SLM), which can be used to improve the conversation ability of game characters; ② The first game to showcase the "NVIDIA ACE" digital human technology is "Mecha BREAK" developed by Amazing Seasun Games.

Cailianshe News, August 22 (Edited by Zhao Hao)On Tuesday (August 20), NVIDIA announced in its official technical blog that it released its first device-side small language model (SLM) at the 2024 Cologne International Games Show (Gamescom 2024), which can be used to improve the conversation ability of game characters.

NVIDIA also announced that the first game to showcase the "NVIDIA ACE" digital human technology is "Mecha BREAK" developed by Amazing Seasun Games. The new technology can bring the characters in the game to life to provide a more dynamic and immersive gaming experience.

Source: NVIDIA official website

Earlier this year, NVIDIA released its digital human technology NVIDIA ACE, which provides speech, intelligence, and animation driven by generative AI. Now this technology has its first SLM "Nemotron-4 4B Instruct".

According to the press release, NVIDIA has optimized the model to improve its responsiveness and device-side inference performance, reducing VRAM usage to about 2GB and significantly shortening the time to generate the first token. It can be deployed as an "NVIDIA NIM" inference microservice for game developers to deploy on the cloud and devices.

As the first game to use NVIDIA ACE NIM, the NPC (non-player character) mechanic in "Unlimited" can respond to the player's commands - NVIDIA Audio2Face-3D NIM and Whisper are responsible for facial animation and voice recognition on the device, and Elevenlabs provides character voices through the cloud.

Whisper is an automatic speech recognition model developed and open-sourced by OpenAI. These technologies combined allow players to interact with the Mechanic in Unlimited, who can help players choose mechas based on combat style and team needs, assist players in customizing the appearance of mechas, and provide advice on combat.

"Limit-free Machine" Source: NVIDIA official website

Earlier this month, Xishanju officially proposed to deploy e-sports business in a global perspective at ChinaJoy, and made Jiexianji the first global e-sports product made by Chinese people. After the first public deletion test, Jiexianji received quite good response.