The Conversation (0)
COMPUTEX -- NVIDIA today announced the general availability of NVIDIA ACE generative AI microservices to accelerate the next wave of digital humans, as well as new generative AI breakthroughs coming soon to the platform.
Companies in customer service, gaming and healthcare are the first to adopt ACE technologies to simplify creating, animating and operating lifelike digital humans across customer service, telehealth, gaming and entertainment.
The suite of NVIDIA ACE digital human generative AI technologies now generally available includes:
- NVIDIA Riva ASR, TTS and NMT — for automatic speech recognition, text-to-speech conversion and translation
- NVIDIA Nemotron LLM — for language understanding and contextual response generation
- NVIDIA Audio2Face — for realistic facial animation based on audio tracks
- NVIDIA Omniverse RTX — for real-time, path-traced realistic skin and hair
Newly announced technologies include:
- NVIDIA Audio2Gesture — for generating body gestures based on audio tracks, available soon
- NVIDIA Nemotron-3 4.5B — a new small language model (SLM) purpose-built for low-latency, on-device RTX AI PC inference
"Digital humans will revolutionize industries," said Jensen Huang, founder and CEO of NVIDIA. "Breakthroughs in multi-modal large language models and neural graphics — delivered by NVIDIA ACE to our ecosystem of developers — are bringing us closer to a future of intent-driven computing, where interacting with computers is as natural as interacting with humans."
Digital Humans Come to 100 Million RTX AI PCs
To date, NVIDIA has provided ACE as NIM microservices for developers to operate in data centers. Now NVIDIA is building ACE PC NIM microservices for deployment across the installed base of 100 million RTX AI PCs and laptops.
These include NVIDIA Nemotron-3 4.5B, the company's first SLM, which has been purpose-built to run on device with similar levels of precision and accuracy as large language models (LLMs) running in the cloud. Nemotron-3 4.5B SLM is now in early access. NVIDIA Audio2Face and NVIDIA Riva ASR on-device models will be available soon in early access .
The new NVIDIA AI Inference Manager software development kit simplifies the deployment of ACE to PCs. It preconfigures the PC with the necessary AI models, engines and dependencies while orchestrating AI inference seamlessly across PCs and the cloud.
An updated version of the Covert Protocol tech demo , developed in collaboration with Inworld AI , is being shown at the COMPUTEX trade show. Using Audio2Face and Riva ASR running locally on GeForce RTX PCs , the demo allows players to interact and influence digital-human non-playable characters (NPCs) with conversational language to complete their mission.
Digital Human Ecosystem Expands With Latest ACE Technologies
ACE is making waves with developers building a variety of applications from companies such as Aww Inc., Dell Technologies, Gumption , Hippocratic AI, Inventec, OurPalm , Perfect World Games, Reallusion, ServiceNow, Soulbotix, SoulShell and UneeQ.
Aww Inc., a pioneering virtual human company based in Japan, launched its first virtual celebrity, Imma, in 2018. Imma has since become the face of major global brands in more than 50 countries. Now, Aww Inc. plans to leverage ACE Audio2Face microservices for real-time animation, enabling a highly interactive communication experience with its users.
Perfect World Games, a game developer and publisher, is adopting ACE in its new mythological wilderness tech demo, Legends. Players can interact with a fully interactive, realistic, multilingual, AI NPC in both English and Mandarin. Using NVIDIA Audio2Face NIM, the character's audio responses generate realistic facial animation in real time.
Inventec, a major technology company that is investing heavily in AI, is using NVIDIA Audio2Face NIM to enhance its healthcare AI agent within the VRSTATE platform. The integration provides a more engaging, comforting virtual consultation experience. At COMPUTEX, Inventec is showcasing an AI agent that can help patients access information about their health.
ServiceNow, the AI platform for business transformation, recently showcased ACE NIM in a generative AI service agent demo for its Now Assist Gen AI Experience, highlighting the potential for digital avatars to enhance customer and employee interactions across industries including retail, travel and more.
Dell Technologies unveiled its cutting-edge Dell Generative AI Solution for Digital Assistants at Dell Technologies World last month. The offering allows businesses to leverage intelligent digital assistants that engage customers through natural conversations across various industries such as retail, healthcare and customer service.
NVIDIA Celebrates Digital Human Startups at COMPUTEX 2024
NVIDIA art teams used generative AI tools built on ACE, including Synthesia and Hour One , to produce a "digital Jensen" avatar that was generated by video from text.
The multilingual avatar featured Huang's unique voice and style, generated by ElevenLabs' proprietary AI speech and voice technology in Mandarin Chinese and English. NVIDIA also collaborated with Voicemod, an NVIDIA Inception member specializing in AI voice technology, to compose the ending theme song of Huang's keynote.
ACE NIM Now Available
NVIDIA ACE NIM microservices for server deployments including Riva and Audio2Face are now in production, adding NVIDIA AI Enterprise software for developers to receive enterprise-class support. Register for early access to ACE NIM microservices that run on RTX AI PCs.
Watch Huang's COMPUTEX keynote to see the latest in ACE content.
About NVIDIA
NVIDIA (NASDAQ: NVDA) is the world leader in accelerated computing.
For further information, contact:
Benjamin Berraondo
NVIDIA Corporation
bberraondo@nvidia.com
Certain statements in this press release including, but not limited to, statements as to: the benefits, impact, performance, features, and availability of NVIDIA's products and technologies, including NVIDIA ACE generative AI microservices, NVIDIA Riva ASR, TTS and NMT, NVIDIA Nemotron LLM and SLM, NVIDIA Audio2Face, NVIDIA Audio2Gesture, NVIDIA Omniverse RTX, NVIDIA Nemotron-3 4.5B, NVIDIA AI Inference Manager, and NVIDIA AI Enterprise software; the benefits and impact of NVIDIA's collaborations with third parties, and the features and availability of their services and offerings; third parties' use or adoption of NVIDIA products, technologies and platforms, and the benefits and impacts thereof; digital humans revolutionizing industries; and breakthroughs in multi-modal large language models and neural graphics — delivered by NVIDIA ACE to our ecosystem of developers — bringing us closer to a future of intent-driven computing, where interacting with computers is as natural as interacting with humans are forward-looking statements that are subject to risks and uncertainties that could cause results to be materially different than expectations. Important factors that could cause actual results to differ materially include: global economic conditions; our reliance on third parties to manufacture, assemble, package and test our products; the impact of technological development and competition; development of new products and technologies or enhancements to our existing product and technologies; market acceptance of our products or our partners' products; design, manufacturing or software defects; changes in consumer preferences or demands; changes in industry standards and interfaces; unexpected loss of performance of our products or technologies when integrated into systems; as well as other factors detailed from time to time in the most recent reports NVIDIA files with the Securities and Exchange Commission, or SEC, including, but not limited to, its annual report on Form 10-K and quarterly reports on Form 10-Q. Copies of reports filed with the SEC are posted on the company's website and are available from NVIDIA without charge. These forward-looking statements are not guarantees of future performance and speak only as of the date hereof, and, except as required by law, NVIDIA disclaims any obligation to update these forward-looking statements to reflect future events or circumstances.
© 2024 NVIDIA Corporation. All rights reserved. NVIDIA, the NVIDIA logo, Audio2Face, NVIDIA NeMo, NVIDIA Omniverse, and NVIDIA RTX are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and other countries. Other company and product names may be trademarks of the respective companies with which they are associated. Features, pricing, availability and specifications are subject to change without notice.
A photo accompanying this announcement is available at:
https://www.globenewswire.com/NewsRoom/AttachmentNg/a29d20a9-e6a6-4f87-ad3c-84ef7432665d
