SoundHound On-Chip Voice AI Enabled by NVIDIA DRIVE

March 19 2024, 00:35
SoundHound AI is evolving its approach with voice artificial intelligence (Voice AI) and announced a completely new implementation of an in-vehicle voice assistant that uses a large language model (LLM) completely on the edge, running on the NVIDIA DRIVE platform. The solution combines SoundHound Chat AI running completely on-device and delivers Generative AI with no connectivity required for speech-to-meaning voice interactions.
 

According to the voice interface pioneer, SoundHound Chat AI marks a new chapter for voice interfaces and proves that a powerful voice assistant with integrated Generative AI can still deliver optimal results in the absence of cloud connectivity. SoundHound's work with NVIDIA is intended to significantly expand the number of places and situations that generative AI can be deployed.

NVIDIA DRIVE will enable SoundHound Chat AI – a breakthrough in-vehicle voice platform that combines both real-time and generative AI capabilities – to provide responses even when there is no connectivity. Among a range of use cases, the new solution will let drivers access SoundHound Vehicle Intelligence, a product that instantly delivers information directly from the car manual and other relevant data sources using natural speech.

Vehicle Intelligence understands a verbal request and seamlessly provides answers – including settings, safety, troubleshooting, and vehicle maintenance – without the need for a cumbersome physical document. Examples include:

"I see a flashing light that looks like a car battery. What does it mean?"
"What does the ‘auto hold’ button do?"
"How do I use that feature that lets me drive hands-free safely?"

In addition to Vehicle Intelligence, users can ask more general questions that can help drivers plan a trip or a vacation, such as:
"Where are the best locations to take photographs on the Pacific Coast Highway?"
"Which wineries offer riesling in Carmel Valley?"

This new implementation of voice technology opens up new opportunities for automakers looking to offer rapid voice-enabled access to LLM capabilities with the added benefit of greater privacy, flexibility, and lower operating costs.

"Together with NVIDIA, we’re marrying the incredible capabilities of generative AI with all the advantages of edge computing," says Mike Zagorsek, COO of SoundHound AI. "The net result is a fast and private voice experience with seamless results. And with this new level of adaptability, the possibilities are endless."
 

"We’re working with innovative partners like SoundHound to bring generative AI and accelerated compute into the car – enhancing the occupant experience and bringing greater safety behind the wheel," adds Rishi Dhall, Vice President of Automotive at NVIDIA. "SoundHound’s in-vehicle voice interface, powered by NVIDIA DRIVE, can provide drivers with fast, accurate information, even when there’s no connection."

NVIDIA DRIVE was originally announced by NVIDIA at the Consumer Electronics Show (CES) in Las Vegas in January 2015, aimed at providing autonomous car and driver assistance functionality powered by deep learning. The platform has evolved with every iteration of NVIDIA's CPU/GPU devices and now evolved to a Blackwell based GPU, announced on March 18, 2024.

SoundHound AI offers a selection of on-device edge voice solutions that allow automakers to grant their end-users greater levels of privacy by keeping data stored locally. Its latest generation of voice AI solutions are already able to offer incredible conversational experiences to users in numerous languages. For service industries SoundHound AI offers products like Smart Answering, Smart Ordering, and Dynamic Interaction, a real-time, multimodal, AI-driven customer service interface.
www.nvidia.com
www.soundhound.com/voice-ai-solutions/automotive
 
 
Page description
About Joao Martins
Since 2013, Joao Martins leads audioXpress as editor-in-chief of the US-based magazine and website, the leading audio electronics, audio product development and design publication, working also as international editor for Voice Coil, the leading periodical for... Read more

related items