Yahoo Finance

Multi-modal models with smart guardrailing at the edge enable more seamless and safer in-car interactions, unlocking powerful capabilities that go far beyond pure infotainment

SHANGHAI and BURLINGTON, Mass., April 23, 2025 (GLOBE NEWSWIRE) -- Just ahead of Auto Shanghai 2025, Cerence Inc. (NASDAQ: CRNC) (“Cerence AI”), a global leader pioneering conversational AI-powered user experiences, today announced a new partnership with MediaTek and expanded collaboration with NVIDIA to deliver the next generation of CaLLM™ Edge, its embedded small language model (SLM) purpose-built for automotive user experiences. With new multi-modal capabilities powered by NVIDIA AI Enterprise software, CaLLM Edge will now make in-car interactions smarter, more perceptive, more human, far safer and more secure than ever. This multi-modal edge SLM is seamlessly integrated into Cerence xUI™, the company’s hybrid cloud/embedded agentic AI platform, and will be showcased for the first time at Auto Shanghai 2025.

Today’s announcement stems from an ongoing collaboration between MediaTek and NVIDIA, with MediaTek’s automotive-grade Dimensity Auto Cockpit chipsets integrating NVIDIA’s GPU, AI, and graphics technologies. Now, the companies have teamed with Cerence AI on a multi-modal edge solution that delivers top performance and cost efficiency for automakers and unlocks powerful new features for drivers and passengers. Leveraging MediaTek’s automotive cockpit solution and optimized first on NVIDIA DRIVE AGX, CaLLM Edge’s advanced multi-modal capabilities are fine-tuned for in-vehicle deployment and high efficiency via a dual processing platform, delivering a new level of contextual awareness – both inside and outside the vehicle.

Auto Shanghai marks the first public demonstration of Cerence xUI running on NVIDIA DRIVE AGX, integrated into a production-ready automotive reference design that replicates a real car’s multi-seat environment, enabling seamless, personalized interaction for drivers and passengers alike. Key innovations include:

• Increased intelligence inside the car – Imagine your car knows when you’re talking to it – and when you’re not. You could ask for recommendations for Italian restaurants, then ask your passenger: “What about the second one?” – and the assistant knows to wait to jump back into the conversation. Plus, the assistant can take direction from driver and passengers at the same time – for example, “Open my window,” followed by “Same for me.” Or, imagine your car can keep an eye on your pet while you run a short errand, or, while you’re driving, answer questions about how your toddler is doing in the back seat.

• Additional context from outside the car – Imagine an assistant that provides information about not only what is inside the vehicle, but also in the world outside. For example, it can explain or translate road signs, identify roadside buildings, and even offer details about something interesting spotted on a billboard. Cerence xUI can leverage car sensor data and both interior and exterior camera feeds in combination with the CaLLM Edge multi-modal SLM, enabling streaming input on the edge – all of which will be shown for the first time at Auto Shanghai.

• Smart guardrailing on the edge – Cerence AI has developed automotive guardrails optimized for NVIDIA DRIVE AGX, helping ensure Cerence-powered systems can safely and reliably handle the nuances of brand-specific in-car interaction, even in conditions with limited connectivity. As part of its comprehensive hybrid architecture, Cerence AI will be delivering this embedded guardrail with NVIDIA NeMo Guardrails, both to complement its cloud variant as well as help minimize distractions, prevent misuse, and ensure voice interactions stay context-aware and compliant with safety norms.