CES 2024: Mercedes Unveils Enhanced Virtual Assistant Technology

Jan 10, 2024 09:42 PM EST

PHOTO OF A WHITE CAR — (Photo : PEXELS/MIKE BIRD)

Mercedes highlighted the latest addition to its future interior experience: the enhanced MBUX Virtual Assistant at CES 2024. This upgrade targets to overcome voice system restrictions. Thus, promising a multifaceted role as both a supportive companion and a hands-free interface for managing multimedia and navigation.

Upgraded: Mercedes Virtual Assistant Technology

With its MBUX Virtual Assistant, Mercedes-Benz is previewing car voice commands. This Mercedes' next-gen virtual assistant is being improved using super-smart AI. This new method aspires for more natural interactions and driver customization, not just commands.

Mercedes-Benz is really stepping up the game for personalized driving by bringing in this smart AI to their in-car assistant. Therefore, smoother car conversations and customized driving experience are more possible.

During a CES 2024 roundtable hosted by Mercedes-Benz AG and attended by SlashGear, Magnus Östberg, Chief Software Officer, expressed the significance of voice as the ultimate mode of communication, highlighting the limitations technology poses in this aspect for cars.

The upcoming "Hey Mercedes" assistant, driven by generative AI and embedded within MB.OS, the next-gen vehicle digital platform, will premiere in the 2025 CLA. SlashGear reported this assistant aims to interconnect various car systems under one digital framework, spanning from electric power units to apps from Mercedes and other providers displayed across multiple in-car screens.

Östberg hints that if Mercedes achieves its vision and drivers trust their cars enough to share their digital preferences, relying solely on screens might become unnecessary to experience the full potential of the vehicle.

MBUX Virtual Assistant: Driver's Experience

The enhanced MBUX Virtual Assistant, operating on the next-gen MB.OS system, aims to establish the most human-like interaction possible with a Mercedes-Benz, according to the company. For instance, it will showcase predictive features, such as playing morning news as soon as the driver enters the vehicle or suggesting dialing into a meeting if the owner's calendar indicates a delay.

As reported in the Verge, Mercedes boasts MBUX as one of the most proficient voice assistants, initially unveiled in 2018 as an abbreviation for "Mercedes-Benz User Experience."

This voice assistant's speech capabilities will hinge on an LLM (Large Language Model) for organic conversations and addressing customer inquiries. It will also embody four distinct "personality traits": natural, predictive, personal, and empathetic.

Moreover, the company says the assistant tries to chat like a friend, answering questions and asking smart ones to understand better. The voice assistant from Mercedes, known as the MBUX Virtual Assistant or the next-gen virtual assistant, offers personalized settings, adapting its tone and speaking style to suit the driver's preferences.

Need a more understanding tone on stressful traffic days? The MBUX assistant is designed to accommodate those moments. Mercedes collaborates with various suppliers, including Nvidia, relying on their water-cooled chips to drive the MB.OS system.

Mercedes reveals that the initial vehicles featuring MB.OS will debut alongside the forthcoming Mercedes Modular Architecture (MMA) in 2025.

Mercedes also plans to add Microsoft Teams and Sony Pictures Ridevu to its vehicles for video conferencing and streaming. A fresh addition, named Surround Navigation, delivers improved spatial awareness through 3D visuals on the infotainment screen, powered by Unity's gaming engine.