At the intersection of luxury and technology, Mercedes-Benz has taken a significant leap forward by integrating Google’s latest conversational AI into its vehicles. The new feature, known as the MBUX Virtual Assistant, was highlighted at CES 2024 with the announcement of its inclusion in the upcoming Mercedes CLA, the first model to feature this advanced tech.

The MBUX Virtual Assistant rides on the back of the next-generation MB.OS operating system, which itself is a testament to Mercedes-Benz’s commitment to redefining the digital in-car experience. Unlike the previous iteration of the MBUX Voice Assistant, which was limited to roughly 20 voice commands activated by the phrase “Hey Mercedes,” this new system elevates the interaction to a conversational level. Previously, the voice assistant relied on inputs from OpenAI‘s ChatGPT and Microsoft Bing for information but lacked true dialogue capabilities. Now, with Google‘s AI, the assistant can engage in multi-turn conversations, providing a more natural and intuitive user experience.

One of the standout features of the new MBUX Virtual Assistant is its personality, characterized by four distinct traits: natural, predictive, personal, and empathetic. This design choice aims to mimic human-like interaction, making the experience not only about command and response but also about understanding and anticipation. For instance, the assistant can ask clarifying questions to better serve the user’s needs, enhancing the personalization of the driving experience.

The integration of Google’s AI, specifically the Gemini model running on the Vertex AI platform from Google Cloud, is a game-changer for automotive applications. This collaboration allows the MBUX Virtual Assistant to leverage Google Maps‘ extensive database, offering real-time updates on points of interest, restaurant recommendations, and navigation, all while being capable of handling complex dialogues. Imagine asking your car for the best Italian restaurant nearby and then inquiring about the reviews or the chef’s signature dish in a follow-up question — all handled seamlessly by the car’s AI.

Sundar Pichai, CEO of Google, emphasized the transformative potential of this technology, stating, “This is just the beginning of how agentic capabilities can transform the automotive industry.” His words underline a vision where vehicles are not just modes of transport but sophisticated companions that adapt and interact with drivers in ways previously thought of as science fiction.

Mercedes-Benz has plans to extend these AI enhancements beyond the CLA to other models with the older Voice Assistant system, although specifics on which models remain under wraps. This move indicates a broader strategy to integrate cutting-edge AI across their lineup, ensuring that the digital luxury experience is not confined to a single model but becomes a hallmark of the brand.

For drivers, this evolution means more than just a technological upgrade; it promises a shift in how they interact with their vehicles daily. The MBUX Virtual Assistant is set to make driving not only more convenient but also more engaging, turning every trip into an opportunity for smart, connected, and empathetic interaction with your car.