
On Monday, Google Cloud unveiled its latest Automotive AI Agent, designating the Mercedes-Benz CLA as the pioneer model to be equipped with this technology later this year. This new Agent will enhance the functionalities of Mercedes’ MBUX Virtual Assistant, allowing for a broader range of conversational interactions with passengers.
Last year at CES 2024, we were introduced to the next-generation assistant from Mercedes, although details about the underlying large language model were not disclosed at that time. This upcoming assistant offers more advanced capabilities compared to the existing MBUX system, which can currently manage around two dozen commands and gather information via sources such as ChatGPT and Bing. Presently, the MBUX is triggered with the phrase “Hey, Mercedes,” but it operates more like Siri or Google Assistant rather than ChatGPT’s Advanced Voice Mode, delivering static responses rather than engaging in two-way conversation.
The new Google Agent is powered by the Gemini large language model and utilizes Vertex AI, specifically designed to enable automakers in creating highly personalized and intuitive in-car assistants that transcend the limits of conventional vehicle voice commands. Notably, the Agent supports multimodal and multilingual input and can answer follow-up questions. For instance, it can inform drivers about nearby Italian restaurants, provide reviews of those establishments, and even highlight the most popular dishes available. Its robust design facilitates multi-turn dialogues, allowing it to recall details from previous interactions.
Moreover, the enhanced MBUX assistant will source real-time information from Google Maps, delivering “fresh and factual data” about over 250 million points of interest worldwide, as well as current traffic conditions. “At Mercedes-Benz, we aim to deliver an outstanding digital experience to our customers,” stated Ola Källenius, CEO of Mercedes-Benz Group AG, in a press release. “Our collaboration with Google Cloud will significantly enhance in-car navigation by merging sophisticated location data with generative AI.”
In the future, Mercedes plans to expand the rollout of the new MBUX assistant to other models, although they have yet to announce specific vehicles that will receive this upgrade.