Waymo is revving up its autonomous driving game with a little help from Google’s Gemini.
This Alphabet-owned trailblazer is leveraging the power of Google's multimodal large language model to train its robotaxis, introducing a new era of smart, decision-making vehicles.
Meet EMMA, the “End-to-End Multimodal Model for Autonomous Driving.” This nifty model processes sensor data to chart future paths for Waymo’s driverless cars, helping them dodge obstacles and choose the best routes. It’s like giving your car a brainy co-pilot who’s always in the know!
Historically, autonomous driving systems have relied on separate modules for tasks like perception and planning. But Waymo’s taking a bold step forward. By integrating MLLMs like Gemini, they’re aiming to overcome the limitations of these pre-defined modules. With its vast internet-sourced knowledge and superior reasoning skills, Gemini could help Waymo’s vehicles adapt to novel environments with ease.
Want to learn more about AI's impact on the world in general and property in particular? Join us on our next Webinar! Click here to register
EMMA has already shown promise in tricky situations, like navigating around road construction or wildlife. It’s a glimpse into the future where autonomous vehicles could handle even more complex tasks seamlessly.
However, it’s not all smooth sailing. EMMA currently struggles with 3D sensor inputs and can only process a limited number of image frames. Plus, the quirks of MLLMs—like the occasional hallucination—mean there’s still work to be done before these models hit the road at full throttle.
Waymo is clear-eyed about these challenges and is calling for further research to refine these cutting-edge systems. As they continue to innovate, the road ahead looks promising for a new generation of intelligent, autonomous vehicles. Buckle up, the future of driving is here!
Want to learn more about AI's impact on the world in general and property in particular? Join us on our next Webinar! Click here to register
Made with TRUST_AI - see the Charter: https://www.modelprop.co.uk/trust-ai
ความคิดเห็น