Verbesserung von Szenenvorhersagen für Autonomes Fahren mit Multimodalen Sprachmodellen

Details

Veröffentlichungs-Nr.

EP4745917

Anmeldetag

14. November 2025

Veröffentlichung

20. Mai 2026

Rechtsraum

EP

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for performing a prediction task using sensor data. The method includes obtaining scene data characterizing a scene in an environment at a current time point, wherein the scene comprises an autonomous vehicle and a plurality of agents, wherein the scene data comprises sensor data captured by one or more sensors of the autonomous vehicle and scene context data; generating, from the sensor data using a multimodal language model (MLM) neural network, one or more text outputs that each describe one or more aspects of the scene; generating, from at least the one or more text outputs describing the one or more aspects of the scene and the scene context data, a prediction input to a prediction neural network; and processing the prediction input using the prediction neural network to generate a prediction output for the prediction task.

Anmelder

Firma

WAYMO LLC

Land

🇺🇸 USA