Verfahren zur Darstellung Multimodaler Sensordaten

Details

Veröffentlichungs-Nr.

EP4800654

Anmeldetag

26. Februar 2025

Veröffentlichung

2. September 2026

Rechtsraum

EP

IPC

G06T15/20, G06T17/00, G06N3/00

Abstract

A method for training a machine learning, ML, model for generating a joint particle-based representation (510) of a scene from multi-modality sensor data comprises receiving sensor data (502; 5012; 522) acquired by a set of optical sensors of different sensor modality, representing the same scene. A joint particle-based representation (510) of the scene covered by the optical sensors is generated. Intersections between rays emanating from a sensor location with the joint particle-based representation (510) are determined, based on which an observation of the scene is rendered (508; 518; 528). A sensor-specific loss function value is determined by comparing the rendered (508; 518; 528) observation with an observation rendered based on the received sensor data (502; 5012; 522). The ML model is trained by determining the intersections, rendering the observation and determining the value of the sensor-specific loss function for every optical sensor, and by optimizing a combination (520) of the sensor-specific loss functions.

Anmelder

Firma

Robert Bosch GmbH

Land

🇩🇪 Deutschland

Fachgebiete