Verfahren und System zur Aktionserkennung mit Multimodaler Fusion

Details

Veröffentlichungs-Nr.

EP4641522

Aktenzeichen

EP25172330

Anmeldetag

24. April 2025

Veröffentlichung

29. Oktober 2025

Rechtsraum

EP

IPC

G06V10/82G06V20/59

Abstract

The present disclosure relates to a computer-implemented method for action recognition, the method comprising: a) capturing a plurality of sequence of frames wherein each sequence is recorded using a predetermined modality; b) extracting intra-modality features and deriving a class token using N layers of multi-stream encoder; c) passing intra-modality features through K layers of cross-modality fusion decoder to extract inter-modality features and a query token; d) concatenating the class token with the query token to generate a global representation; and e) feeding the global representation to an action classification module trained to determine an action performed based on the global representation, and determining the action that was most probably performed. The present disclosure further relates to a control method for a vehicle, a system, a vehicle, a computer program, and a computer readable medium or data carrier signal.

Anmelder

Firmen

AUMOVIO Germany GmbH
Nanyang Technological University
Continental Automotive Technologies GmbH

Land

🇩🇪 Deutschland

Fachgebiete