Verfahren zur Aktionssegmentierung einer Videosequenz

Details

Veröffentlichungs-Nr.

EP4481696

Aktenzeichen

EP23181135

Anmeldetag

23. Juni 2023

Veröffentlichung

31. Dezember 2025

Erteilung

31. Dezember 2025

Rechtsraum

EP

IPC

G06V10/82G06V20/40G06V20/52G06V20/70

Abstract

A computer-implemented method for action segmentation of a video sequence, the method comprising: selecting a plurality of local segments (113) from the video sequence, each local segment comprising a plurality of successive frames of the video sequence; (S12) processing each local segment with a first attention transformer (114) in order to generate first enhanced feature maps (116) modelling relations between local segments (113); (S20) selecting a plurality of global segments (123) from the first enhanced feature maps (116), each global segment comprising a plurality of non-successive frames of the first enhanced feature maps (116); (S22) processing each global segment with a second attention transformer (124) in order to generate second enhanced feature maps (126) modelling relations between global segments (123); and (S30) assigning an action class to each frame of the video sequence based on the second enhanced feature maps (126).

Anmelder

Firmen

TOYOTA JIDOSHA KABUSHIKI KAISHA
Rheinische Friedrich-Wilhelms-Universität Bonn

Land

🇯🇵 Japan

Fachgebiete