Ora: Objekterweiterte Beziehungsbewusste Aktionserkennung

Details

Veröffentlichungs-Nr.

EP4730282

Anmeldetag

29. August 2025

Veröffentlichung

22. April 2026

Rechtsraum

EP

Abstract

A computer-implemented method of object-augmented action recognition and an object-augmented action recognition system may be provided, the method comprises processing one or more initial patch tokens to extract one or more human tokens and one or more object tokens; applying the extracted one or more human tokens and the extracted one or more object tokens and the one or more initial patch tokens to a first cross attention mechanism to obtain a set of processed patch tokens containing object-guided information; enumerating to construct a set of Human-Object (HO) tokens, the constructed HO tokens each comprising information associated with visual relationship and information associated with spatial relationship between a human token and an object token; applying the constructed HO tokens and the processed patch tokens containing object-guided information to a second cross attention mechanism to obtain a set of resultant processed HO tokens; applying a feature aggregation process to the resultant processed HO tokens to synthesize the features of M groups of the resultant processed HO tokens into a single feature representation; obtaining a prediction result based on the set of processed patch tokens containing object-guided information; obtaining an action recognition prediction result based on a result of the feature aggregation process and the prediction result based on the set of processed patch tokens containing object-guided information; and outputting for use the action recognition prediction result.

Anmelder

Firmen

AUMOVIO Germany GmbH
Nanyang Technological University

Land

🇩🇪 Deutschland