System und Computerimplementiertes Verfahren zur Erkennung Falscher Multimodaler Medien

Details

Veröffentlichungs-Nr.

EP4807583

Anmeldetag

14. März 2025

Veröffentlichung

16. September 2026

Rechtsraum

EP

IPC

G06F16/583, G06F16/55

Abstract

System and computer-implemented method of detecting fake multimodal media. In the method (100), the original image (2) of a multimodal post (1) is represented with a set of original visual features (4) while the original caption text (3) is converted into an original entity relationship graph (5). The original image (2) is used through reverse search (108) to find evidence text (8), and the original caption text (3) is used through direct search (110) to find evidence image (9). The nodes and edges of the entity relationship graph (18) of evidence text (8) and the visual features (13) of evidence image (9) are matched against the original entity relationship graph (5) and the original visual features (4) to find supporting and conflicting evidence. The result of the matching is also used in a feedback-based image retrieval (112) to refine the retrieval of an updated evidence image (9'). Finally, an interpretable decision on the authenticity of the multimodal post (1) in terms of matched nodes, edges and visual features is obtained.

Anmelder

Firmen

Centre De Visió Per Computador
UNIVERSITAT AUTÒNOMA DE BARCELONA

Land

🇪🇸 Spanien

Fachgebiete