Berechnung der Datenkompatibilität für die Text-Erweiterte Visuelle Abfrage unter Verwendung einer Text-Bild-Pair-Vector-Repräsentation

Details

Veröffentlichungs-Nr.

EP4134840

Aktenzeichen

EP21306114

Anmeldetag

12. August 2021

Veröffentlichung

8. Oktober 2025

Erteilung

8. Oktober 2025

Rechtsraum

EP

IPC

G06F16/48G06V10/82

Abstract

A system and method for image retrieval is described. A first text-image interaction neural network generates a vector representation of a first text-image pair based on encoder representations of a reference image and a text modifier. The text modifier describes at least one visual difference between a target image and the reference image. A second text-image interaction neural network generates, for each candidate target image of a set of candidate target images, a vector representation of a second text-image pair based on the encoder representation of the text modifier and an encoder representation of a respective candidate target image. A compatibility module computes, based on the vector representations, a compatibility score for each triplet of a set of triplets, each triplet comprising the reference image a candidate target image of the set of candidate target images and the text modifier.

Anmelder

Firma

Naver Corporation

Land

🇰🇷 Südkorea

Fachgebiete