Vorrichtung und Computerimplementiertes Verfahren zur Bestimmung mindestens einer Scheibe eines Satzes Digitaler Bilder

Details

Veröffentlichungs-Nr.

EP4760645

Anmeldetag

11. Dezember 2024

Veröffentlichung

17. Juni 2026

Rechtsraum

EP

Abstract

A device and a computer implemented method for determining at least one slice of a set of digital images on which a model for detecting an object in a digital image underperforms, wherein the method comprises providing (202) a set of digital images, wherein the set of digital images comprises digital images that are respectively annotated with a ground truth bounding box label, wherein the ground truth bounding box label comprises bounding box coordinates and a class label, wherein the method further comprises determining (204), for the digital images, a respective prediction of the model, wherein the prediction of the model comprises a predicted bounding box label, wherein the predicted bounding box label comprises predicted bounding box coordinates and a predicted class label, determining (206), for the predictions that are determined for the digital images a respective patch of the respective digital image depending on the respective prediction, wherein the respective patch is a false positive patch or a false negative patch or a true positive patch, determining (208), for the patches, a respective encoding of the respective patch with an image encoder of a vision language model, wherein the image encoder is configured to encode visual input of a resolution, wherein the encoding of the respective patch comprises an encoding of the respective patch, and wherein the encoding of the respective patch comprises an encoding of dense visual features determined for the respective patch, determining (210), for the encodings of the dense visual features, a respective upscaled embedding of the same resolution as the visual input, determining (212), for the patches, a respective feature vector depending on the pixels of the patch that are inside the ground truth bounding box defined in the label for the digital image for that the patch is determined, determining (214), for the patches, a respective embedding vector depending on the feature vector determined for the respective patch and the encoding of the respective patch, assigning (216), to the embedding vectors a first target value or a second target value respectively, wherein the first target value is assigned to the respective embedding vector in case the patch that the respective embedding vector is determined for is a false positive patch, wherein the second target value is assigned to the respective embedding vector otherwise, in particular in case the patch that the respective embedding vector is determined for is a false negative patch or a true positive patch, grouping (218) the digital images of the set of digital images into slices depending on the embedding vectors that are determined for the respective patch that is determined for the respective digital image and depending on the target values that are assigned to the respective embedding vector.

Anmelder

Firma

Robert Bosch GmbH

Land

🇩🇪 Deutschland