Multimodales Föderiertes Lernverfahren und System in Umgebungen mit Modalitätsmissbrauch

Details

Veröffentlichungs-Nr.

EP4773046

Anmeldetag

19. Dezember 2025

Veröffentlichung

8. Juli 2026

Rechtsraum

EP

Abstract

Disclosed are a multimodal federated learning method and system in modality-missing environments. The multimodal federated learning system includes a server and a plurality of clients, each provided with a local model, a neural network structure of the local model provided by each of the clients is identical, a client type of each of the clients is categorized based on whether a modality of training data used to train the local model is missing, each of the clients generates a class-specific local prototype from data of the input modality and transmit the class-specific local prototype to the server, and the server aggregates class-specific local prototypes received from a plurality of clients of different client types, generates a class-specific complete prototype based on the aggregated class-specific local prototypes, and transmits the generated class-specific complete prototype to each of the clients.

Anmelder

Firma

UNIVERSITY-INDUSTRY COOPERATION GROUP OF KYUNG HEE UNIVERSITY

Land

🇰🇷 Südkorea