Strukturierte Unterraumfeinabstimmung für Sicht- und Sprachmodelle

Details

Veröffentlichungs-Nr.

EP4787240

Anmeldetag

30. Januar 2026

Veröffentlichung

5. August 2026

Rechtsraum

EP

Abstract

Methods and systems for fine-tuning a machine-learning model using a fusion-frame representation are provided. Model weights associated with a layer of a machine-learning model are updated using a projection of a block diagonal matrix into a fusion frame, with each block of the block diagonal matrix projected onto a respective subspace of the fusion frame. This reduces the number of parameters that need to be handled during fine-tuning, reducing demand on processor and memory resources, as it is not necessary to fine-tune all the weights, only the elements of the block diagonal matrix. The use of fusion frames also enables targeting of particular parameters or parameter sets using the subspaces of the fusion frame. Furthermore, embodiments described herein show how the fusion frame implementation lends itself to parallelisation of calculations associated with each respective subspace.

Anmelder

Firma

GDM Holding LLC

Land

🇺🇸 USA