Komprimierung von Gewichtsaktualisierungen für Decoderseitige Neuronale Netze

Details

Veröffentlichungs-Nr.

EP3716158

Aktenzeichen

EP20165121

Anmeldetag

24. März 2020

Veröffentlichung

25. November 2020

Rechtsraum

EP

IPC

G06N3/08G06N3/04H04N19/124H04L29/08

Abstract

A method, apparatus, and computer program product are provided for training a neural network or providing a pre-trained neural network with the weight-updates being compressible using at least a weight-update compression loss function and/or task loss function. The weight-update compression loss function can comprise a weight-update vector defined as a latest weight vector minus an initial weight vector before training. A pre-trained neural network can be compressed by pruning one or more small-valued weights. The training of the neural network can consider the compressibility of the neural network, for instance, using a compression loss function, such as a task loss and/or a weight-update compression loss. The compressed neural network can be applied within a decoding loop of an encoder side or in a post-processing stage, as well as at a decoder side.

Anmelder

Firma

Nokia Technologies Oy

Land

🇫🇮 Finnland

Fachgebiete