Hierarchische Mantissenbitlängenauswahl zur Hardware-Implementierung eines Tiefen Neuronalen Netzwerks

Details

Veröffentlichungs-Nr.

EP3480689

Aktenzeichen

EP18204174

Anmeldetag

2. November 2018

Veröffentlichung

30. Dezember 2020

Erteilung

30. Dezember 2020

Rechtsraum

EP

IPC

G06F7/483G06F17/11G06N3/063G06N3/04

Abstract

Hierarchical methods for selecting fixed point number formats with reduced mantissa bit lengths for representing values input to, and/or output, from, the layers of a DNN. The methods begin with one or more initial fixed point number formats for each layer. The layers are divided into subsets of layers and the mantissa bit lengths of the fixed point number formats are iteratively reduced from the initial fixed point number formats on a per subset basis. If a reduction causes the output error of the DNN to exceed an error threshold, then the reduction is discarded, and no more reductions are made to the layers of the subset. Otherwise a further reduction is made to the fixed point number formats for the layers in that subset. Once no further reductions can be made to any of the subsets the method is repeated for continually increasing numbers of subsets until a predetermined number of layers per subset is achieved.

Anmelder

Firma

Imagination Technologies Limited

Land

🇬🇧 Großbritannien

Fachgebiete