Neuronale Aufmerksamkeitsnetze mit Verallgemeinerten Restaufmerksamkeitsblöcken

Details

Veröffentlichungs-Nr.

EP4787234

Anmeldetag

3. Februar 2026

Veröffentlichung

5. August 2026

Rechtsraum

EP

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing a machine learning task on a network input to generate a network output using an attention neural network. The attention neural network includes a plurality of attention blocks arranged in a stack one after the other. One or more of the plurality of attention blocks are generalized residual attention blocks. Each generalized residual attention block includes one or more generalized residual blocks and an attention layer. The one or more generalized residual blocks includes a query generalized residual block.

Anmelder

Firma

GOOGLE LLC

Land

🇺🇸 USA