Verbessertes Sprachmodell mit Reduzierter Halluzination

Details

Veröffentlichungs-Nr.

EP4818965

Anmeldetag

30. März 2026

Veröffentlichung

7. Oktober 2026

Rechtsraum

EP

Abstract

A method including receiving an input for a language model including decoder layers having attention heads. The language model predicts a chunk of tokens based on the input. Predicting includes determining, for each of the attention heads, corresponding attention map weights from the input. The method also includes determining, from the corresponding attention map weights of each of the attention heads, a lookback ratio vector for the chunk of tokens. A hallucination score for the chunk of tokens is predicted using the lookback ratio vector. A determination is made that the hallucination score fails to satisfy a predefined threshold, λ, such that the chunk of tokens represents a hallucination of the language model. An edit direction for the corresponding attention map weights for the chunk of tokens is determined. The attention map weights of at least some attention heads are modified to generate a post-process language model.

Anmelder

Firma

Intuit Inc.

Land

🇺🇸 USA