Triggerbasierte Grammatikdurchsetzung in Llm-Generationen

Details

Veröffentlichungs-Nr.

EP4773037

Anmeldetag

2. Januar 2026

Veröffentlichung

8. Juli 2026

Rechtsraum

EP

Abstract

In an example embodiment, a mechanism is provided to allow an LLM to generate multiple text blocks in which different grammars are strictly enforced with a single invocation. This mechanism defines a set of trigger tokens and end tokens. When a trigger token is encountered by the LLM, a strict grammar referenced by the trigger token is begun to be enforced and this enforcement ends when an end token is encountered. Between the time an end token is encountered, and another trigger token is encountered, no grammar is strictly enforced. By including multiple types of such trigger token/end token pairs, it becomes possible for the LLM to generate texts having different strictly enforced grammars in a single invocation.

Anmelder

Firma

SAP SE

Land

🇩🇪 Deutschland