Präventive Erzeugung von Generativen Modellausgängen

Details

Veröffentlichungs-Nr.

EP4711949

Anmeldetag

29. August 2025

Veröffentlichung

18. März 2026

Rechtsraum

EP

Abstract

Various implementations include reducing latency when interacting with a generative model system based on generating predicted complete text based on natural language (NL) text input, where the NL text input is a portion of a user query. In many implementations, predicted completion text can be generated by processing NL text input using a language model. In several implementations, the system can perform initial processing of the NL input text and the predicted completion text (e.g., preform initial preprocessing of the NL input text and predicted completion text for processing using the generative model, performing an initial limited decoding of output using the generative model, etc.). The user can confirm the predicted completion text before the system continues processing the NL input and predicted completion text using the generative model to generate output.

Anmelder

Firma

Google LLC

Land

🇺🇸 USA