Interaktion eines Sprachmodells in Nahezu Echtzeit

Details

Veröffentlichungs-Nr.

EP4790586

Anmeldetag

29. Januar 2026

Veröffentlichung

12. August 2026

Rechtsraum

EP

Abstract

Solutions disclosed herein provide for near real-time language model interaction. Efficient management of the historical state reduces token counts in prompts, enabling use of (near) real-time invocation of language models. Examples segment a transcript (or other streaming representation) of a conversation into an earlier portion for summarization and a later portion. The summary and later portion are included in a prompt for the language model, along with an instruction to return an update to a real-time contextual analysis product (e.g., an updated agenda or other data product) based on prompt. Using the summary, or a sliding time window, the token count in the prompt is reduced, enabling a more rapid cadence of updates. The update is provided as an output (e.g., an agenda update or an updated summary of the conversation), and updated summary may be efficiently used as the summary in the following prompt (i.e., the next update iteration).

Anmelder

Firma

Microsoft Technology Licensing, LLC

Land

🇺🇸 USA