Intelligentes Prompt-Routing über Maschinenlernmodelle

Details

Veröffentlichungs-Nr.

EP4818976

Anmeldetag

25. März 2026

Veröffentlichung

7. Oktober 2026

Rechtsraum

EP

IPC

G06N3/0475

Abstract

A user of a machine learning model service may lack information about the suitability of particular generative machine learning models for particular tasks. The user may benefit from a machine learning model router that outputs intelligent decisions on which generative machine learning model is more suitable than other generative machine learning models for a particular prompt with respect to known or unknown hardware and process constraints. Suitability may be based on a variety of factors, such as quality of the model for the particular prompt, expected resource expenditure for the particular prompt such as cost or latency, and other factors such as which computing device or devices hosts the generative machine learning model.

Anmelder

Firma

Amazon Technologies, Inc.

Land

🇺🇸 USA

Fachgebiete