Automatische Konfidenzbasierte Erkennung zur Feinabstimmung von Grossen Sprachmodellen

Details

Veröffentlichungs-Nr.

EP4718313

Anmeldetag

29. Juli 2025

Veröffentlichung

1. April 2026

Rechtsraum

EP

IPC

G06F40/30

Abstract

Systems and methods are disclosed for fine-tuning a large language model (LLM). In particular, a system calculates when to again fine-tune an LLM based on a newly obtained dataset. The system identifies whether the LLM's use of the new dataset causes more than a tolerable difference in the outputs to a defined set of inputs. As such, the system uses the LLM to generate a new set of outputs and corresponding set of confidences for the defined set of inputs based on the new dataset, and the system generates a new distribution of the new set of confidences. The system also stores a previous distribution of a previous set of confidences in a previous set of outputs to the defined set of inputs based on a previous dataset, and the system calculates a difference between the new distribution and the previous distribution. Fine-tuning the LLM is based on the difference.

Anmelder

Firma

Intuit Inc.

Land

🇺🇸 USA