Modelltrainings- und Checkpoint-Dateispeichersysteme und -Verfahren

Details

Veröffentlichungs-Nr.

EP4711930

Anmeldetag

13. Dezember 2024

Veröffentlichung

18. März 2026

Rechtsraum

EP

IPC

G06F11/14

Abstract

One or more embodiments of this specification provide a model training and checkpoint file storage system and method. The system includes a model training module and a checkpoint file processing module. The model training module is configured to execute a training task of an artificial intelligence model, where computation in the training task is performed by GPU chips; and during the execution of the training task, if a first checkpoint file is generated, the training task is suspended, and a request is made to the checkpoint file processing module to write the first checkpoint file. The checkpoint file processing module is configured to locally cache the first checkpoint file based on a received write request for the first checkpoint file, and then concurrently perform a notification operation and a storage operation, where the notification operation is used to return a write success notification for the first checkpoint file to the model training module, to indicate the model training module to resume the training task, and the storage operation is used to persist the first checkpoint file.

Anmelder

Firma

Alipay (Hangzhou) Information Technology Co., Ltd.

Land

🇨🇳 China

Fachgebiete