Bevorrechtigung in einem Hardware-Beschleuniger für Maschinelles Lernen

Details

Veröffentlichungs-Nr.

EP4715590

Anmeldetag

21. Dezember 2020

Veröffentlichung

25. März 2026

Rechtsraum

EP

IPC

G06F9/48, G06F9/46, G06N3/063G06F9/48

Abstract

The present disclosure relates to a method, system and non-transitory computer readable storage medium. The method involves operating a machine learning accelerator, comprising steps of: executing, by a scalar core directing a plurality of compute units of the machine learning accelerator, a first process in a first context, wherein the first process is a long-running process; identifying, by a job scheduler of the machine learning accelerator, that a second process is queued, wherein the second process has a higher priority than a priority of the long-running process, and upon reaching a preemption checkpoint: determining, by the scalar core, an amount of available resources and in response to the amount of available resources being sufficient for the second process: pausing, by the scalar core, execution of the first process; allocating available resources to the second process; switching, by the scalar core, to a second context; executing, by the scalar core, the second process; switching, by the scalar core, to the first context; and resuming, by the scalar core, execution of the first process.

Anmelder

Firma

GOOGLE LLC

Land

🇺🇸 USA

Fachgebiete