Verfahren und Vorrichtung mit Generativer Modellverarbeitung

Details

Veröffentlichungs-Nr.

EP4826596

Anmeldetag

12. März 2026

Veröffentlichung

21. Oktober 2026

Rechtsraum

EP

IPC

G06N3/0475

Abstract

A processor-implemented method includes determining a task ratio between a first processing group and a second processing group for an inference task of a generative model, generating subtensors by dividing tensors used for the inference task based on communication dependency of computation stages of the inference task, storing the generated subtensors in a first memory pool of the first processing group and in a second memory pool of the second processing group based on the task ratio, and performing the inference task using the stored subtensors by the first processing group and the second processing group.

Anmelder

Firmen

Samsung Electronics Co., Ltd.
Ulsan National Institute of Science and Technology (UNIST)

Land

🇰🇷 Südkorea

Fachgebiete