Baumbasierte Netzwerkarchitektur zur Beschleunigung Kollektiver Operationen für Maschinelles Lernen

Details

Veröffentlichungs-Nr.

EP4586103

Aktenzeichen

EP24206191

Anmeldetag

11. Oktober 2024

Veröffentlichung

16. Juli 2025

Rechtsraum

EP

IPC

G06F15/78G06N3/063

Abstract

Aspects of the disclosure are directed to a tree-based network architecture for serving and/or training machine learning models. The architecture includes one or more multi-chip packages having a plurality of compute-memory stacks connected via an input/output (I/O) die. The I/O die includes an aggregator to aggregate computations from the compute-memory stacks. The architecture can further include a plurality of the multi-chip packages connected on a server via a server level aggregator and a plurality of the servers connected on a rack via a rack level aggregator for further aggregation of the computations from the compute-memory stacks. The tree-based network architecture allows for fewer hops, resulting in lower latency and savings in bandwidth when serving and/or training machine learning models.

Anmelder

Firma

Google LLC

Land

🇺🇸 USA

Fachgebiete