Implementing parameter server in networking infrastructure for high-performance computing
US11315013B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Apr 23, 2018 |
| Grant date | Apr 26, 2022 |
| Priority date | — |
| Expiry date | Nov 11, 2040 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/044
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques are provided for implementing a parameter server within a networking infrastructure of a computing system to reduce the communication bandwidth and latency for performing communication synchronization operations of the parameter server. For example, a method includes executing a distributed deep learning (DL) model training process to train model parameters of a DL model using a plurality of worker nodes executing on one or more server nodes of a computing system, and executing a parameter server within a networking infrastructure of the computing system to aggregate local model parameters computed by the plurality of worker nodes and to distribute aggregated model parameters to the plurality of worker nodes using the networking infrastructure of the computing system.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.