Method and device for training model in distributed system
US10764125B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 25, 2018 |
| Grant date | Sep 1, 2020 |
| Priority date | — |
| Expiry date | Jul 25, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F2209/5017
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
A method and a device for training a model in a distributed system are disclosed, so as to reduce load of a master node (101) during model training. The method includes: receiving, by a parameter server (1022) in a first slave node (102), a training result sent by a parameter client (1021) in at least one slave node (102) in the distributed system, where the first slave node (102) is any slave node (102) in the distributed system, and a parameter client (1021) in each slave node (102) obtains a training result by executing a training task corresponding to a sub-model stored on a parameter server (1022) in the slave node (102); and updating, by the parameter server (1022) in the first slave node (102) based on the received training result, a sub-model stored on the parameter server in the first slave node.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.