Parameter version vectors used for deterministic replay of distributed execution of workload computations
US10643150B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 11, 2016 |
| Grant date | May 5, 2020 |
| Priority date | — |
| Expiry date | Nov 20, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/02
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method includes storing parameter versions utilized by learner instances in each of two or more epochs in a parameter receiving buffer of a parameter server, the learner instances performing distributed execution of workload computations of a machine learning algorithm. The method also includes creating a parameter roster in the parameter server comprising parameter version vectors specifying the parameter versions used by each of the learner instances during each of the two or more epochs. The method further includes generating one or more aggregated parameter sets for storage in an aggregated parameters buffer by aggregating parameter versions from the parameter receiving buffer based on the parameter version vectors in the parameter roster and providing aggregated parameter sets from the aggregated parameters buffer to the learner instances for deterministic replay of the distributed execution of the workload computations of the machine learning algorithm.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.