Parallelized machine learning with distributed lockless training
US9984337B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 1, 2015 |
| Grant date | May 29, 2018 |
| Priority date | — |
| Expiry date | Jul 25, 2036 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F16/273
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods are disclosed for providing distributed learning over a plurality of parallel machine network nodes by allocating a per-sender receive queue at every machine network node and performing distributed in-memory training; and training each unit replica and maintaining multiple copies of the unit replica being trained, wherein all unit replicas train, receive unit updates and merge in parallel in a peer-to-peer fashion, wherein each receiving machine network node merges updates at later point in time without interruption and wherein the propagating and synchronizing unit replica updates are lockless and asynchronous.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.