System and method for fault-tolerant parallel learning over non-iid data
US10291485B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 18, 2016 |
| Grant date | May 14, 2019 |
| Priority date | — |
| Expiry date | Jun 24, 2037 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N20/00
- WIPO fieldDigital communication
- WIPO sectorElectrical engineering
Abstract
A network device, system, and method are provided. The network device includes a processor. The processor is configured to store a local estimate and a dual variable maintaining an accumulated subgradient for the network device. The processor is further configured to collect values of the dual variable of neighboring network devices. The processor is also configured to form a convex combination with equal weight from the collected dual variable of neighboring network devices. The processor is additionally configured to add a most recent local subgradient for the network device, scaled by a scaling factor, to the convex combination to obtain an updated dual variable. The processor is further configured to update the local estimate by projecting the updated dual variable to a primal space.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.