Method, electronic device and computer program product for processing data
US11651269B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Nov 6, 2019 |
| Grant date | May 16, 2023 |
| Priority date | — |
| Expiry date | Aug 13, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F18/2193
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method comprises: generating, at a first computing device, a first set of gradient values associated with a data block processed by nodes of a machine learning model, the first set of gradient values being in a first data format; determining a first shared factor from the first set of gradient values, the first shared factor being in a second data format of a lower a precision than that of the first data format; and scaling the first set of gradient values with the first shared factor, to obtain a second set of gradient values having the second data format. In addition, the method comprises sending the second set of gradient values and the first shared factor to a second computing device; and, in response to receiving a third set of gradient values and a second shared factor from the second computing device, adjusting parameters of the machine learning model.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.