Deep learning heterogeneous computing method based on layer-wide memory allocation and system thereof
US11568268B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 21, 2020 |
| Grant date | Jan 31, 2023 |
| Priority date | — |
| Expiry date | Sep 20, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/09
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A deep learning heterogeneous computing method based on layer-wide memory allocation, at least comprises steps of: traversing a neural network model so as to acquire a training operational sequence and a number of layers L thereof; calculating a memory room R1 required by data involved in operation at the ith layer of the neural network model under a double-buffer configuration, where 1≤i≤L; altering a layer structure of the ith layer and updating the training operational sequence; distributing all the data across a memory room of the CPU and the memory room of the GPU according to a data placement method; performing iterative computation at each said layer successively based on the training operational sequence so as to complete neural network training.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.