Choosing execution mode of a neural network based on total memory usage
US11880762B2 · kind B2 · utility
0Cited by
1References
8Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Jun 26, 2018 |
| Grant date | Jan 23, 2024 |
| Priority date | — |
| Expiry date | Oct 5, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/063
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A computer-implemented method, a computer program product, and a computer processing system are provided for selecting from among multiple Graphics Processing Unit (GPU) execution modes for a Neural Network (NN) having a size greater than a threshold size. The multiple GPU execution modes include a normal memory mode, an Out-of-Core (OoC) execution mode, and a Unified Memory (UM) mode. The method includes starting an execution on the NN with the UM mode and measuring the memory usage for each of layers of the NN. The method further includes selecting an execution mode based on the memory usage of all of the layers.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.