Dynamic quantization of neural networks
US11755901B2 · kind B2 · utility
1Cited by
0References
25Claims
0Family size
Assignee
Inventor
Key dates
| Filing date | Dec 28, 2017 |
| Grant date | Sep 12, 2023 |
| Priority date | — |
| Expiry date | Feb 22, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F7/023
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
An apparatus for applying dynamic quantization of a neural network is described herein. The apparatus includes a scaling unit and a quantizing unit. The scaling unit is to calculate an initial desired scale factors of a plurality of inputs, weights and a bias and apply the input scale factor to a summation node. Also, the scaling unit is to determine a scale factor for a multiplication node based on the desired scale factors of the inputs and select a scale factor for an activation function and an output node. The quantizing unit is to dynamically requantize the neural network by traversing a graph of the neural network.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.