Activation functions for deep neural networks
US12387091B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 7, 2022 |
| Grant date | Aug 12, 2025 |
| Priority date | — |
| Expiry date | Oct 7, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/045
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Hardware for implementing a Deep Neural Network (DNN) for performing an activation function includes, at an activation module for performing an activation function, a programmable lookup table for storing lookup data approximating the activation function over a first range of input values to the activation module, the method comprising: providing calibration data to a representation of the hardware; monitoring an input to an activation module of the representation of the hardware so as to determine a range of input values to the activation module; generating lookup data for the lookup table representing the activation function over the determined range of input values; and loading the generated lookup data into the lookup table of the hardware, thereby configuring the activation module of the hardware for performing the activation function over the determined range of input values.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.