Softmax circuit
US10949498B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 13, 2019 |
| Grant date | Mar 16, 2021 |
| Priority date | — |
| Expiry date | Oct 16, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/04
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Disclosed approaches for circuitry that implements a softmax function include difference calculation circuitry configured to calculate differences between combinations of elements, zk−zj, of a vector. First lookup circuitry is configured to lookup and output representations of exponential values, ez−zassociated with the differences in response to input of the differences. Each adder circuit of N adder circuits sums a subset of the exponential values output from the first lookup circuitry and a value of 1. The sum output by each adder circuit denotes a denominator of a plurality of denominators of the softmax function. Second lookup circuitry is configured with quotients and looks-up and outputs quotients associated with the plurality of denominators as results of the softmax function.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.