Efficient decoding of output sequences using adaptive early exiting
US11886976B1 · kind B1 · utility
0Cited by
0References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Jul 14, 2023 |
| Grant date | Jan 30, 2024 |
| Priority date | — |
| Expiry date | Jul 14, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/0475
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating output sequences using auto-regressive decoder neural networks. In particular, during generation, adaptive early exiting is used to reduce the time required to generate the output sequence.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.