Convolution-augmented transformer models
US12079703B2 · kind B2 · utility
0Cited by
0References
18Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Dec 31, 2020 |
| Grant date | Sep 3, 2024 |
| Priority date | — |
| Expiry date | May 31, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L21/0272
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods can utilize a conformer model to process a data set for various data processing tasks, including, but not limited to, speech recognition, sound separation, protein synthesis determination, video or other image set analysis, and natural language processing. The conformer model can use feed-forward blocks, a self-attention block, and a convolution block to process data to learn global interactions and relative-offset-based local correlations of the input data.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.