Convolution-augmented transformer models
US12373666B2 · kind B2 · utility
0Cited by
0References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Jul 8, 2024 |
| Grant date | Jul 29, 2025 |
| Priority date | — |
| Expiry date | Jul 8, 2044 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L21/0272
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods can utilize a conformer model to process a data set for various data processing tasks, including, but not limited to, speech recognition, sound separation, protein synthesis determination, video or other image set analysis, and natural language processing. The conformer model can use feed-forward blocks, a self-attention block, and a convolution block to process data to learn global interactions and relative-offset-based local correlations of the input data.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.