Sorting attention neural networks
US12346793B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Feb 8, 2021 |
| Grant date | Jul 1, 2025 |
| Priority date | — |
| Expiry date | Feb 5, 2044 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N7/01
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A system for performing a machine learning task on a network input is described. The system includes one or more computers and one or more storage devices storing instructions that, when executed by the one or more computers, cause the one or more computers to implement (i) multiple sorting networks in which each sorting network is configured to sort vector blocks in a sequence of vector blocks to generate a sorted sequence of vector blocks; and (ii) a sorting attention neural network configured to perform the machine learning task on the input sequence by executing multiple sorting attention mechanisms using the sorting networks.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.