Processing text sequences using neural networks
US11182566B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 3, 2017 |
| Grant date | Nov 23, 2021 |
| Priority date | — |
| Expiry date | Apr 11, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG10L15/197
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A computer-implemented method for training a neural network that is configured to generate a score distribution over a set of multiple output positions. The neural network is configured to process a network input to generate a respective score distribution for each of a plurality of output positions including a respective score for each token in a predetermined set of tokens that includes n-grams of multiple different sizes. Example methods described herein provide trained neural networks which produce results with improved accuracy compared to the state of the art, e.g. translations that are more accurate compared to the state of the art, or more accurate speech recognition compared to the state of the art.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.