Compressing neural networks for natural language understanding
US12210973B2 · kind B2 · utility
3Cited by
0References
15Claims
0Family size
Assignee
Inventor
Key dates
| Filing date | Jul 24, 2020 |
| Grant date | Jan 28, 2025 |
| Priority date | — |
| Expiry date | Feb 6, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N5/04
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A model for a natural language understanding task is generated based on labeled data generated by a labeling model. The model for the natural language understanding task is smaller than the labeling model (i.e., with lower computational and memory requirements than the combined model), but with substantially the same performance as the labeling model. In some cases, the labeling model may be generated based on a large pre-trained model.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.