Systems and methods for natural language processing using joint energy-based models
US11934952B2 · kind B2 · utility
0Cited by
20References
15Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Dec 16, 2020 |
| Grant date | Mar 19, 2024 |
| Priority date | — |
| Expiry date | Sep 24, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/30
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Embodiments described herein provide natural language processing (NLP) systems and methods that utilize energy-based models (EBMs) to compute an exponentially-weighted energy-like term in the loss function to train an NLP classifier. Specifically, noise contrastive estimation (NCE) procedures are applied together with the EBM-based loss objectives for training the NLPs.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.