Learned evaluation model for grading quality of natural language generation outputs
US11875115B2 · kind B2 · utility
0Cited by
1References
22Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Dec 12, 2022 |
| Grant date | Jan 16, 2024 |
| Priority date | — |
| Expiry date | Dec 12, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/51
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods for automatic evaluation of the quality of NLG outputs. In some aspects of the technology, a learned evaluation model may be pretrained first using NLG model pretraining tasks, and then with further pretraining tasks using automatically generated synthetic sentence pairs. In some cases, following pretraining, the evaluation model may be further fine-tuned using a set of human-graded sentence pairs, so that it learns to approximate the grades allocated by the human evaluators.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.