Learned evaluation model for grading quality of natural language generation outputs
US12223273B2 · kind B2 · utility
0Cited by
1References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Sep 25, 2023 |
| Grant date | Feb 11, 2025 |
| Priority date | — |
| Expiry date | Sep 25, 2043 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F40/51
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods for automatic evaluation of the quality of NLG outputs. In some aspects of the technology, a learned evaluation model may be pretrained first using NLG model pretraining tasks, and then with further pretraining tasks using automatically generated synthetic sentence pairs. In some cases, following pretraining, the evaluation model may be further fine-tuned using a set of human-graded sentence pairs, so that it learns to approximate the grades allocated by the human evaluators.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.