Programmatically generating evaluation data sets for code generation models
US12141553B2 · kind B2 · utility
0Cited by
14References
20Claims
0Family size
Assignee
Inventors
Key dates
| Filing date | Jun 22, 2022 |
| Grant date | Nov 12, 2024 |
| Priority date | — |
| Expiry date | Aug 31, 2042 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F11/368
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Evaluation data sets may be programmatically generated for code generation models. An evaluation data set is obtained that includes items that correspond to different evaluation tests for a code generation system. The individual items of the evaluation data set maybe converted, including the conversion of a function signature for the items, the test statements for the items and using a code generation system to generate the body of the function.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.