Automatic evaluation of a knowledge canvassing application
US10769539B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Aug 16, 2016 |
| Grant date | Sep 8, 2020 |
| Priority date | — |
| Expiry date | Feb 9, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N5/022
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A system includes a knowledge canvassing system executed by a computer, a processor, and a memory coupled to the processor. The memory is encoded with instructions that when executed cause the processor to provide a training system configured to generate benchmark data, each benchmark datum including a set of one or more benchmark input entities and a set of one or more benchmark output entities associated with the one or more benchmark input entities, query the knowledge canvassing system with each set of benchmark input entities, receive, for each set of benchmark input entities queried, an output result from the knowledge canvassing system that includes a set of zero or more knowledge canvassing system output entities, and generate an evaluation score for each set of knowledge canvassing system output entities based on a comparison of the knowledge canvassing system output entities with the set of benchmark output entities.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.