Graphical systems and methods for human-in-the-loop machine intelligence
US11295071B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 14, 2018 |
| Grant date | Apr 5, 2022 |
| Priority date | — |
| Expiry date | Dec 14, 2038 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06Q50/01
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Methods and systems are disclosed for creating and linking a series of interfaces configured to display information and receive confirmation of classifications made by a natural language modeling engine to improve organization of a collection of documents into an hierarchical structure. In some embodiments, the interfaces may display to an annotator a plurality of labels of potential classifications for a document as identified by a natural language modeling engine, collect annotated responses from the annotator, aggregate the annotated responses across other annotators, analyze the accuracy of the natural language modeling engine based on the aggregated annotated responses, and predict accuracies of the natural language modeling engine's classifications of the documents.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.