Machine learning based adaptive instructions for annotation
US10977518B1 · kind B1 · utility
Assignee
Inventors
Key dates
| Filing date | Mar 15, 2019 |
| Grant date | Apr 13, 2021 |
| Priority date | — |
| Expiry date | May 21, 2039 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06N3/045
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Techniques for generating and utilizing machine learning based adaptive instructions for annotation are described. An annotation service can use models to identify edge case data elements predicted to elicit differing annotations from annotators, “bad” data elements predicted to be difficult to annotate, and/or “good” data elements predicted to elicit matching or otherwise high-quality annotations from annotators. These sets of data elements can be automatically incorporated into annotation job instructions provided to annotators, resulting in improved overall annotation results via having efficiently and effectively “trained” the annotators how to perform the annotation task.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.