Systems and methods for distributed data annotation
US8706729B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Oct 12, 2012 |
| Grant date | Apr 22, 2014 |
| Priority date | — |
| Expiry date | Oct 12, 2032 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06F18/2185
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Systems and methods for distributed data annotation in accordance embodiments of the invention are disclosed. In one embodiment of the invention, a distributed data annotation server system includes a storage device configured to store source data, one or more annotators, annotation tasks and a processor, wherein a distributed data annotation application configures the processor to receive source data including one or more pieces of source data, select one or more annotators, create one or more annotation tasks for the selected annotators and source data, request one or more annotations for the source data using the annotation tasks, receive annotations, determine source data metadata for at least one piece of source data using the received annotations, generate annotator metadata for at least one annotator using the received annotations and the source data, and estimate the ground truth for the source data using the source data metadata and the annotator metadata.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.