Result aggregation
US9954942B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Dec 11, 2013 |
| Grant date | Apr 24, 2018 |
| Priority date | — |
| Expiry date | Jun 7, 2034 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06Q50/01
- WIPO fieldIT methods for management
- WIPO sectorElectrical engineering
Abstract
Methods and systems for result aggregation in crowdsourcing are described. In one implementation, a task with a plurality of solution options is provided for workers to respond. Responses for the task are received from multiple workers, where each of the responses includes a worker response confidence value corresponding to one of the plurality of solution options. The worker response confidence value is indicative of confidence of a worker for the one of the plurality of solution options to be correct. A task answer for the task is estimated based on at least the worker response confidence value received from each of the multiple workers. A performance bonus for each of the multiple workers is computed based on the task answer, the worker response confidence value in the response from each worker, and a Proper Scoring Rule.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.