Crowdsourcing system with community learning
US10762443B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jul 17, 2017 |
| Grant date | Sep 1, 2020 |
| Priority date | — |
| Expiry date | Oct 10, 2038 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L51/212
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Crowdsourcing systems with machine learning are described. Specifically, item-label inference methods and systems are presented, for example, to provide aggregated answers to a crowdsourced task in a manner achieving good accuracy even where observed data about past behavior of crowd members is sparse. In various examples, an item-label inference system infers variables describing characteristics of both individual crowd workers and communities of the workers. In various examples, an item-label inference system provides aggregated labels while considering the inferred worker characteristics and the inferred characteristics of the worker communities. In examples the item-label inference system provides uncertainty information associated with the inference results for selecting workers and generating future tasks.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.