Crowdsourcing system with community learning
US9767419B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 24, 2014 |
| Grant date | Sep 19, 2017 |
| Priority date | — |
| Expiry date | Nov 13, 2035 |
Classification
- Technology area (CPC H)Electricity
- CPC primaryH04L51/212
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
Crowdsourcing systems with machine learning are described, for example, to aggregate answers to a crowdsourced task in a manner achieving good accuracy even where observed data about past behavior of crowd members is sparse. In various examples a machine learning system jointly learns variables describing characteristics of both individual crowd workers and communities of the workers. In various examples, the machine learning system learns aggregated labels. In examples learnt variables describing characteristics of an individual crowd worker are related, by addition of noise, to learnt variables describing characteristics of a community of which the individual is a member. In examples the crowdsourcing system uses the learnt variables describing characteristics of individual workers and of communities of workers for any one or more of: active learning, targeted training of workers, targeted issuance of tasks, calculating and issuing rewards.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.