Dynamic optimization for data quality control in crowd sourcing tasks to crowd labor

US11087247B2 · kind B2 · utility

Assignee

• Figure Eight Technologies, Inc. · US

Inventors

• Christopher R. Van Pelt · San Francisco, US
• Ryan Cox · Saratoga Springs, US
• Alexander Sorokin · Foster City, US

Key dates

• Filing date: Mar 23, 2012
• Grant date: Aug 10, 2021
• Expiry date: Mar 23, 2032

Classification

• Technology area (CPC G): Physics
• CPC primary: G06Q10/063114
• WIPO field: IT methods for management
• WIPO sector: Electrical engineering

Abstract

Systems and methods of dynamic optimization for data quality control in crowd sourcing tasks to crowd labor are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for dynamically monitoring results received from workers for a task distributed for evaluation via a job distribution platform, incrementally assigning additional workers to the task using the results and continuously monitoring additional results to assign any additional workers if needed to meet a quality metric for the task.