Probabilistic multigraph modeling for improving the quality of crowdsourced affective data
US11636368B2 · kind B2 · utility
Assignee
Inventors
Key dates
| Filing date | Jan 4, 2018 |
| Grant date | Apr 25, 2023 |
| Priority date | — |
| Expiry date | Nov 22, 2041 |
Classification
- Technology area (CPC G)Physics
- CPC primaryG06Q30/0201
- WIPO fieldComputer technology
- WIPO sectorElectrical engineering
Abstract
A method of improving quality of crowdsourced affective data based on agreement relationship between a plurality of annotators include receiving, by a processor, a collection of stimuli previously given affective labels by the plurality of annotators, executing, by a processor, an algorithm operative to perform the steps including constructing an agreement multigraph as a probabilistic model including a pair-wise status of agreement between the affective labels given by different ones of the plurality of annotators, learning the probabilistic model computationally using the crowdsourced affective data, identifying a reliability of each of the plurality of annotators based on the learned model, and adjusting the crowdsourced affective data by calculating the affective labels of each stimuli based on the identified reliability of each of the plurality of annotators, thereby improving the quality of the crowdsourced affective data.
Source: USPTO / EPO open patent data. Objective bibliographic and citation counts.