Evaluating Crowdsourcing Participants in the Absence of Ground-Truth.

Ramanathan Subramanian Rómer Rosales Glenn Fung Jennifer G. Dy

Published in: CoRR (2016)

Keyphrases

ground truth
ground truth data
neural network
significantly greater
manually labeled
undergraduate students
gold standard
significantly higher
mental models
open ended
test images
quantitative evaluation
multi party
high quality
individual differences
image processing
genetic algorithm
data sets