Evaluating crowdsourced relevance assessments using self-reported traits and task speed.

Christopher Chow Tom Gedeon

Published in: OZCHI (2017)

Keyphrases

relevance assessments
test collection
retrieval systems
information retrieval systems
information seeking
user feedback
evaluation metrics
ir evaluation
relevance judgments
xml retrieval
interactive information retrieval
average precision
probabilistic model
language model
semi supervised