On the Relation Between Assessor's Agreement and Accuracy in Gamified Relevance Assessment.

Olga Megorskaya Vladimir Kukushkin Pavel Serdyukov

Published in: SIGIR (2015)

Keyphrases

relevance assessments
test collection
high accuracy
relevance judgments
retrieval systems
precision and recall
classification accuracy
information seeking
information retrieval systems
ir evaluation
database
learning to rank