On Crowdsourcing Relevance Magnitudes for Information Retrieval Evaluation.
Eddy MaddalenaStefano MizzaroFalk ScholerAndrew TurpinPublished in: ACM Trans. Inf. Syst. (2017)
Keyphrases
- information retrieval evaluation
- test collection
- rank correlation
- relevance judgments
- retrieval effectiveness
- relevance assessments
- user feedback
- information retrieval
- retrieval systems
- language model
- document collections
- interactive information retrieval
- retrieval model
- average precision
- mechanical turk
- databases
- relevant documents
- information retrieval systems
- relevance feedback
- e learning
- learning algorithm