On the effect of relevance scales in crowdsourcing relevance assessments for Information Retrieval evaluation.
Kevin RoiteroEddy MaddalenaStefano MizzaroFalk ScholerPublished in: Inf. Process. Manag. (2021)
Keyphrases
- information retrieval evaluation
- test collection
- relevance assessments
- interactive information retrieval
- relevance judgments
- rank correlation
- information retrieval
- relevance judgements
- relevant documents
- retrieval effectiveness
- retrieval model
- language model
- retrieval systems
- average precision
- document collections
- learning to rank
- user feedback
- ir evaluation
- xml retrieval
- highly relevant documents
- document relevance
- anchor text
- information retrieval systems