Size and Source Matter: Understanding Inconsistencies in Test Collection-Based Evaluation.
Timothy JonesAndrew TurpinStefano MizzaroFalk ScholerMark SandersonPublished in: CIKM (2014)
Keyphrases
- test collection
- evaluation methodology
- relevance judgments
- evaluation campaigns
- ir evaluation
- relevance assessments
- evaluation of information retrieval systems
- information retrieval evaluation
- relevance judgements
- retrieval effectiveness
- trec web track
- xml retrieval
- average precision
- search tasks
- information retrieval
- retrieval model
- relevant documents
- language model
- trec web
- retrieval systems
- evaluation metrics
- evaluation method
- document collections
- evaluation methods
- document set
- chinese web
- learning to rank
- patent retrieval
- information retrieval systems