Too Many Relevants: Whither Cranfield Test Collections?
Ellen M. VoorheesNick CraswellJimmy LinPublished in: SIGIR (2022)
Keyphrases
- test collection
- information retrieval evaluation
- evaluation of information retrieval systems
- search tasks
- retrieval systems
- information retrieval
- average precision
- relevant documents
- rank correlation
- language model
- retrieval model
- retrieval effectiveness
- document collections
- relevance assessments
- evaluation methodology
- learning to rank
- relevance judgements
- relevance judgments
- patent retrieval
- search engine
- digital libraries
- evaluation campaigns
- databases