Relevance Assessments for Web Search Evaluation: Should We Randomise or Prioritise the Pooled Documents? (Corrected Version).
Tetsuya SakaiSijie TaoZhaohao ZengPublished in: CoRR (2022)
Keyphrases
- relevance assessments
- test collection
- web search
- relevance judgements
- relevance judgments
- retrieval systems
- evaluation metrics
- information retrieval systems
- web search engines
- interactive information retrieval
- document ranking
- information seeking
- xml retrieval
- ir evaluation
- user feedback
- document relevance
- relevant documents
- search engine
- document collections
- information retrieval
- anchor text
- retrieval effectiveness
- language model
- trec web track
- highly relevant documents
- gold standard
- evaluation measures
- precision and recall
- average precision
- digital libraries