Relevance Assessments for Web Search Evaluation: Should We Randomise or Prioritise the Pooled Documents?
Tetsuya SakaiSijie TaoZhaohao ZengPublished in: ACM Trans. Inf. Syst. (2022)
Keyphrases
- relevance assessments
- test collection
- web search
- relevance judgments
- relevance judgements
- web search engines
- retrieval systems
- information retrieval systems
- evaluation metrics
- document ranking
- xml retrieval
- interactive information retrieval
- user feedback
- information seeking
- document relevance
- ir evaluation
- search engine
- relevant documents
- information retrieval
- average precision
- highly relevant documents
- learning to rank
- gold standard
- precision and recall
- document collections
- web pages
- query logs
- retrieval effectiveness
- retrieval model
- text mining
- relevance feedback
- pairwise