ACORDAR 2.0: A Test Collection for Ad Hoc Dataset Retrieval with Densely Pooled Datasets and Question-Style Queries.
Qiaosheng ChenWeiqing LuoZixian HuangTengteng LinXiaxia WangAhmet SoyluBasil EllBaifan ZhouEvgeny KharlamovGong ChengPublished in: SIGIR (2024)
Keyphrases
- test collection
- retrieval systems
- trec web
- relevance judgments
- relevance judgements
- relevance assessments
- retrieval model
- retrieval effectiveness
- ad hoc retrieval
- trec test collections
- information retrieval
- benchmark datasets
- trec collections
- average precision
- document collections
- retrieval strategies
- relevant documents
- language model
- search tasks
- retrieval process
- database
- trec web track
- short queries
- query terms
- evaluation methodology
- anchor text
- relevance feedback
- evaluation of information retrieval systems
- relevance scores
- web search engines
- focused retrieval
- spoken document retrieval
- chinese web
- user queries
- relevance model
- learning to rank
- evaluation measures
- human relevance judgments
- search engine
- graded relevance assessments
- information retrieval systems
- pseudo relevance feedback
- language modeling
- image retrieval
- query expansion