Can Generative LLMs Create Query Variants for Test Collections? An Exploratory Study.
Marwah AlaofiLuke GallagherMark SandersonFalk ScholerPaul ThomasPublished in: SIGIR (2023)
Keyphrases
- test collection
- retrieval systems
- relevance judgments
- average precision
- relevance assessments
- queries and relevance judgments
- ad hoc retrieval
- relevant documents
- information retrieval
- retrieval effectiveness
- relevance judgements
- retrieval model
- information retrieval evaluation
- evaluation methodology
- document set
- relevance feedback
- document collections
- query expansion
- language model
- original query
- query processing
- query terms
- relevance scores
- learning to rank
- user feedback
- database
- human relevance judgments
- ir evaluation
- search engine
- search queries
- web search engines
- pseudo relevance feedback
- structured queries
- keywords
- newspaper articles
- query suggestion
- user queries
- evaluation of information retrieval systems
- query logs
- tf idf