Preferences on a Budget: Prioritizing Document Pairs when Crowdsourcing Relevance Judgments.
Kevin RoiteroAlessandro CheccoStefano MizzaroGianluca DemartiniPublished in: WWW (2022)
Keyphrases
- relevance judgments
- retrieval systems
- relevant documents
- test collection
- user feedback
- information retrieval systems
- document collections
- information retrieval
- retrieval effectiveness
- average precision
- relevance assessments
- human relevance judgments
- user preferences
- relevance feedback
- retrieved documents
- learning to rank
- pairwise
- documents retrieved
- web search engines
- ranked list
- document retrieval
- retrieval model
- relevance scores
- implicit feedback
- query expansion
- search engine
- query performance prediction
- multimedia
- ranking functions
- evaluation measures
- query terms
- document clustering
- vector space model
- evaluation metrics
- keywords
- text documents
- user interaction
- language model
- user interface