The Many Benefits of Annotator Rationales for Relevance Judgments.
Tyler McDonnellMücahid KutluTamer ElsayedMatthew LeasePublished in: IJCAI (2017)
Keyphrases
- relevance judgments
- test collection
- retrieval systems
- average precision
- learning to rank
- retrieval effectiveness
- web search engines
- relevance feedback
- relevant documents
- user feedback
- ranking functions
- evaluation measures
- query performance prediction
- evaluation metrics
- information retrieval evaluation
- clickthrough data
- document retrieval
- information retrieval
- language model
- information retrieval systems
- relevance assessments
- database systems
- retrieval model
- benchmark datasets
- web search
- retrieval functions
- probabilistic model
- high dimensional