Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments.
Tyler McDonnellMatthew LeaseMücahid KutluTamer ElsayedPublished in: HCOMP (2016)
Keyphrases
- relevance judgments
- test collection
- retrieval systems
- learning to rank
- average precision
- retrieval effectiveness
- user feedback
- relevance feedback
- web search engines
- ranking functions
- relevance scores
- relevant documents
- information retrieval
- query performance prediction
- retrieval functions
- keywords
- data sets
- evaluation measures
- relevance assessments
- training data
- information retrieval evaluation
- highly relevant documents