Contextual and dimensional relevance judgments for reusable SERP-level evaluation.
Peter B. GolbusImed ZitouniJinyoung KimAhmed Hassan AwadallahFernando DiazPublished in: WWW (2014)
Keyphrases
- relevance judgments
- test collection
- web search engines
- search engine
- search tasks
- search result
- document relevance
- retrieval systems
- average precision
- learning to rank
- retrieval effectiveness
- evaluation measures
- relevance feedback
- relevant documents
- user feedback
- evaluation metrics
- ranking functions
- web search
- relevance assessments
- user satisfaction
- xml retrieval
- information retrieval
- relevance judgements
- loss function
- document collections
- user queries
- active learning
- support vector
- information retrieval systems
- human judgments
- contextual information