How evaluator domain expertise affects search result relevance judgments.
Kenneth A. KinneyScott B. HuffmanJuting ZhaiPublished in: CIKM (2008)
Keyphrases
- search result
- domain expertise
- relevance judgments
- web search engines
- search behavior
- web search
- test collection
- search tasks
- search engine
- ranking functions
- search queries
- user queries
- query logs
- implicit feedback
- relevant documents
- web pages
- learning to rank
- relevance assessments
- retrieval systems
- retrieval effectiveness
- web documents
- search sessions
- query suggestion
- average precision
- relevance feedback
- log data
- evaluation metrics
- ranked list
- keyword search
- result list
- digital libraries
- user studies
- search logs
- evaluation measures
- database
- information retrieval