Data-Driven Relevance Judgments for Ranking Evaluation.
Nuno MonizLuís TorgoJoão VinagrePublished in: CoRR (2016)
Keyphrases
- relevance judgments
- learning to rank
- data driven
- ranking functions
- evaluation measures
- user feedback
- test collection
- evaluation metrics
- implicit feedback
- retrieval functions
- web search engines
- retrieval effectiveness
- average precision
- human relevance judgments
- retrieval systems
- relevance feedback
- result list
- human judgments
- relevance assessments
- information retrieval
- relevant documents
- information retrieval evaluation
- web search
- ranking models
- ranking algorithm
- query performance prediction
- documents retrieved
- scoring function
- supervised learning
- ranked list
- precision and recall
- loss function
- document retrieval
- decision trees
- xml retrieval
- bayesian networks
- clickthrough data
- language model
- search engine