Reducing Reliance on Relevance Judgments for System Comparison by Using Expectation-Maximization.
Ning GaoWilliam WebberDouglas W. OardPublished in: ECIR (2014)
Keyphrases
- relevance judgments
- expectation maximization
- test collection
- em algorithm
- retrieval systems
- retrieval effectiveness
- web search engines
- average precision
- user feedback
- learning to rank
- ranking functions
- relevant documents
- evaluation measures
- machine learning
- relevance feedback
- clickthrough data
- information retrieval
- probabilistic model
- human judgments
- retrieval functions
- information retrieval evaluation
- retrieval model
- maximum likelihood
- web search
- evaluation metrics
- image retrieval
- search engine
- learning algorithm
- query performance prediction