Prioritizing relevance judgments to improve the construction of IR test collections.
Mehdi HosseiniIngemar J. CoxNatasa Milic-FraylingTrevor SweetingVishwa VinayPublished in: CIKM (2011)
Keyphrases
- test collection
- relevance judgments
- information retrieval
- retrieval effectiveness
- relevance assessments
- retrieval model
- ir evaluation
- relevance feedback
- relevant documents
- information retrieval evaluation
- average precision
- retrieval systems
- patent retrieval
- language model
- ad hoc retrieval
- relevance judgements
- document collections
- evaluation measures
- human relevance judgments
- query performance prediction
- learning to rank
- web search engines
- evaluation methodology
- xml retrieval
- evaluation of information retrieval systems
- information retrieval systems
- search engine
- queries and relevance judgments
- graded relevance
- vector space model
- ranking functions
- co occurrence