IR system evaluation using nugget-based test collections.
Virgiliu PavluShahzad RajputPeter B. GolbusJaved A. AslamPublished in: WSDM (2012)
Keyphrases
- test collection
- ir evaluation
- relevance assessments
- information retrieval
- retrieval effectiveness
- relevance judgements
- relevance judgments
- retrieval model
- information retrieval evaluation
- evaluation campaigns
- evaluation methodology
- xml retrieval
- evaluation of information retrieval systems
- graded relevance
- ad hoc retrieval
- relevant documents
- average precision
- language model
- patent retrieval
- human relevance judgments
- information seeking
- information retrieval systems
- retrieval systems
- statistical significance
- clef evaluation campaign
- learning to rank
- document collections
- relevance feedback
- trec test collections
- term frequency
- information access
- user feedback
- evaluation measures
- term weighting
- vector space model
- evaluation metrics
- loss function
- query expansion
- supervised learning