On the Reusability of "Living Labs" Test Collections: : A Case Study of Real-Time Summarization.
Luchen TanGaurav BaruahJimmy LinPublished in: SIGIR (2017)
Keyphrases
- test collection
- real time
- information retrieval
- retrieval model
- retrieval effectiveness
- relevant documents
- average precision
- document collections
- information retrieval evaluation
- language model
- evaluation methodology
- retrieval systems
- ir evaluation
- ad hoc retrieval
- relevance assessments
- relevance judgments
- chinese web
- patent retrieval
- evaluation of information retrieval systems
- information retrieval systems
- relevance judgements
- evaluation campaigns
- learning to rank
- test set
- probabilistic model
- databases