Multi-element protocol on IR experiments stability: Application to the TREC-COVID test collection.
Gabriela González SáezPhilippe MulhemLorraine GoeuriotPetra GaluscákováPublished in: CIRCLE (2022)
Keyphrases
- test collection
- retrieval effectiveness
- information retrieval
- ir evaluation
- retrieval model
- relevance assessments
- relevance judgements
- ad hoc retrieval
- language model
- retrieval systems
- average precision
- document collections
- information retrieval evaluation
- search tasks
- relevant documents
- trec test collections
- relevance judgments
- evaluation methodology
- query expansion
- trec web
- information retrieval systems
- patent retrieval
- trec collections
- xml retrieval
- evaluation campaigns
- language modeling
- pseudo relevance feedback
- trec web track
- statistical significance
- focused retrieval
- term frequency
- tf idf
- relevance feedback
- information extraction