Randomised vs. Prioritised Pools for Relevance Assessments: Sample Size Considerations.
Tetsuya SakaiPeng XiaoPublished in: AIRS (2019)
Keyphrases
- sample size
- relevance assessments
- test collection
- relevance judgements
- information seeking
- information retrieval systems
- evaluation metrics
- model selection
- retrieval systems
- small sample
- xml retrieval
- upper bound
- random sampling
- user feedback
- language model
- retrieval model
- statistical tests
- retrieval effectiveness
- statistical power
- information retrieval
- statistical hypothesis testing
- variance reduction
- progressive sampling
- average precision
- machine learning
- relevance judgments
- random sample
- worst case
- relevance feedback
- data mining
- document collections
- small samples