A Blueprint of IR Evaluation Integrating Task and User Characteristics: Test Collection and Evaluation Metrics.
Kalervo JärvelinEero SormunenPublished in: CoRR (2023)
Keyphrases
- ir evaluation
- test collection
- evaluation metrics
- relevance assessments
- average precision
- evaluation methodology
- learning to rank
- relevance judgments
- information retrieval
- relevant documents
- graded relevance
- retrieval effectiveness
- precision and recall
- retrieval systems
- search tasks
- language model
- user feedback
- patent retrieval
- retrieval model
- document collections
- information retrieval evaluation
- statistical significance
- user queries
- user interaction
- spoken document retrieval
- relevance feedback
- query suggestion
- probabilistic model