Considering Assessor Agreement in IR Evaluation.
Eddy MaddalenaKevin RoiteroGianluca DemartiniStefano MizzaroPublished in: ICTIR (2017)
Keyphrases
- ir evaluation
- relevance assessments
- test collection
- relevance judgments
- information retrieval
- statistical significance
- information seeking
- evaluation metrics
- retrieval effectiveness
- information retrieval systems
- relevant documents
- patent retrieval
- retrieval systems
- user feedback
- short queries
- average precision
- language model
- keywords
- search engine