Relevance assessment: are judges exchangeable and does it matter.
Peter BaileyNick CraswellIan SoboroffPaul ThomasArjen P. de VriesEmine YilmazPublished in: SIGIR (2008)
Keyphrases
- relevance assessments
- test collection
- retrieval systems
- information retrieval systems
- information seeking
- interactive information retrieval
- evaluation metrics
- user feedback
- relevance judgments
- xml retrieval
- information retrieval
- average precision
- database
- relevance feedback
- language model
- expert systems
- digital libraries
- retrieval effectiveness
- machine learning