Relevance Judgment Convergence Degree - A Measure of Inconsistency among Assessors for Information Retrieval.
Dengya ZhuShastri L. NimmagaddaKok Wai WongTorsten ReinersPublished in: CoRR (2022)
Keyphrases
- information retrieval
- test collection
- relevance judgments
- document relevance
- relevance judgements
- relevant documents
- relevance assessments
- relevant and non relevant documents
- relevance feedback
- information retrieval systems
- retrieval systems
- search engine
- ir evaluation
- relevance ranking
- retrieval effectiveness
- document collections
- probability measure
- retrieval model
- document retrieval
- text retrieval
- similarity measure
- web retrieval
- information filtering
- information seeking
- correlation coefficient
- learning to rank
- vector space model
- average precision
- information access
- query terms
- iterative algorithms
- convergence speed
- evaluation measures
- human subjects
- document length
- web search
- topical relevance