Crowd vs. Expert: What Can Relevance Judgment Rationales Teach Us About Assessor Disagreement?
Mücahid KutluTyler McDonnellYassmine BarkallahTamer ElsayedMatthew LeasePublished in: SIGIR (2018)
Keyphrases
- relevance judgments
- relevance assessments
- learning to rank algorithms
- test collection
- relevance feedback
- information retrieval
- expert knowledge
- retrieval systems
- active learning
- data sets
- information retrieval systems
- information seeking
- e learning
- highly relevant
- crowd sourced
- learning to rank
- relative importance
- learning process