Effect of verbal comprehension skill and self-reported features on reliability of crowdsourced relevance judgments.
Parnia SamimiSri Devi RavanaYun Sing KohPublished in: Comput. Hum. Behav. (2016)
Keyphrases
- relevance judgments
- test collection
- retrieval effectiveness
- user feedback
- relevance feedback
- web search engines
- information retrieval
- average precision
- feature set
- feature space
- relevance assessments
- learning to rank
- retrieval systems
- user interaction
- low level
- language model
- benchmark datasets
- co occurrence
- web search
- classification accuracy
- retrieval model
- feature vectors
- pairwise
- feature extraction
- search engine
- data sets