Quality through flow and immersion: gamifying crowdsourced relevance assessments.
Carsten EickhoffChristopher G. HarrisArjen P. de VriesPadmini SrinivasanPublished in: SIGIR (2012)
Keyphrases
- relevance assessments
- test collection
- information retrieval systems
- information seeking
- retrieval systems
- high quality
- low quality
- interactive information retrieval
- relevance judgments
- evaluation metrics
- relevance judgements
- user feedback
- ir evaluation
- xml retrieval
- language model
- evaluation measures
- retrieval effectiveness
- retrieval model
- relevant documents
- data management
- database systems