A Game Theory Approach for Estimating Reliability of Crowdsourced Relevance Assessments.
Yashar MoshfeghiAlvaro Francisco Huertas-RoseroPublished in: ACM Trans. Inf. Syst. (2022)
Keyphrases
- game theory
- relevance assessments
- test collection
- game theoretic
- information seeking
- retrieval systems
- information retrieval systems
- relevance judgements
- cooperative
- nash equilibrium
- multi agent systems
- evaluation metrics
- mechanism design
- relevance judgments
- resource allocation
- fictitious play
- xml retrieval
- user feedback
- multi agent learning
- statistical physics
- information retrieval
- nash equilibria
- evolutionary game theory
- cooperative game theory
- average precision
- retrieval effectiveness
- solution concepts
- document collections
- web search