Human uncertainty and ranking error: fallacies in metric-based evaluation of recommender systems.
Kevin JasbergSergej SizovPublished in: SAC (2018)
Keyphrases
- recommender systems
- evaluation metrics
- human judgments
- user feedback
- collaborative filtering
- web search
- error rate
- ranking functions
- pairwise comparisons
- measurement errors
- ranking algorithm
- evaluation method
- preference learning
- evaluation measures
- human subjects
- metric learning
- information overload
- evaluation model
- xml retrieval
- learning to rank
- missing data
- distance function
- user profiles
- graded relevance