Inferring missing relevance judgments from crowd workers via probabilistic matrix factorization.
Hyun Joon JungMatthew LeasePublished in: SIGIR (2012)
Keyphrases
- relevance judgments
- probabilistic matrix factorization
- collaborative filtering
- test collection
- learning to rank
- matrix factorization
- retrieval systems
- missing data
- average precision
- retrieval effectiveness
- web search engines
- relevance feedback
- user feedback
- ranking functions
- evaluation measures
- recommender systems
- relevant documents
- information retrieval systems
- information retrieval
- relevance assessments
- query performance prediction
- evaluation metrics
- incomplete data
- missing values
- pairwise
- human judgments
- search engine
- document retrieval
- ranked list
- retrieval model
- user queries
- language model
- web search
- query processing
- feature space
- query difficulty
- metadata
- feature selection
- queries and relevance judgments