Finding Replicable Human Evaluations via Stable Ranking Probability.
Parker RileyDaniel DeutschGeorge F. FosterViresh RatnakarAli DabirmoghaddamMarkus FreitagPublished in: CoRR (2024)
Keyphrases
- ranking algorithm
- probability distribution
- human subjects
- learning to rank
- human behavior
- human beings
- human interaction
- human users
- ranking functions
- link analysis
- conditional probabilities
- probability estimates
- human operators
- probability theory
- data sets
- human experts
- information retrieval systems
- web search
- video sequences
- information systems
- genetic algorithm