Estimation of Fair Ranking Metrics with Incomplete Judgments.

Ömer Kirnap Fernando Diaz Asia Biega Michael D. Ekstrand Ben Carterette Emine Yilmaz

Published in: WWW (2021)

Keyphrases

human judgments
ranking functions
evaluation metrics
ranking algorithm
accurate estimation
evaluation measures
learning to rank
missing values
relevance judgments
robust estimation
estimation algorithm
density estimation
noisy data
parameter estimation
link analysis
ranked list
precision and recall
rank aggregation