Incentivizing Evaluation with Peer Prediction and Limited Access to Ground Truth (Extended Abstract).
Xi Alice GaoJames R. WrightKevin Leyton-BrownPublished in: IJCAI (2020)
Keyphrases
- extended abstract
- ground truth
- gold standard
- prediction accuracy
- high quality
- prediction algorithm
- real time
- quantitative evaluation
- objective evaluation
- access control
- prediction error
- random access
- evaluation criteria
- manually labeled
- single user
- ground truth data
- segmented images
- evaluation model
- evaluation method
- prediction model
- data mining
- databases