Login / Signup
It's the End of the Gold Standard as we Know it. On the Impact of Pre-aggregation on the Evaluation of Highly Subjective Tasks.
Valerio Basile
Published in:
DP@AI*IA (2020)
Keyphrases
</>
gold standard
highly subjective
semi automatic
ground truth
mechanical turk
manual segmentation
website
relevance judgements