VariErr NLI: Separating Annotation Error from Human Label Variation.

Leon Weber-Genzel Siyao Peng Marie-Catherine de Marneffe Barbara Plank

Published in: ACL (1) (2024)

Keyphrases

active learning
human behavior
human interaction
real time
metadata
error rate
information retrieval
labeling process
manual annotation
automatic annotation
error analysis
binary images
image annotation
human experts
relative error
semantic labels
class labels