VariErr NLI: Separating Annotation Error from Human Label Variation.
Leon Weber-GenzelSiyao PengMarie-Catherine de MarneffeBarbara PlankPublished in: CoRR (2024)
Keyphrases
- error rate
- semantic annotation
- metadata
- active learning
- neural network
- human interaction
- machine learning
- automatic annotation
- human experts
- multi modal
- digital libraries
- learning algorithm
- image classification
- pairwise
- case study
- human behavior
- prediction error
- artificial intelligence
- relative error
- instance level
- labeling process