A Novel Label Aggregation with Attenuated Scores for Ground-Truth Identification of Dataset Annotation with Crowdsourcing.
Ratchainant ThammasudjaritAnon PlangprasopchokCharnyote PluempitiwiriyawejPublished in: IEICE Trans. Inf. Syst. (2017)
Keyphrases
- ground truth
- manually labeled
- mechanical turk
- annotated images
- gold standard
- weakly labeled
- multi label
- ground truth data
- metadata
- high quality
- automatic image annotation
- image annotation
- manual annotation
- active learning
- precision recall curves
- data aggregation
- information retrieval
- multi label classification
- image retrieval
- training dataset
- automatic annotation
- quantitative evaluation
- semantic annotation
- image labeling
- class labels
- benchmark datasets
- semantic labels
- visual features
- data sets