Survey Equivalence: A Procedure for Measuring Classifier Accuracy Against Human Labels.
Paul ResnickYuqing KongGrant SchoenebeckTim WeningerPublished in: CoRR (2021)
Keyphrases
- training data
- unseen data
- high accuracy
- labeling effort
- training examples
- class labels
- individual classifiers
- multi label classification
- decision trees
- highest accuracy
- pairwise
- classification accuracy
- feature selection
- fold cross validation
- error rate
- feature set
- computational cost
- support vector
- multi label
- human subjects
- classification rate
- higher classification accuracy
- labeled instances
- fully supervised
- human experts
- active learning
- support vector machine classifier
- confusion matrix
- label noise
- learning algorithm