The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks.
Nikil Roashan SelvamSunipa DevDaniel KhashabiTushar KhotKai-Wei ChangPublished in: CoRR (2022)
Keyphrases
- virtual communities
- social networks
- online communities
- information sharing
- neural network
- benchmark datasets
- real time
- database
- benchmark suite
- information systems
- website
- construction process
- power law
- real life
- extreme value theory
- synthetic datasets
- social interaction
- social media
- trade off
- image retrieval
- object recognition
- training data
- real world
- data sets