DeiT-LT Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets.
Harsh RangwaniPradipto MondalMayank MishraAshish Ramayee AsokanR. Venkatesh BabuPublished in: CoRR (2024)
Keyphrases
- training dataset
- computer vision
- real time
- vision system
- experimental results on real world
- fuzzy logic
- training set
- test set
- training phase
- data sets
- training algorithm
- training process
- decision trees
- fault diagnosis
- database
- restricted boltzmann machine
- computer software
- synthetic datasets
- gaussian distribution
- benchmark datasets
- training examples
- training samples
- data mining
- machine learning
- high dimensional
- artificial intelligence
- training data