PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers.
Xiaoyi DongJianmin BaoTing ZhangDongdong ChenWeiming ZhangLu YuanDong ChenFang WenNenghai YuPublished in: CoRR (2021)
Keyphrases
- training set
- vector quantization
- visual perception
- human vision
- human perception
- test set
- real time
- computer vision
- bag of words
- training process
- human visual system
- vision system
- online learning
- text classification
- low level
- case study
- machine learning
- image representation
- training examples
- image quality
- image classification
- image processing
- vector quantizer
- training phase
- neural network