PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers.
Xiaoyi DongJianmin BaoTing ZhangDongdong ChenWeiming ZhangLu YuanDong ChenFang WenNenghai YuBaining GuoPublished in: AAAI (2023)
Keyphrases
- training set
- vector quantization
- computer vision
- visual perception
- human vision
- real time
- training process
- supervised learning
- vision system
- image representation
- vector quantizer
- training examples
- test set
- multiscale
- training algorithm
- human visual system
- perceptual grouping
- training phase
- visual processing
- visual words
- image coding
- bag of words
- training samples
- online learning
- image compression
- object recognition
- machine learning
- neural network