Visual Atoms: Pre-training Vision Transformers with Sinusoidal Waves.
Sora TakashimaRyo HayamizuNakamasa InoueHirokatsu KataokaRio YokotaPublished in: CoRR (2023)
Keyphrases
- visual perception
- visual processing
- computer vision
- human vision
- training process
- visual field
- test set
- data sets
- visual information
- training examples
- logic programs
- image processing
- visual features
- linear combination
- vision system
- feedforward neural networks
- real time
- supervised learning
- low level
- training samples
- machine learning
- neural network