Scaled ReLU Matters for Training Vision Transformers.
Pichao WangXue WangHao LuoJingkai ZhouZhipeng ZhouFan WangHao LiRong JinPublished in: AAAI (2022)
Keyphrases
- computer vision
- training process
- real time
- vision system
- multiscale
- test set
- training phase
- e learning
- image processing
- artificial neural networks
- computational vision
- database
- visual perception
- training dataset
- training algorithm
- training examples
- supervised learning
- multi class
- video sequences
- information systems
- artificial intelligence
- genetic algorithm