Scaled ReLU Matters for Training Vision Transformers.

Pichao Wang Xue Wang Hao Luo Jingkai Zhou Zhipeng Zhou Fan Wang Hao Li Rong Jin

Published in: CoRR (2021)

Keyphrases

computer vision
training samples
vision system
online learning
training set
real time
active learning
computer software
feedforward neural networks
human vision
visual perception
training process
data structure
web services
website
real world
neural network
databases