Rethinking Skip Connection with Layer Normalization in Transformers and ResNets.

Fenglin Liu Xuancheng Ren Zhiyuan Zhang Xu Sun Yuexian Zou

Published in: CoRR (2021)

Keyphrases

multi layer
preprocessing
application layer
artificial intelligence
normalization method
real world
data mining
genetic algorithm
decision trees
wireless sensor networks