On the Expressivity Role of LayerNorm in Transformers' Attention.

Shaked Brody Uri Alon Eran Yahav

Published in: ACL (Findings) (2023)

Keyphrases

artificial intelligence
three dimensional
expert systems
artificial neural networks
visual attention
real time
data sets
neural network
real world
machine learning
genetic algorithm
image processing
digital libraries
eye tracking