Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer.

Yuandong Tian Yiping Wang Beidi Chen Simon S. Du

Published in: NeurIPS (2023)

Keyphrases

recurrent networks
fuzzy logic
multi layer
training set
dynamic model
online learning
test set
fault diagnosis
dynamical systems
web service composition
real time
decision making
knowledge base
case study
feed forward neural networks
feedforward neural networks