Geometric Dynamics of Signal Propagation Predict Trainability of Transformers.
Aditya CowsikTamra NebabuXiao-Liang QiSurya GanguliPublished in: CoRR (2024)
Keyphrases
- signal processing
- frequency domain
- original signal
- wave propagation
- non stationary
- high frequency
- dynamical systems
- multiresolution
- database
- geometric constraints
- white noise
- random noise
- dynamic model
- highly nonlinear
- nonlinear dynamics
- temporal evolution
- wavelet analysis
- pattern recognition
- image segmentation
- genetic algorithm