Login / Signup
The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers.
Zonglin Li
Chong You
Srinadh Bhojanapalli
Daliang Li
Ankit Singh Rawat
Sashank J. Reddi
Ke Ye
Felix Chern
Felix X. Yu
Ruiqi Guo
Sanjiv Kumar
Published in:
ICLR (2023)
Keyphrases
</>
neural network
high dimensional
sparse representation
information processing
training data
case based reasoning
lazy learning
averaged one dependence estimators
database
image processing
decision trees
artificial neural networks
agent societies
activation patterns
partial discharge