Uncovering Layer-Dependent Activation Sparsity Patterns in ReLU Transformers.

Cody Wild Jesper Anderson

Published in: CoRR (2024)

Keyphrases

information processing
pattern mining
high dimensional
frequent patterns
similar patterns
pattern analysis
multi layer
pattern discovery
database
sparse representation
artificial intelligence
data mining techniques
data analysis
interesting patterns
application layer
complex patterns
real time