The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry.

Michael Zhang Kush Bhatia Hermann Kumbong Christopher Ré

Published in: ICLR (2024)

Keyphrases

machine learning
linear systems
image processing
clustering algorithm
evolutionary algorithm
hidden markov models
collaborative filtering
linear model
piecewise linear
simple linear