Sign in
Hermann Kumbong
Publication Activity (10 Years)
Years Active: 2023-2024
Publications (10 Years): 4
Top Topics
Fourier Transform
Long Sequences
Preprocessing
Lightweight
Top Venues
CoRR
NeurIPS
</>
Publications
</>
Michael Zhang
,
Kush Bhatia
,
Hermann Kumbong
,
Christopher Ré
The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry.
CoRR
(2024)
Stefano Massaroli
,
Michael Poli
,
Daniel Y. Fu
,
Hermann Kumbong
,
Rom N. Parnichkun
,
Aman Timalsina
,
David W. Romero
,
Quinn McIntyre
,
Beidi Chen
,
Atri Rudra
,
Ce Zhang
,
Christopher Ré
,
Stefano Ermon
,
Yoshua Bengio
Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions.
CoRR
(2023)
Daniel Y. Fu
,
Hermann Kumbong
,
Eric Nguyen
,
Christopher Ré
FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores.
CoRR
(2023)
Stefano Massaroli
,
Michael Poli
,
Daniel Y. Fu
,
Hermann Kumbong
,
Rom N. Parnichkun
,
David W. Romero
,
Aman Timalsina
,
Quinn McIntyre
,
Beidi Chen
,
Atri Rudra
,
Ce Zhang
,
Christopher Ré
,
Stefano Ermon
,
Yoshua Bengio
Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions.
NeurIPS
(2023)