Albert Gu

Publication Activity (10 Years)

Years Active: 2013-2024
Publications (10 Years): 60

Top Topics

General Purpose

Multidimensional Signals

Recurrent Neural Networks

Top Venues

Publications

Sukjun Hwang, Aakash Lahoti, Tri Dao, Albert Gu
Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers. CoRR (2024)
Haozhe Shan, Albert Gu, Zhong Meng, Weiran Wang, Krzysztof Choromanski, Tara N. Sainath
Augmenting Conformers With Structured State-Space Sequence Models For Online Speech Recognition. ICASSP (2024)
Soham De, Samuel L. Smith, Anushan Fernando, Aleksandar Botev, George-Cristian Muraru, Albert Gu, Ruba Haroun, Leonard Berrada, Yutian Chen, Srivatsan Srinivasan, Guillaume Desjardins, Arnaud Doucet, David Budden, Yee Whye Teh, Razvan Pascanu, Nando de Freitas, Caglar Gulcehre
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models. CoRR (2024)
Tri Dao, Albert Gu
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality. CoRR (2024)
Roger Waleffe, Wonmin Byeon, Duncan Riach, Brandon Norick, Vijay Korthikanti, Tri Dao, Albert Gu, Ali Hatamizadeh, Sudhakar Singh, Deepak Narayanan, Garvit Kulshreshtha, Vartika Singh, Jared Casper, Jan Kautz, Mohammad Shoeybi, Bryan Catanzaro
An Empirical Study of Mamba-based Language Models. CoRR (2024)
Yair Schiff, Chia-Hsiang Kao, Aaron Gokaslan, Tri Dao, Albert Gu, Volodymyr Kuleshov
Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling. CoRR (2024)
Antonio Orvieto, Samuel L. Smith, Albert Gu, Anushan Fernando, Çaglar Gülçehre, Razvan Pascanu, Soham De
Resurrecting Recurrent Neural Networks for Long Sequences. ICML (2023)
Albert Gu, Tri Dao
Mamba: Linear-Time Sequence Modeling with Selective State Spaces. CoRR (2023)
Chris Lu, Yannick Schroecker, Albert Gu, Emilio Parisotto, Jakob Foerster, Satinder Singh, Feryal M. P. Behbahani
Structured State Space Models for In-Context Reinforcement Learning. CoRR (2023)
Antonio Orvieto, Samuel L. Smith, Albert Gu, Anushan Fernando, Çaglar Gülçehre, Razvan Pascanu, Soham De
Resurrecting Recurrent Neural Networks for Long Sequences. CoRR (2023)
Haozhe Shan, Albert Gu, Zhong Meng, Weiran Wang, Krzysztof Choromanski, Tara N. Sainath
Augmenting conformers with structured state space models for online speech recognition. CoRR (2023)
Albert Gu, Isys Johnson, Aman Timalsina, Atri Rudra, Christopher Ré
How to Train your HIPPO: State Space Models with Generalized Orthogonal Basis Projections. ICLR (2023)
David M. Knigge, David W. Romero, Albert Gu, Efstratios Gavves, Erik J. Bekkers, Jakub Mikolaj Tomczak, Mark Hoogendoorn, Jan-Jakob Sonke
Modelling Long Range Dependencies in $N$D: From Task-Specific to a General Purpose CNN. ICLR (2023)
Junxiong Wang, Jing Nathan Yan, Albert Gu, Alexander M. Rush
Pretraining Without Attention. EMNLP (Findings) (2023)
David M. Knigge, David W. Romero, Albert Gu, Efstratios Gavves, Erik J. Bekkers, Jakub M. Tomczak, Mark Hoogendoorn, Jan-Jakob Sonke
Modelling Long Range Dependencies in N-D: From Task-Specific to a General Purpose CNN. CoRR (2023)
Chris Lu, Yannick Schroecker, Albert Gu, Emilio Parisotto, Jakob N. Foerster, Satinder Singh, Feryal M. P. Behbahani
Structured State Space Models for In-Context Reinforcement Learning. NeurIPS (2023)
Albert Gu, Karan Goel, Christopher Ré
Efficiently Modeling Long Sequences with Structured State Spaces. ICLR (2022)
Karan Goel, Albert Gu, Chris Donahue, Christopher Ré
It's Raw! Audio Generation with State-Space Models. ICML (2022)
Eric Nguyen, Karan Goel, Albert Gu, Gordon W. Downs, Preey Shah, Tri Dao, Stephen A. Baccus, Christopher Ré
S4ND: Modeling Images and Videos as Multidimensional Signals Using State Spaces. CoRR (2022)
David W. Romero, David M. Knigge, Albert Gu, Erik J. Bekkers, Efstratios Gavves, Jakub M. Tomczak, Mark Hoogendoorn
Towards a General Purpose CNN for Long Range Dependencies in ND. CoRR (2022)
Junxiong Wang, Jing Nathan Yan, Albert Gu, Alexander M. Rush
Pretraining Without Attention. CoRR (2022)
Karan Goel, Albert Gu, Chris Donahue, Christopher Ré
It's Raw! Audio Generation with State-Space Models. CoRR (2022)
Albert Gu, Isys Johnson, Aman Timalsina, Atri Rudra, Christopher Ré
How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections. CoRR (2022)
Eric Nguyen, Karan Goel, Albert Gu, Gordon W. Downs, Preey Shah, Tri Dao, Stephen Baccus, Christopher Ré
S4ND: Modeling Images and Videos as Multidimensional Signals with State Spaces. NeurIPS (2022)
Albert Gu, Karan Goel, Ankit Gupta, Christopher Ré
On the Parameterization and Initialization of Diagonal State Space Models. NeurIPS (2022)
Ankit Gupta, Albert Gu, Jonathan Berant
Diagonal State Spaces are as Effective as Structured State Spaces. NeurIPS (2022)
Albert Gu, Ankit Gupta, Karan Goel, Christopher Ré
On the Parameterization and Initialization of Diagonal State Space Models. CoRR (2022)
Albert Gu, Karan Goel, Christopher Ré
Efficiently Modeling Long Sequences with Structured State Spaces. CoRR (2021)
Albert Gu, Isys Johnson, Karan Goel, Khaled Saab, Tri Dao, Atri Rudra, Christopher Ré
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State Space Layers. NeurIPS (2021)
Karan Goel, Albert Gu, Yixuan Li, Christopher Ré
Model Patching: Closing the Subgroup Performance Gap with Data Augmentation. ICLR (2021)
Ines Chami, Albert Gu, Dat Nguyen, Christopher Ré
HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projections. CoRR (2021)
Albert Gu, Isys Johnson, Karan Goel, Khaled Saab, Tri Dao, Atri Rudra, Christopher Ré
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layers. CoRR (2021)
Jared Quincy Davis, Albert Gu, Krzysztof Choromanski, Tri Dao, Christopher Ré, Chelsea Finn, Percy Liang
Catformer: Designing Stable Transformers via Sensitivity Analysis. ICML (2021)
Ines Chami, Albert Gu, Dat Nguyen, Christopher Ré
HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projections. ICML (2021)
Nimit Sharad Sohoni, Jared Dunnmon, Geoffrey Angus, Albert Gu, Christopher Ré
No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problems. NeurIPS (2020)
Karan Goel, Albert Gu, Yixuan Li, Christopher Ré
Model Patching: Closing the Subgroup Performance Gap with Data Augmentation. CoRR (2020)
Nimit Sharad Sohoni, Jared A. Dunnmon, Geoffrey Angus, Albert Gu, Christopher Ré
No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problems. CoRR (2020)
Albert Gu, Tri Dao, Stefano Ermon, Atri Rudra, Christopher Ré
HiPPO: Recurrent Memory with Optimal Polynomial Projections. NeurIPS (2020)
Tri Dao, Nimit Sharad Sohoni, Albert Gu, Matthew Eichhorn, Amit Blonder, Megan Leszczynski, Atri Rudra, Christopher Ré
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps. CoRR (2020)
Tri Dao, Nimit Sharad Sohoni, Albert Gu, Matthew Eichhorn, Amit Blonder, Megan Leszczynski, Atri Rudra, Christopher Ré
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps. ICLR (2020)
Anna C. Gilbert, Albert Gu, Christopher Ré, Atri Rudra, Mary Wootters
Sparse Recovery for Orthogonal Polynomial Transforms. ICALP (2020)
Ines Chami, Albert Gu, Vaggos Chatziafratis, Christopher Ré
From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clustering. NeurIPS (2020)
Albert Gu, Tri Dao, Stefano Ermon, Atri Rudra, Christopher Ré
HiPPO: Recurrent Memory with Optimal Polynomial Projections. CoRR (2020)
Albert Gu, Çaglar Gülçehre, Thomas Paine, Matt Hoffman, Razvan Pascanu
Improving the Gating Mechanism of Recurrent Neural Networks. ICML (2020)
Ines Chami, Albert Gu, Vaggos Chatziafratis, Christopher Ré
From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clustering. CoRR (2020)
Tri Dao, Albert Gu, Matthew Eichhorn, Atri Rudra, Christopher Ré
Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations. CoRR (2019)
Tri Dao, Albert Gu, Matthew Eichhorn, Atri Rudra, Christopher Ré
Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations. ICML (2019)
Albert Gu, Çaglar Gülçehre, Tom Le Paine, Matthew W. Hoffman, Razvan Pascanu
Improving the Gating Mechanism of Recurrent Neural Networks. CoRR (2019)
Albert Gu, Frederic Sala, Beliz Gunel, Christopher Ré
Learning Mixed-Curvature Representations in Product Spaces. ICLR (Poster) (2019)
Anna C. Gilbert, Albert Gu, Christopher Ré, Atri Rudra, Mary Wootters
Sparse Recovery for Orthogonal Polynomial Transforms. CoRR (2019)
Tri Dao, Albert Gu, Alexander Ratner, Virginia Smith, Chris De Sa, Christopher Ré
A Kernel Theory of Modern Data Augmentation. ICML (2019)
Christopher De Sa, Albert Gu, Rohan Puttagunta, Christopher Ré, Atri Rudra
A Two-pronged Progress in Structured Dense Matrix Vector Multiplication. SODA (2018)
Anna T. Thomas, Albert Gu, Tri Dao, Atri Rudra, Christopher Ré
Learning Invariance with Compact Transforms. ICLR (Workshop) (2018)
Anna T. Thomas, Albert Gu, Tri Dao, Atri Rudra, Christopher Ré
Learning Compressed Transforms with Low Displacement Rank. CoRR (2018)
Christopher De Sa, Albert Gu, Christopher Ré, Frederic Sala
Representation Tradeoffs for Hyperbolic Embeddings. CoRR (2018)
Tri Dao, Albert Gu, Alexander J. Ratner, Virginia Smith, Christopher De Sa, Christopher Ré
A Kernel Theory of Modern Data Augmentation. CoRR (2018)
Frederic Sala, Christopher De Sa, Albert Gu, Christopher Ré
Representation Tradeoffs for Hyperbolic Embeddings. ICML (2018)
Anna T. Thomas, Albert Gu, Tri Dao, Atri Rudra, Christopher Ré
Learning Compressed Transforms with Low Displacement Rank. NeurIPS (2018)
Albert Gu, Rohan Puttagunta, Christopher Ré, Atri Rudra
Recurrence Width for Structured Dense Matrix Vector Multiplication. CoRR (2016)
Albert Gu, Anupam Gupta, Amit Kumar
The Power of Deferral: Maintaining a Constant-Competitive Steiner Tree Online. SIAM J. Comput. 45 (1) (2016)
Albert Gu
Sprague-Grundy Values of the $\mathcal{R}$-Wythoff Game. Electron. J. Comb. 22 (2) (2015)
Albert Gu, Anupam Gupta, Amit Kumar
The power of deferral: maintaining a constant-competitive steiner tree online. STOC (2013)
Albert Gu, Anupam Gupta, Amit Kumar
The Power of Deferral: Maintaining a Constant-Competitive Steiner Tree Online. CoRR (2013)