Atri Rudra

ORCID

Publication Activity (10 Years)

Years Active: 2001-2024
Publications (10 Years): 66

Top Venues

Publications

Simran Arora, Sabri Eyuboglu, Michael Zhang, Aman Timalsina, Silas Alberti, Dylan Zinsley, James Zou, Atri Rudra, Christopher Ré
Simple linear attention language models balance the recall-throughput tradeoff. CoRR (2024)
Simran Arora, Aman Timalsina, Aaryan Singhal, Benjamin Spector, Sabri Eyuboglu, Xinyi Zhao, Ashish Rao, Atri Rudra, Christopher Ré
Just read twice: closing the recall gap for recurrent language models. CoRR (2024)
Simran Arora, Sabri Eyuboglu, Aman Timalsina, Isys Johnson, Michael Poli, James Zou, Atri Rudra, Christopher Ré
Zoology: Measuring and Improving Recall in Efficient Language Models. ICLR (2024)
Daniel Y. Fu, Elliot L. Epstein, Eric Nguyen, Armin W. Thomas, Michael Zhang, Tri Dao, Atri Rudra, Christopher Ré
Simple Hardware-Efficient Long Convolutions for Sequence Modeling. ICML (2023)
Stefano Massaroli, Michael Poli, Daniel Y. Fu, Hermann Kumbong, Rom N. Parnichkun, Aman Timalsina, David W. Romero, Quinn McIntyre, Beidi Chen, Atri Rudra, Ce Zhang, Christopher Ré, Stefano Ermon, Yoshua Bengio
Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions. CoRR (2023)
Simran Arora, Sabri Eyuboglu, Aman Timalsina, Isys Johnson, Michael Poli, James Zou, Atri Rudra, Christopher Ré
Zoology: Measuring and Improving Recall in Efficient Language Models. CoRR (2023)
Atri Rudra
Technical Perspective: (Pre-) Semirings Come to the Recursion Party. SIGMOD Rec. 52 (1) (2023)
Stacy A. Doore, Atri Rudra, Omowumi Ogunyemi, Trystan S. Goetze, Mehran Sahami, Thomas J. Cortina, Kiran Bhardwaj, Crystal Lee
Teaching Responsible Computing in Context: Models, Practices, and Tools. SIGCSE (2) (2023)
Daniel Y. Fu, Tri Dao, Khaled Kamal Saab, Armin W. Thomas, Atri Rudra, Christopher Ré
Hungry Hungry Hippos: Towards Language Modeling with State Space Models. ICLR (2023)
Albert Gu, Isys Johnson, Aman Timalsina, Atri Rudra, Christopher Ré
How to Train your HIPPO: State Space Models with Generalized Orthogonal Basis Projections. ICLR (2023)
Elvira Mayordomo, Mitsunori Ogihara, Atri Rudra
Foreword: a Commemorative Issue for Alan L. Selman. Theory Comput. Syst. 67 (3) (2023)
Daniel Y. Fu, Simran Arora, Jessica Grogan, Isys Johnson, Evan Sabri Eyuboglu, Armin W. Thomas, Benjamin Spector, Michael Poli, Atri Rudra, Christopher Ré
Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture. NeurIPS (2023)
Atri Rudra
Arithmetic Circuits, Structured Matrices and (not so) Deep Learning. Theory Comput. Syst. 67 (3) (2023)
Daniel Y. Fu, Elliot L. Epstein, Eric Nguyen, Armin W. Thomas, Michael Zhang, Tri Dao, Atri Rudra, Christopher Ré
Simple Hardware-Efficient Long Convolutions for Sequence Modeling. CoRR (2023)
Daniel Y. Fu, Simran Arora, Jessica Grogan, Isys Johnson, Sabri Eyuboglu, Armin W. Thomas, Benjamin Spector, Michael Poli, Atri Rudra, Christopher Ré
Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture. CoRR (2023)
Stefano Massaroli, Michael Poli, Daniel Y. Fu, Hermann Kumbong, Rom N. Parnichkun, David W. Romero, Aman Timalsina, Quinn McIntyre, Beidi Chen, Atri Rudra, Ce Zhang, Christopher Ré, Stefano Ermon, Yoshua Bengio
Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions. NeurIPS (2023)
Tri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra, Christopher Ré
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness. NeurIPS (2022)
Su Feng, Boris Glavic, Aaron Huber, Oliver Kennedy, Atri Rudra
Computing expected multiplicities for bag-TIDBs with bounded multiplicities. CoRR (2022)
Beidi Chen, Tri Dao, Kaizhao Liang, Jiaming Yang, Zhao Song, Atri Rudra, Christopher Ré
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models. ICLR (2022)
Jaroslaw Blasiok, Venkatesan Guruswami, Preetum Nakkiran, Atri Rudra, Madhu Sudan
General Strong Polarization. J. ACM 69 (2) (2022)
Albert Gu, Isys Johnson, Aman Timalsina, Atri Rudra, Christopher Ré
How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections. CoRR (2022)
Tri Dao, Beidi Chen, Nimit Sharad Sohoni, Arjun D. Desai, Michael Poli, Jessica Grogan, Alexander Liu, Aniruddh Rao, Atri Rudra, Christopher Ré
Monarch: Expressive Structured Matrices for Efficient and Accurate Training. ICML (2022)
Tri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra, Christopher Ré
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness. CoRR (2022)
Tri Dao, Daniel Y. Fu, Khaled Kamal Saab, Armin W. Thomas, Atri Rudra, Christopher Ré
Hungry Hungry Hippos: Towards Language Modeling with State Space Models. CoRR (2022)
Atri Rudra
Arithmetic Circuits, Structured Matrices and (not so) Deep Learning. CoRR (2022)
Tri Dao, Beidi Chen, Nimit Sharad Sohoni, Arjun D. Desai, Michael Poli, Jessica Grogan, Alexander Liu, Aniruddh Rao, Atri Rudra, Christopher Ré
Monarch: Expressive Structured Matrices for Efficient and Accurate Training. CoRR (2022)
Kenneth Joseph, Huei-Yen Winnie Chen, Stefania Ionescu, Yuhao Du, Pranav Sankhe, Aniko Hannak, Atri Rudra
A qualitative, network-centric method for modeling socio-technical systems, with applications to evaluating interventions on social media platforms to increase social equality. Appl. Netw. Sci. 7 (1) (2022)
Albert Gu, Isys Johnson, Karan Goel, Khaled Saab, Tri Dao, Atri Rudra, Christopher Ré
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State Space Layers. NeurIPS (2021)
Beidi Chen, Tri Dao, Eric Winsor, Zhao Song, Atri Rudra, Christopher Ré
Scatterbrain: Unifying Sparse and Low-rank Attention. NeurIPS (2021)
Sai Vikneshwar Mani Jayaraman, Corey Ropell, Atri Rudra
Constraints. CoRR (2021)
Beidi Chen, Tri Dao, Eric Winsor, Zhao Song, Atri Rudra, Christopher Ré
Scatterbrain: Unifying Sparse and Low-rank Attention Approximation. CoRR (2021)
Albert Gu, Isys Johnson, Karan Goel, Khaled Saab, Tri Dao, Atri Rudra, Christopher Ré
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layers. CoRR (2021)
Beidi Chen, Tri Dao, Kaizhao Liang, Jiaming Yang, Zhao Song, Atri Rudra, Christopher Ré
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models. CoRR (2021)
Shi Li, Sai Vikneshwar Mani Jayaraman, Atri Rudra
Covering the Relational Join. CoRR (2020)
Albert Gu, Tri Dao, Stefano Ermon, Atri Rudra, Christopher Ré
HiPPO: Recurrent Memory with Optimal Polynomial Projections. NeurIPS (2020)
Tri Dao, Nimit Sharad Sohoni, Albert Gu, Matthew Eichhorn, Amit Blonder, Megan Leszczynski, Atri Rudra, Christopher Ré
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps. CoRR (2020)
Tri Dao, Nimit Sharad Sohoni, Albert Gu, Matthew Eichhorn, Amit Blonder, Megan Leszczynski, Atri Rudra, Christopher Ré
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps. ICLR (2020)
Anna C. Gilbert, Albert Gu, Christopher Ré, Atri Rudra, Mary Wootters
Sparse Recovery for Orthogonal Polynomial Transforms. ICALP (2020)
Albert Gu, Tri Dao, Stefano Ermon, Atri Rudra, Christopher Ré
HiPPO: Recurrent Memory with Optimal Polynomial Projections. CoRR (2020)
Michael Langberg, Shi Li, Sai Vikneshwar Mani Jayaraman, Atri Rudra
Topology Dependent Bounds For FAQs. CoRR (2020)
Tri Dao, Albert Gu, Matthew Eichhorn, Atri Rudra, Christopher Ré
Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations. CoRR (2019)
Tri Dao, Albert Gu, Matthew Eichhorn, Atri Rudra, Christopher Ré
Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations. ICML (2019)
Anna C. Gilbert, Albert Gu, Christopher Ré, Atri Rudra, Mary Wootters
Sparse Recovery for Orthogonal Polynomial Transforms. CoRR (2019)
Michael Langberg, Shi Li, Sai Vikneshwar Mani Jayaraman, Atri Rudra
Topology Dependent Bounds For FAQs. PODS (2019)
Aarthy Shivram Arun, Sai Vikneshwar Mani Jayaraman, Christopher Ré, Atri Rudra
Hypertree Decompositions Revisited for PGMs. CoRR (2018)
Christopher De Sa, Albert Gu, Rohan Puttagunta, Christopher Ré, Atri Rudra
A Two-pronged Progress in Structured Dense Matrix Vector Multiplication. SODA (2018)
Anna T. Thomas, Albert Gu, Tri Dao, Atri Rudra, Christopher Ré
Learning Invariance with Compact Transforms. ICLR (Workshop) (2018)
Atri Rudra, Mary Wootters
Average-radius list-recoverability of random linear codes. SODA (2018)
Anna T. Thomas, Albert Gu, Tri Dao, Atri Rudra, Christopher Ré
Learning Compressed Transforms with Low Displacement Rank. CoRR (2018)
Jaroslaw Blasiok, Venkatesan Guruswami, Preetum Nakkiran, Atri Rudra, Madhu Sudan
General Strong Polarization. Electron. Colloquium Comput. Complex. 25 (2018)
Aarthy Shivram Arun, Sai Vikneshwar Mani Jayaraman, Christopher Ré, Atri Rudra
Hypertree Decompositions Revisited for PGMs. CoRR (2018)
Jaroslaw Blasiok, Venkatesan Guruswami, Preetum Nakkiran, Atri Rudra, Madhu Sudan
General Strong Polarization. CoRR (2018)
Jaroslaw Blasiok, Venkatesan Guruswami, Preetum Nakkiran, Atri Rudra, Madhu Sudan
General strong polarization. STOC (2018)
Anna T. Thomas, Albert Gu, Tri Dao, Atri Rudra, Christopher Ré
Learning Compressed Transforms with Low Displacement Rank. NeurIPS (2018)
Hung Q. Ngo, Ely Porat, Christopher Ré, Atri Rudra
Worst-case Optimal Join Algorithms. J. ACM 65 (3) (2018)
Atri Rudra
Answering FAQs in CSPs, probabilistic graphical models, databases, logic and matrix operations (invited talk). STOC (2017)
Arkadev Chattopadhyay, Michael Langberg, Shi Li, Atri Rudra
Tight Network Topology Dependent Bounds on Rounds of Communication. SODA (2017)
Mahmoud Abo Khamis, Hung Q. Ngo, Atri Rudra
Juggling Functions Inside a Database. CoRR (2017)
Jimmy Dobler, Atri Rudra
Implementation of Tetris as a Model Counter. CoRR (2017)
Atri Rudra, Mary Wootters
Average-radius list-recovery of random linear codes: it really ties the room together. CoRR (2017)
Mahmoud Abo Khamis, Hung Q. Ngo, Atri Rudra
Juggling Functions Inside a Database. SIGMOD Rec. 46 (1) (2017)
Mahmoud Abo Khamis, Hung Q. Ngo, Atri Rudra
FAQ: Questions Asked Frequently. PODS (2016)
Albert Gu, Rohan Puttagunta, Christopher Ré, Atri Rudra
Recurrence Width for Structured Dense Matrix Vector Multiplication. CoRR (2016)
Arkadev Chattopadhyay, Michael Langberg, Shi Li, Atri Rudra
Tight Network Topology Dependent Bounds on Rounds of Communication. CoRR (2016)
Arkadev Chattopadhyay, Michael Langberg, Shi Li, Atri Rudra
Tight Network Topology Dependent Bounds on Rounds of Communication. Electron. Colloquium Comput. Complex. 23 (2016)
Mahmoud Abo Khamis, Hung Q. Ngo, Christopher Ré, Atri Rudra
Joins via Geometric Resolutions: Worst Case and Beyond. ACM Trans. Database Syst. 41 (4) (2016)
Mahmoud Abo Khamis, Hung Q. Ngo, Atri Rudra
FAQ: Questions Asked Frequently. CoRR (2015)
Atri Rudra, Mary Wootters
It'll Probably Work Out: Improved List-Decoding Through Random Operations. ITCS (2015)
Dung T. Nguyen, Molham Aref, Martin Bravenboer, George Kollias, Hung Q. Ngo, Christopher Ré, Atri Rudra
Join Processing for Graph Patterns: An Old Dog with New Tricks. GRADES@SIGMOD/PODS (2015)
Jesse Hartloff, Matthew Morse, Bingsheng Zhang, Thomas Effland, Jennifer Cordaro, Jim Schuler, Sergey Tulyakov, Atri Rudra, Venu Govindaraju
A multiple server scheme for fingerprint fuzzy vaults. CVPR Workshops (2015)
Arkadev Chattopadhyay, Atri Rudra
The Range of Topological Effects on Communication. CoRR (2015)
Arkadev Chattopadhyay, Atri Rudra
The Range of Topological Effects on Communication. ICALP (2) (2015)
Dung T. Nguyen, Molham Aref, Martin Bravenboer, George Kollias, Hung Q. Ngo, Christopher Ré, Atri Rudra
Join Processing for Graph Patterns: An Old Dog with New Tricks. CoRR (2015)
Mahmoud Abo Khamis, Hung Q. Ngo, Christopher Ré, Atri Rudra
Joins via Geometric Resolutions: Worst-case and Beyond. PODS (2015)
Mohammad Iftekhar Husain, Steven Y. Ko, Steve Uurtamo, Atri Rudra, Ramalingam Sridhar
Bidirectional data verification for cloud storage. J. Netw. Comput. Appl. 45 (2014)
Atri Rudra, Mary Wootters
Every list-decodable code for high noise has abundant near-optimal rate puncturings. STOC (2014)
Matthew Morse, Jesse Hartloff, Thomas Effland, Jim Schuler, Jennifer Cordaro, Sergey Tulyakov, Atri Rudra, Venu Govindaraju
Secure Fingerprint Matching with Generic Local Structures. CVPR Workshops (2014)
Atri Rudra, Mary Wootters
It'll probably work out: improved list-decoding through random operations. CoRR (2014)
Mahmoud Abo Khamis, Hung Q. Ngo, Christopher Ré, Atri Rudra
Joins via Geometric Resolutions: Worst-case and Beyond. CoRR (2014)
Mahmoud Abo Khamis, Anna C. Gilbert, Hung Q. Ngo, Atri Rudra
Sparse Approximation, List Decoding, and Uncertainty Principles. CoRR (2014)
Atri Rudra, Mary Wootters
It'll probably work out: improved list-decoding through random operations. Electron. Colloquium Comput. Complex. 21 (2014)
Hung Q. Ngo, Dung T. Nguyen, Christopher Ré, Atri Rudra
Beyond worst-case analysis for joins with minesweeper. PODS (2014)
Arkadev Chattopadhyay, Jaikumar Radhakrishnan, Atri Rudra
Topology Matters in Communication. FOCS (2014)
Arkadev Chattopadhyay, Jaikumar Radhakrishnan, Atri Rudra
Topology matters in communication. Electron. Colloquium Comput. Complex. 21 (2014)
Swapnoneel Roy, Atri Rudra, Akshat Verma
Energy Aware Algorithmic Engineering. MASCOTS (2014)
Denisa Duma, Mary Wootters, Anna C. Gilbert, Hung Q. Ngo, Atri Rudra, Matthew Alpert, Timothy J. Close, Gianfranco Ciardo, Stefano Lonardi
Accurate Decoding of Pooled Sequenced Data Using Compressed Sensing. WABI (2013)
Hung Q. Ngo, Dung T. Nguyen, Christopher Ré, Atri Rudra
Towards Instance Optimal Join Algorithms for Data in Indexes CoRR (2013)
Hung Q. Ngo, Christopher Ré, Atri Rudra
Skew Strikes Back: New Developments in the Theory of Join Algorithms. CoRR (2013)
Swapnoneel Roy, Atri Rudra, Akshat Verma
An energy complexity model for algorithms. ITCS (2013)
Anna C. Gilbert, Hung Q. Ngo, Ely Porat, Atri Rudra, Martin J. Strauss
ℓ2/ℓ2-Foreach Sparse Recovery with Low Risk. ICALP (1) (2013)
Atri Rudra, Mary Wootters
Every list-decodable code for high noise has abundant near-optimal rate puncturings. Electron. Colloquium Comput. Complex. 20 (2013)
Alexandr Andoni, Atri Rudra
Special Issue: APPROX-RANDOM 2012: Guest Editors' Foreword. Theory Comput. 9 (2013)
Ning Chen, Roee Engelberg, C. Thach Nguyen, Prasad Raghavendra, Atri Rudra, Gyanit Singh
Improved Approximation Algorithms for the Spanning Star Forest Problem. Algorithmica 65 (3) (2013)
Anna C. Gilbert, Hung Q. Ngo, Ely Porat, Atri Rudra, Martin J. Strauss
L2/L2-foreach sparse recovery with low risk CoRR (2013)
Jesse Hartloff, Jimmy Dobler, Sergey Tulyakov, Atri Rudra, Venu Govindaraju
Towards fingerprints as strings: Secure indexing for fingerprint matching. ICB (2013)
Atri Rudra, Mary Wootters
Every list-decodable code for high noise has abundant near-optimal rate puncturings. CoRR (2013)
Hung Q. Ngo, Christopher Ré, Atri Rudra
Skew strikes back: new developments in the theory of join algorithms. SIGMOD Rec. 42 (4) (2013)
Anna C. Gilbert, Brett Hemenway, Atri Rudra, Martin J. Strauss, Mary Wootters
Recovering simple signals. ITA (2012)
Mohammad Iftekhar Husain, Steven Y. Ko, Atri Rudra, Steve Uurtamo
Almost Universal Hash Families are also Storage Enforcing CoRR (2012)
Charanjit S. Jutla, Vijay Kumar, Atri Rudra
On the Circuit Complexity of Composite Galois Field Transformations. Electron. Colloquium Comput. Complex. 19 (2012)

Atri Rudra.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Atri Rudra