Depen Morwani

Publication Activity (10 Years)

Years Active: 2020-2024
Publications (10 Years): 12

Top Topics

Top Venues

Publications

Depen Morwani, Itai Shapira, Nikhil Vyas, Eran Malach, Sham M. Kakade, Lucas Janson
A New Perspective on Shampoo's Preconditioner. CoRR (2024)
Rosie Zhao, Depen Morwani, David Brandfonbrener, Nikhil Vyas, Sham M. Kakade
Deconstructing What Makes a Good Optimizer for Language Models. CoRR (2024)
Depen Morwani, Benjamin L. Edelman, Costin-Andrei Oncescu, Rosie Zhao, Sham M. Kakade
Feature emergence via margin maximization: case studies in algebraic tasks. ICLR (2024)
Depen Morwani, Jatin Batra, Prateek Jain, Praneeth Netrapalli
Simplicity Bias in 1-Hidden Layer Neural Networks. CoRR (2023)
Nikhil Vyas, Alexander Atanasov, Blake Bordelon, Depen Morwani, Sabarish Sainathan, Cengiz Pehlevan
Feature-Learning Networks Are Consistent Across Widths At Realistic Scales. CoRR (2023)
Nikhil Vyas, Depen Morwani, Rosie Zhao, Gal Kaplun, Sham M. Kakade, Boaz Barak
Beyond Implicit Bias: The Insignificance of SGD Noise in Online Learning. CoRR (2023)
Depen Morwani, Benjamin L. Edelman, Costin-Andrei Oncescu, Rosie Zhao, Sham M. Kakade
Feature emergence via margin maximization: case studies in algebraic tasks. CoRR (2023)
Nikhil Vyas, Alexander Atanasov, Blake Bordelon, Depen Morwani, Sabarish Sainathan, Cengiz Pehlevan
Feature-Learning Networks Are Consistent Across Widths At Realistic Scales. NeurIPS (2023)
Depen Morwani, Jatin Batra, Prateek Jain, Praneeth Netrapalli
Simplicity Bias in 1-Hidden Layer Neural Networks. NeurIPS (2023)
Depen Morwani, Harish G. Ramaswamy
Inductive Bias of Gradient Descent for Weight Normalized Smooth Homogeneous Neural Nets. ALT (2022)
Depen Morwani, Rahul Vashisht, Harish G. Ramaswamy
Using noise resilience for ranking generalization of deep neural networks. CoRR (2020)
Depen Morwani, Harish G. Ramaswamy
Inductive Bias of Gradient Descent for Exponentially Weight Normalized Smooth Homogeneous Neural Nets. CoRR (2020)