Suriya Gunasekar

Publication Activity (10 Years)

Years Active: 2012-2024
Publications (10 Years): 52

Top Topics

Matrix Factorization

Structural Constraints

Technical Report

Top Venues

Publications

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat S. Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Amit Garg, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Eric Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olatunji Ruwase, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Masahiro Tanaka, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yue Zhang, Yunan Zhang, Xiren Zhou
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone. CoRR (2024)
Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yüksekgönül, Rahee Ghosh Peshawaria, Ranjita Naik, Besmira Nushi
KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval. ICLR (2024)
Ananya Kumar, Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar
How to Fine-Tune Vision Models with SGD. ICLR (2024)
Mert Yüksekgönül, Varun Chandrasekaran, Erik Jones, Suriya Gunasekar, Ranjita Naik, Hamid Palangi, Ece Kamar, Besmira Nushi
Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Models. ICLR (2024)
Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio César Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, Sébastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Yin Tat Lee, Yuanzhi Li
Textbooks Are All You Need. CoRR (2023)
Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, Yin Tat Lee
Textbooks Are All You Need II: phi-1.5 technical report. CoRR (2023)
Mathieu Even, Scott Pesme, Suriya Gunasekar, Nicolas Flammarion
(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability. CoRR (2023)
Mert Yüksekgönül, Varun Chandrasekaran, Erik Jones, Suriya Gunasekar, Ranjita Naik, Hamid Palangi, Ece Kamar, Besmira Nushi
Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Models. CoRR (2023)
Mathieu Even, Scott Pesme, Suriya Gunasekar, Nicolas Flammarion
(S)GD over Diagonal Linear Networks: Implicit bias, Large Stepsizes and Edge of Stability. NeurIPS (2023)
Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yüksekgönül, Rahee Ghosh Peshawaria, Ranjita Naik, Besmira Nushi
KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval. CoRR (2023)
Suriya Gunasekar
Generalization to translation shifts: a study in architectures and augmentations. CoRR (2022)
Yi Zhang, Arturs Backurs, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar, Tal Wagner
Unveiling Transformers with LEGO: a synthetic reasoning task. CoRR (2022)
Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar
Data Augmentation as Feature Manipulation. ICML (2022)
Meena Jagadeesan, Ilya P. Razenshteyn, Suriya Gunasekar
Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm. COLT (2022)
Yunhao Ge, Harkirat S. Behl, Jiashu Xu, Suriya Gunasekar, Neel Joshi, Yale Song, Xin Wang, Laurent Itti, Vibhav Vineet
Neural-Sim: Learning to Generate Training Data with NeRF. CoRR (2022)
Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar
Data Augmentation as Feature Manipulation: a story of desert cows and grass cows. CoRR (2022)
Yunhao Ge, Harkirat S. Behl, Jiashu Xu, Suriya Gunasekar, Neel Joshi, Yale Song, Xin Wang, Laurent Itti, Vibhav Vineet
Neural-Sim: Learning to Generate Training Data with NeRF. ECCV (23) (2022)
Ananya Kumar, Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar
How to Fine-Tune Vision Models with SGD. CoRR (2022)
Meena Jagadeesan, Ilya P. Razenshteyn, Suriya Gunasekar
Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm. CoRR (2021)
Suriya Gunasekar, Blake E. Woodworth, Nathan Srebro
Mirrorless Mirror Descent: A Natural Derivation of Mirror Descent. AISTATS (2021)
Suriya Gunasekar, Blake E. Woodworth, Nathan Srebro
Mirrorless Mirror Descent: A More Natural Discretization of Riemannian Gradient Flow. CoRR (2020)
Yiding Jiang, Parth Natekar, Manik Sharma, Sumukh K. Aithal, Dhruva Kashyap, Natarajan Subramanyam, Carlos Lassance, Daniel M. Roy, Gintare Karolina Dziugaite, Suriya Gunasekar, Isabelle Guyon, Pierre Foret, Scott Yak, Hossein Mobahi, Behnam Neyshabur, Samy Bengio
Methods and Analysis of The First Competition in Predicting Generalization of Deep Learning. NeurIPS (Competition and Demos) (2020)
Blake E. Woodworth, Suriya Gunasekar, Jason D. Lee, Edward Moroshko, Pedro Savarese, Itay Golan, Daniel Soudry, Nathan Srebro
Kernel and Rich Regimes in Overparametrized Models. CoRR (2020)
Xiaoxia Wu, Edgar Dobriban, Tongzheng Ren, Shanshan Wu, Zhiyuan Li, Suriya Gunasekar, Rachel Ward, Qiang Liu
Implicit Regularization and Convergence for Weight Normalization. NeurIPS (2020)
Yiding Jiang, Pierre Foret, Scott Yak, Daniel M. Roy, Hossein Mobahi, Gintare Karolina Dziugaite, Samy Bengio, Suriya Gunasekar, Isabelle Guyon, Behnam Neyshabur
NeurIPS 2020 Competition: Predicting Generalization in Deep Learning. CoRR (2020)
Edward Moroshko, Blake E. Woodworth, Suriya Gunasekar, Jason D. Lee, Nati Srebro, Daniel Soudry
Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy. NeurIPS (2020)
Edward Moroshko, Suriya Gunasekar, Blake E. Woodworth, Jason D. Lee, Nathan Srebro, Daniel Soudry
Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy. CoRR (2020)
Blake E. Woodworth, Suriya Gunasekar, Jason D. Lee, Edward Moroshko, Pedro Savarese, Itay Golan, Daniel Soudry, Nathan Srebro
Kernel and Rich Regimes in Overparametrized Models. COLT (2020)
Mor Shpigel Nacson, Suriya Gunasekar, Jason D. Lee, Nathan Srebro, Daniel Soudry
Lexicographic and Depth-Sensitive Margins in Homogeneous and Non-Homogeneous Deep Models. CoRR (2019)
Mor Shpigel Nacson, Jason D. Lee, Suriya Gunasekar, Pedro Henrique Pamplona Savarese, Nathan Srebro, Daniel Soudry
Convergence of Gradient Descent on Separable Data. AISTATS (2019)
Mor Shpigel Nacson, Suriya Gunasekar, Jason D. Lee, Nathan Srebro, Daniel Soudry
Lexicographic and Depth-Sensitive Margins in Homogeneous and Non-Homogeneous Deep Models. ICML (2019)
Xiaoxia Wu, Edgar Dobriban, Tongzheng Ren, Shanshan Wu, Zhiyuan Li, Suriya Gunasekar, Rachel Ward, Qiang Liu
Implicit Regularization of Normalization Methods. CoRR (2019)
Avrim Blum, Suriya Gunasekar, Thodoris Lykouris, Nati Srebro
On preserving non-discrimination when combining expert advice. NeurIPS (2018)
Suriya Gunasekar, Jason D. Lee, Daniel Soudry, Nati Srebro
Implicit Bias of Gradient Descent on Linear Convolutional Networks. NeurIPS (2018)
Avrim Blum, Suriya Gunasekar, Thodoris Lykouris, Nathan Srebro
On preserving non-discrimination when combining expert advice. CoRR (2018)
Suriya Gunasekar, Blake E. Woodworth, Srinadh Bhojanapalli, Behnam Neyshabur, Nathan Srebro
Implicit Regularization in Matrix Factorization. ITA (2018)
Suriya Gunasekar, Jason D. Lee, Daniel Soudry, Nathan Srebro
Implicit Bias of Gradient Descent on Linear Convolutional Networks. CoRR (2018)
Suriya Gunasekar, Jason D. Lee, Daniel Soudry, Nathan Srebro
Characterizing Implicit Bias in Terms of Optimization Geometry. CoRR (2018)
Suriya Gunasekar, Jason D. Lee, Daniel Soudry, Nathan Srebro
Characterizing Implicit Bias in Terms of Optimization Geometry. ICML (2018)
Daniel Soudry, Elad Hoffer, Mor Shpigel Nacson, Suriya Gunasekar, Nathan Srebro
The Implicit Bias of Gradient Descent on Separable Data. J. Mach. Learn. Res. 19 (2018)
Mor Shpigel Nacson, Jason D. Lee, Suriya Gunasekar, Nathan Srebro, Daniel Soudry
Convergence of Gradient Descent on Separable Data. CoRR (2018)
Suriya Gunasekar, Blake E. Woodworth, Srinadh Bhojanapalli, Behnam Neyshabur, Nathan Srebro
Implicit Regularization in Matrix Factorization. CoRR (2017)
Blake E. Woodworth, Suriya Gunasekar, Mesrob I. Ohannessian, Nathan Srebro
Learning Non-Discriminatory Predictors. COLT (2017)
Blake E. Woodworth, Suriya Gunasekar, Mesrob I. Ohannessian, Nathan Srebro
Learning Non-Discriminatory Predictors. CoRR (2017)
Suriya Gunasekar, Blake E. Woodworth, Srinadh Bhojanapalli, Behnam Neyshabur, Nati Srebro
Implicit Regularization in Matrix Factorization. NIPS (2017)
Shalmali Joshi, Suriya Gunasekar, David A. Sontag, Joydeep Ghosh
Identifiable Phenotyping using Constrained Non-Negative Matrix Factorization. MLHC (2016)
Shalmali Joshi, Suriya Gunasekar, David A. Sontag, Joydeep Ghosh
Identifiable Phenotyping using Constrained Non-Negative Matrix Factorization. CoRR (2016)
Suriya Gunasekar, Oluwasanmi Koyejo, Joydeep Ghosh
Preference Completion from Partial Rankings. CoRR (2016)
Suriya Gunasekar, Oluwasanmi Koyejo, Joydeep Ghosh
Preference Completion from Partial Rankings. NIPS (2016)
Suriya Gunasekar, Makoto Yamada, Dawei Yin, Yi Chang
Consistent Collective Matrix Completion under Joint Low Rank Structure. AISTATS (2015)
Suriya Gunasekar, Pradeep Ravikumar, Joydeep Ghosh
Exponential Family Matrix Completion under Structural Constraints. CoRR (2015)
Suriya Gunasekar, Arindam Banerjee, Joydeep Ghosh
Unified View of Matrix Completion under General Structural Constraints. NIPS (2015)
Suriya Gunasekar, Joydeep Ghosh, Alan C. Bovik
Face Detection on Distorted Images Augmented by Perceptual Quality-Aware Features. IEEE Trans. Inf. Forensics Secur. 9 (12) (2014)
Suriya Gunasekar, Makoto Yamada, Dawei Yin, Yi Chang
Consistent Collective Matrix Completion under Joint Low Rank Structure. CoRR (2014)
Suriya Gunasekar, Joydeep Ghosh, Alan C. Bovik
Face detection on distorted images using perceptual quality-aware features. Human Vision and Electronic Imaging (2014)
Suriya Gunasekar, Pradeep Ravikumar, Joydeep Ghosh
Exponential Family Matrix Completion under Structural Constraints. ICML (2014)
Suriya Gunasekar, Ayan Acharya, Neeraj Gaur, Joydeep Ghosh
Noisy Matrix Completion Using Alternating Minimization. ECML/PKDD (2) (2013)
Sindhu Raghavan, Suriya Gunasekar, Joydeep Ghosh
Review quality aware collaborative filtering. RecSys (2012)