Yuanzhi Li

ORCID

Publication Activity (10 Years)

Years Active: 2007-2024
Publications (10 Years): 193

Top Venues

Publications

Sitan Chen, Yuanzhi Li
Provably learning a multi-head attention layer. CoRR (2024)
Tian Ye, Zicheng Xu, Yuanzhi Li, Zeyuan Allen-Zhu
Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process. CoRR (2024)
Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat S. Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Amit Garg, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Eric Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olatunji Ruwase, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Masahiro Tanaka, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yue Zhang, Yunan Zhang, Xiren Zhou
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone. CoRR (2024)
Ahmet Cagri Duzgun, Samy Jelassi, Yuanzhi Li
How Does Overparameterization Affect Features? CoRR (2024)
Yue Wu, Xuan Tang, Tom M. Mitchell, Yuanzhi Li
SmartPlay : A Benchmark for LLMs as Intelligent Agents. ICLR (2024)
Aakash Lahoti, Stefani Karp, Ezra Winston, Aarti Singh, Yuanzhi Li
Role of Locality and Weight Sharing in Image-Based Tasks: A Sample Complexity Separation between CNNs, LCNs, and FCNs. ICLR (2024)
Ruiqian Nai, Zixin Wen, Ji Li, Yuanzhi Li, Yang Gao
Revisiting Disentanglement in Downstream Tasks: A Study on Its Necessity for Abstract Visual Reasoning. AAAI (2024)
Yue Wu, Yewen Fan, So Yeon Min, Shrimai Prabhumoye, Stephen McAleer, Yonatan Bisk, Ruslan Salakhutdinov, Yuanzhi Li, Tom M. Mitchell
AgentKit: Flow Engineering with Graphs, not Coding. CoRR (2024)
Ruiqian Nai, Zixin Wen, Ji Li, Yuanzhi Li, Yang Gao
Revisiting Disentanglement in Downstream Tasks: A Study on Its Necessity for Abstract Visual Reasoning. CoRR (2024)
Zeyuan Allen-Zhu, Yuanzhi Li
Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws. CoRR (2024)
Junpeng Liu, Yifan Song, Bill Yuchen Lin, Wai Lam, Graham Neubig, Yuanzhi Li, Xiang Yue
VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding? CoRR (2024)
Zixiang Chen, Yihe Deng, Yuanzhi Li, Quanquan Gu
Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP. ICLR (2024)
Aakash Lahoti, Stefani Karp, Ezra Winston, Aarti Singh, Yuanzhi Li
Role of Locality and Weight Sharing in Image-Based Tasks: A Sample Complexity Separation between CNNs, LCNs, and FCNs. CoRR (2024)
Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio César Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, Sébastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Yin Tat Lee, Yuanzhi Li
Textbooks Are All You Need. CoRR (2023)
Zeyuan Allen-Zhu, Yuanzhi Li
Physics of Language Models: Part 3.2, Knowledge Manipulation. CoRR (2023)
Dhruv Malik, Conor Igoe, Yuanzhi Li, Aarti Singh
Weighted Tallying Bandits: Overcoming Intractability via Repeated Exposure Optimality. ICML (2023)
Difan Zou, Yuan Cao, Yuanzhi Li, Quanquan Gu
The Benefits of Mixup for Feature Learning. ICML (2023)
Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, Yin Tat Lee
Textbooks Are All You Need II: phi-1.5 technical report. CoRR (2023)
Qinsheng Hou, Wenrui Diao, Yanhao Wang, Chenglin Mao, Lingyun Ying, Song Liu, Xiaofeng Liu, Yuanzhi Li, Shanqing Guo, Meining Nie, Haixin Duan
Can We Trust the Phone Vendors? Comprehensive Security Measurements on the Android Firmware Ecosystem. IEEE Trans. Software Eng. 49 (7) (2023)
Zeyuan Allen-Zhu, Yuanzhi Li
Backward Feature Correction: How Deep Learning Performs Deep (Hierarchical) Learning. COLT (2023)
Ruoqi Shen, Sébastien Bubeck, Ronen Eldan, Yin Tat Lee, Yuanzhi Li, Yi Zhang
Positional Description Matters for Transformers Arithmetic. CoRR (2023)
Michael Santacroce, Yadong Lu, Han Yu, Yuanzhi Li, Yelong Shen
Efficient RLHF: Reducing the Memory Usage of PPO. CoRR (2023)
Michael Santacroce, Zixin Wen, Yelong Shen, Yuanzhi Li
What Matters In The Structured Pruning of Generative Language Models? CoRR (2023)
Samy Jelassi, Stéphane d'Ascoli, Carles Domingo-Enrich, Yuhuai Wu, Yuanzhi Li, François Charton
Length Generalization in Arithmetic Transformers. CoRR (2023)
Zixiang Chen, Yihe Deng, Yuanzhi Li, Quanquan Gu
Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP. CoRR (2023)
Difan Zou, Yuan Cao, Yuanzhi Li, Quanquan Gu
Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization. ICLR (2023)
Yuchen Li, Yuanzhi Li, Andrej Risteski
How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding. ICML (2023)
Eric Luxenberg, Dhruv Malik, Yuanzhi Li, Aarti Singh, Stephen P. Boyd
Specifying and Solving Robust Empirical Risk Minimization Problems Using CVXPY. CoRR (2023)
Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott M. Lundberg, Harsha Nori, Hamid Palangi, Marco Túlio Ribeiro, Yi Zhang
Sparks of Artificial General Intelligence: Early experiments with GPT-4. CoRR (2023)
Sébastien Bubeck, Yin Tat Lee, Yuanzhi Li, Mark Sellke
Competitively Chasing Convex Bodies. SIAM J. Comput. 52 (1) (2023)
Sitan Chen, Sinho Chewi, Holden Lee, Yuanzhi Li, Jianfeng Lu, Adil Salim
The probability flow ODE is provably fast. CoRR (2023)
Dhruv Malik, Conor Igoe, Yuanzhi Li, Aarti Singh
Weighted Tallying Bandits: Overcoming Intractability via Repeated Exposure Optimality. CoRR (2023)
Zeyuan Allen-Zhu, Yuanzhi Li
Forward Super-Resolution: How Can GANs Learn Hierarchical Generative Models for Real-World Distributions. ICLR (2023)
Yan Pan, Yuanzhi Li
Toward Understanding Why Adam Converges Faster Than SGD for Transformers. CoRR (2023)
Binghui Li, Yuanzhi Li
Why Clean Generalization and Robust Overfitting Both Happen in Adversarial Training. CoRR (2023)
Sitan Chen, Sinho Chewi, Holden Lee, Yuanzhi Li, Jianfeng Lu, Adil Salim
The probability flow ODE is provably fast. NeurIPS (2023)
Yuan Cao, Difan Zou, Yuanzhi Li, Quanquan Gu
The Implicit Bias of Batch Normalization in Linear Models and Two-layer Linear Convolutional Neural Networks. COLT (2023)
Ronen Eldan, Yuanzhi Li
TinyStories: How Small Can Language Models Be and Still Speak Coherent English? CoRR (2023)
Zeyuan Allen-Zhu, Yuanzhi Li
Physics of Language Models: Part 1, Context-Free Grammar. CoRR (2023)
Harsha Nori, Yin Tat Lee, Sheng Zhang, Dean Carignan, Richard Edgar, Nicolò Fusi, Nicholas King, Jonathan Larson, Yuanzhi Li, Weishung Liu, Renqian Luo, Scott Mayer McKinney, Robert Osazuwa Ness, Hoifung Poon, Tao Qin, Naoto Usuyama, Chris White, Eric Horvitz
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine. CoRR (2023)
Bingbin Liu, Sébastien Bubeck, Ronen Eldan, Janardhan Kulkarni, Yuanzhi Li, Anh Nguyen, Rachel Ward, Yi Zhang
TinyGSM: achieving >80% on GSM8k with small language models. CoRR (2023)
Yue Wu, Yewen Fan, Paul Pu Liang, Amos Azaria, Yuanzhi Li, Tom M. Mitchell
Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals. CoRR (2023)
Yuan Cao, Difan Zou, Yuanzhi Li, Quanquan Gu
The Implicit Bias of Batch Normalization in Linear Models and Two-layer Linear Convolutional Neural Networks. CoRR (2023)
Yuanzhi Li, Raghu Meka, Rina Panigrahy, Kulin Shah
Simple Mechanisms for Representing, Indexing and Manipulating Concepts. CoRR (2023)
Zeyuan Allen Zhu, Yuanzhi Li
Physics of Language Models: Part 3.1, Knowledge Storage and Extraction. CoRR (2023)
Yue Wu, Shrimai Prabhumoye, So Yeon Min, Yonatan Bisk, Ruslan Salakhutdinov, Amos Azaria, Tom M. Mitchell, Yuanzhi Li
SPRING: GPT-4 Out-performs RL Algorithms by Studying Papers and Reasoning. CoRR (2023)
Kaiqi Jiang, Dhruv Malik, Yuanzhi Li
How Does Adaptive Optimization Impact Local Neural Network Geometry? NeurIPS (2023)
Yunwei Ren, Yuanzhi Li
On the Importance of Contrastive Loss in Multimodal Learning. CoRR (2023)
Difan Zou, Yuan Cao, Yuanzhi Li, Quanquan Gu
The Benefits of Mixup for Feature Learning. CoRR (2023)
Yuchen Li, Yuanzhi Li, Andrej Risteski
How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding. CoRR (2023)
Yue Wu, Xuan Tang, Tom M. Mitchell, Yuanzhi Li
SmartPlay : A Benchmark for LLMs as Intelligent Agents. CoRR (2023)
Yue Wu, Yewen Fan, Paul Pu Liang, Amos Azaria, Yuanzhi Li, Tom M. Mitchell
Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals. NeurIPS (2023)
Yue Wu, So Yeon Min, Shrimai Prabhumoye, Yonatan Bisk, Russ Salakhutdinov, Amos Azaria, Tom M. Mitchell, Yuanzhi Li
SPRING: Studying Papers and Reasoning to play Games. NeurIPS (2023)
Yue Wu, So Yeon Min, Yonatan Bisk, Ruslan Salakhutdinov, Amos Azaria, Yuanzhi Li, Tom M. Mitchell, Shrimai Prabhumoye
Plan, Eliminate, and Track - Language Models are Good Teachers for Embodied Agents. CoRR (2023)
Shuyu Zhang, Shangran Xie, Yuanzhi Li, Mengqi Yuan, Xinming Qian
Detection of Gas Pipeline Leakage Using Distributed Optical Fiber Sensors: Multi-Physics Analysis of Leakage-Fiber Coupling Mechanism in Soil Environment. Sensors 23 (12) (2023)
Zeyuan Allen-Zhu, Yuanzhi Li
Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning. ICLR (2023)
Sitan Chen, Jerry Li, Yuanzhi Li, Anru R. Zhang
Learning Polynomial Transformations via Generalized Tensor Decompositions. STOC (2023)
Sitan Chen, Sinho Chewi, Jerry Li, Yuanzhi Li, Adil Salim, Anru Zhang
Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions. ICLR (2023)
Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka
Minimax Optimality (Probably) Doesn't Imply Distribution Learning for GANs. CoRR (2022)
Samy Jelassi, Yuanzhi Li
Towards understanding how momentum improves generalization in deep learning. CoRR (2022)
Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen
LoRA: Low-Rank Adaptation of Large Language Models. ICLR (2022)
Zixiang Chen, Yihe Deng, Yue Wu, Quanquan Gu, Yuanzhi Li
Towards Understanding Mixture of Experts in Deep Learning. CoRR (2022)
Qinsheng Hou, Wenrui Diao, Yanhao Wang, Xiaofeng Liu, Song Liu, Lingyun Ying, Shanqing Guo, Yuanzhi Li, Meining Nie, Haixin Duan
Large-scale Security Measurements on the Android Firmware Ecosystem. ICSE (2022)
Zeyuan Allen-Zhu, Yuanzhi Li
Feature Purification: How Adversarial Training Performs Robust Deep Learning. FOCS (2022)
Samy Jelassi, David Dobre, Arthur Mensch, Yuanzhi Li, Gauthier Gidel
Dissecting adaptive methods in GANs. CoRR (2022)
Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka
Minimax Optimality (Probably) Doesn't Imply Distribution Learning for GANs. ICLR (2022)
Samy Jelassi, Michael E. Sander, Yuanzhi Li
Vision Transformers provably learn spatial structure. CoRR (2022)
Sitan Chen, Sinho Chewi, Jerry Li, Yuanzhi Li, Adil Salim, Anru R. Zhang
Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions. CoRR (2022)
Samy Jelassi, Michael E. Sander, Yuanzhi Li
Vision Transformers provably learn spatial structure. NeurIPS (2022)
Zixin Wen, Yuanzhi Li
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning. CoRR (2022)
Dhruv Malik, Yuanzhi Li, Aarti Singh
Complete Policy Regret Bounds for Tallying Bandits. CoRR (2022)
Sitan Chen, Jerry Li, Yuanzhi Li, Anru R. Zhang
Learning Polynomial Transformations. CoRR (2022)
Sitan Chen, Jerry Li, Yuanzhi Li
Learning (Very) Simple Generative Models Is Hard. CoRR (2022)
Zixiang Chen, Yihe Deng, Yue Wu, Quanquan Gu, Yuanzhi Li
Towards Understanding the Mixture-of-Experts Layer in Deep Learning. NeurIPS (2022)
Zixin Wen, Yuanzhi Li
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning. NeurIPS (2022)
Yuanzhi Li, Ruosong Wang, Lin F. Yang
Settling the Horizon-Dependence of Sample Complexity in Reinforcement Learning. FOCS (2022)
Dhruv Malik, Yuanzhi Li, Aarti Singh
Complete Policy Regret Bounds for Tallying Bandits. COLT (2022)
Samy Jelassi, Yuanzhi Li
Towards understanding how momentum improves generalization in deep learning. ICML (2022)
Kaiqi Jiang, Dhruv Malik, Yuanzhi Li
How Does Adaptive Optimization Impact Local Neural Network Geometry? CoRR (2022)
Sitan Chen, Jerry Li, Yuanzhi Li
Learning (Very) Simple Generative Models Is Hard. NeurIPS (2022)
Stefani Karp, Ezra Winston, Yuanzhi Li, Aarti Singh
Local Signal Adaptivity: Provable Feature Learning in Neural Networks Beyond Kernels. NeurIPS (2021)
Dhruv Malik, Aldo Pacchiano, Vishwak Srinivasan, Yuanzhi Li
Sample Efficient Reinforcement Learning In Continuous State Spaces: A Perspective Beyond Linearity. ICML (2021)
Yuanzhi Li, Ruosong Wang, Lin F. Yang
Settling the Horizon-Dependence of Sample Complexity in Reinforcement Learning. CoRR (2021)
Zehao Dou, Yuanzhi Li
On the One-sided Convergence of Adam-type Algorithms in Non-convex Non-concave Min-max Optimization. CoRR (2021)
Jeremy M. Cohen, Simran Kaur, Yuanzhi Li, J. Zico Kolter, Ameet Talwalkar
Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability. CoRR (2021)
Dhruv Malik, Yuanzhi Li, Pradeep Ravikumar
When Is Generalizable Reinforcement Learning Tractable? NeurIPS (2021)
Zeyuan Allen-Zhu, Yuanzhi Li, Aarti Singh, Yining Wang
Near-optimal discrete optimization for experimental design: a regret minimization approach. Math. Program. 186 (1) (2021)
Difan Zou, Yuan Cao, Yuanzhi Li, Quanquan Gu
Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization. CoRR (2021)
Komal Dhull, Jingyan Wang, Nihar B. Shah, Yuanzhi Li, R. Ravi
A heuristic for statistical seriation. UAI (2021)
Haojie Wang, Jidong Zhai, Mingyu Gao, Zixuan Ma, Shizhi Tang, Liyan Zheng, Yuanzhi Li, Kaiyuan Rong, Yuanyong Chen, Zhihao Jia
PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections. OSDI (2021)
Zeyuan Allen-Zhu, Yuanzhi Li
Forward Super-Resolution: How Can GANs Learn Hierarchical Generative Models for Real-World Distributions. CoRR (2021)
Zixin Wen, Yuanzhi Li
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning. CoRR (2021)
Dhruv Malik, Aldo Pacchiano, Vishwak Srinivasan, Yuanzhi Li
Sample Efficient Reinforcement Learning In Continuous State Spaces: A Perspective Beyond Linearity. CoRR (2021)
Zeyuan Allen-Zhu, Yuanzhi Li
Feature Purification: How Adversarial Training Performs Robust Deep Learning. FOCS (2021)
Yuanzhi Li, Ruosong Wang, Lin F. Yang
Settling the Horizon-Dependence of Sample Complexity in Reinforcement Learning. FOCS (2021)
Lei Li, Lei Wang, Yuanzhi Li, Jie Sheng
Mixed Deep Reinforcement Learning-behavior Tree for Intelligent Agents Design. ICAART (1) (2021)
Zixin Wen, Yuanzhi Li
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning. ICML (2021)
Jeremy M. Cohen, Simran Kaur, Yuanzhi Li, J. Zico Kolter, Ameet Talwalkar
Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability. ICLR (2021)
Sébastien Bubeck, Yuanzhi Li, Dheeraj M. Nagaraj
A Law of Robustness for Two-Layers Neural Networks. COLT (2021)
Dhruv Malik, Yuanzhi Li, Pradeep Ravikumar
When Is Generalizable Reinforcement Learning Tractable? CoRR (2021)

Yuanzhi Li.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Yuanzhi Li