Tianhao Wang

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 10

Top Topics

Adaptive Learning Rate

Multilayer Neural Networks

Stochastic Gradient Descent

Top Venues

Publications

Angeliki Giannou, Liu Yang, Tianhao Wang, Dimitris Papailiopoulos, Jason D. Lee
How Well Can Transformers Emulate In-context Newton's Method? CoRR (2024)
Runzhe Wang, Sadhika Malladi, Tianhao Wang, Kaifeng Lyu, Zhiyuan Li
The Marginal Value of Momentum for Small Learning Rate SGD. ICLR (2024)
Runzhe Wang, Sadhika Malladi, Tianhao Wang, Kaifeng Lyu, Zhiyuan Li
The Marginal Value of Momentum for Small Learning Rate SGD. CoRR (2023)
Zhiyuan Li, Tianhao Wang, Dingli Yu
Fast Mixing of Stochastic Gradient Descent with Normalization and Weight Decay. NeurIPS (2022)
Tianhao Wang, Xinyi Zhong, Zhou Fan
Universality of Approximate Message Passing algorithms and tensor networks. CoRR (2022)
Zhiyuan Li, Tianhao Wang, Sanjeev Arora
What Happens after SGD Reaches Zero Loss? --A Mathematical Framework. ICLR (2022)
Zhiyuan Li, Tianhao Wang, Jason D. Lee, Sanjeev Arora
Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent. CoRR (2022)
Zhiyuan Li, Tianhao Wang, Jason D. Lee, Sanjeev Arora
Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent. NeurIPS (2022)
Zhiyuan Li, Tianhao Wang, Sanjeev Arora
What Happens after SGD Reaches Zero Loss? -A Mathematical Framework. CoRR (2021)
Zhou Fan, Roy R. Lederman, Yi Sun, Tianhao Wang, Sheng Xu
Maximum likelihood for high-noise group orbit estimation and single-particle cryo-EM. CoRR (2021)