Zhongwang Zhang

Publication Activity (10 Years)

Years Active: 2020-2024
Publications (10 Years): 18

Top Topics

Hierarchical Data Structures

Competitive Learning

Top Venues

IEEE Trans. Pattern Anal. Mach. Intell.

Publications

Zhongwang Zhang, Pengxiao Lin, Zhiwei Wang, Yaoyu Zhang, Zhi-Qin John Xu
Initialization is Critical to Whether Transformers Fit Composite Functions by Inference or Memorizing. CoRR (2024)
Zhiwei Wang, Lulu Zhang, Zhongwang Zhang, Zhi-Qin John Xu
Loss Jump During Loss Switch in Solving PDEs with Neural Networks. CoRR (2024)
Zhongwang Zhang, Zhi-Qin John Xu
Implicit Regularization of Dropout. IEEE Trans. Pattern Anal. Mach. Intell. 46 (6) (2024)
Zhongwang Zhang, Yuqing Li, Tao Luo, Zhi-Qin John Xu
Stochastic Modified Equations and Dynamics of Dropout Algorithm. ICLR (2024)
Zhongwang Zhang, Zhiwei Wang, Junjie Yao, Zhangchen Zhou, Xiaolong Li, Weinan E, Zhi-Qin John Xu
Anchor function: a type of benchmark functions for studying language models. CoRR (2024)
Yaoyu Zhang, Leyang Zhang, Zhongwang Zhang, Zhiwei Bai
Local Linear Recovery Guarantee of Deep Neural Networks at Overparameterization. CoRR (2024)
Zhiwei Wang, Yunji Wang, Zhongwang Zhang, Zhangchen Zhou, Hui Jin, Tianyang Hu, Jiacheng Sun, Zhenguo Li, Yaoyu Zhang, Zhi-Qin John Xu
Towards Understanding How Transformer Perform Multi-step Reasoning with Matching Operation. CoRR (2024)
Zhongwang Zhang, Zhi-Qin John Xu
Loss Spike in Training Neural Networks. CoRR (2023)
Zhongwang Zhang, Yuqing Li, Tao Luo, Zhi-Qin John Xu
Stochastic Modified Equations and Dynamics of Dropout Algorithm. CoRR (2023)
Yaoyu Zhang, Zhongwang Zhang, Leyang Zhang, Zhiwei Bai, Tao Luo, Zhi-Qin John Xu
Optimistic Estimate Uncovers the Potential of Nonlinear Models. CoRR (2023)
Yaoyu Zhang, Zhongwang Zhang, Leyang Zhang, Zhiwei Bai, Tao Luo, Zhi-Qin John Xu
Linear Stability Hypothesis and Rank Stratification for Nonlinear Models. CoRR (2022)
Weijin Wang, Jin Li, Yilei Wang, Zhongwang Zhang
RETSR: An Effective Review-Enhanced and Time-Aware Sequential Recommendation Framework. ICTAI (2022)
Zhongwang Zhang, Zhi-Qin John Xu
Implicit regularization of dropout. CoRR (2022)
Yaoyu Zhang, Yuqing Li, Zhongwang Zhang, Tao Luo, Zhi-Qin John Xu
Embedding Principle: a hierarchical structure of loss landscape of deep neural networks. CoRR (2021)
Yaoyu Zhang, Zhongwang Zhang, Tao Luo, Zhi-Qin J. Xu
Embedding Principle of Loss Landscape of Deep Neural Networks. NeurIPS (2021)
Yaoyu Zhang, Zhongwang Zhang, Tao Luo, Zhi-Qin John Xu
Embedding Principle of Loss Landscape of Deep Neural Networks. CoRR (2021)
Zhongwang Zhang, Hanxu Zhou, Zhi-Qin John Xu
A variance principle explains why dropout finds flatter minima. CoRR (2021)
Xueli Zheng, Zhongwang Zhang, Xinyang Yan, Zhongjiang Yan, Mao Yang, Bo Li
A Distributed Reservation and Contention Combined TDMA Protocol for Wireless Avionics Intra-communication Networks. IoTaaS (2020)