Chiwun Yang

Publication Activity (10 Years)

Years Active: 2023-2024
Publications (10 Years): 10

Top Topics

Defense Mechanisms

Faster Convergence

Top Venues

Publications

Jiuxiang Gu, Yingyu Liang, Zhenmei Shi, Zhao Song, Chiwun Yang
Toward Infinite-Long Prefix in Transformer. CoRR (2024)
Timothy Chu, Zhao Song, Chiwun Yang
How to Protect Copyright Data in Optimization of Large Language Models? AAAI (2024)
Yichuan Deng, Zhao Song, Chiwun Yang
Attention is Naturally Sparse with Gaussian Distributed Input. CoRR (2024)
Yichuan Deng, Zhao Song, Chiwun Yang
Enhancing Stochastic Gradient Descent: A Unified Framework and Novel Acceleration Methods for Faster Convergence. CoRR (2024)
Yichuan Deng, Zhao Song, Shenghao Xie, Chiwun Yang
Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights. CoRR (2023)
Zhao Song, Chiwun Yang
An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent. CoRR (2023)
Chenyang Li, Zhao Song, Weixin Wang, Chiwun Yang
A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformer. CoRR (2023)
Timothy Chu, Zhao Song, Chiwun Yang
Fine-tune Language Models to Approximate Unbiased In-context Learning. CoRR (2023)
Raghav Addanki, Chenyang Li, Zhao Song, Chiwun Yang
One Pass Streaming Algorithm for Super Long Token Attention Approximation in Sublinear Space. CoRR (2023)
Timothy Chu, Zhao Song, Chiwun Yang
How to Protect Copyright Data in Optimization of Large Language Models? CoRR (2023)