Guangxuan Xiao

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 18

Top Topics

Efficient Compression

Neural Network Training

Top Venues

Proc. VLDB Endow.

Publications

Kezhao Huang, Haitian Jiang, Minjie Wang, Guangxuan Xiao, David Wipf, Xiang Song, Quan Gan, Zengfeng Huang, Jidong Zhai, Zheng Zhang
FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training. Proc. VLDB Endow. 17 (6) (2024)
Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, Mike Lewis
Efficient Streaming Language Models with Attention Sinks. ICLR (2024)
Jiaming Tang, Yilong Zhao, Kan Zhu, Guangxuan Xiao, Baris Kasikci, Song Han
Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference. CoRR (2024)
Yujun Lin, Haotian Tang, Shang Yang, Zhekai Zhang, Guangxuan Xiao, Chuang Gan, Song Han
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving. CoRR (2024)
Chaojun Xiao, Pengle Zhang, Xu Han, Guangxuan Xiao, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Song Han, Maosong Sun
InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory. CoRR (2024)
Ji Lin, Jiaming Tang, Haotian Tang, Shang Yang, Wei-Ming Chen, Wei-Chen Wang, Guangxuan Xiao, Xingyu Dang, Chuang Gan, Song Han
AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration. MLSys (2024)
Wenhao Wu, Yizhong Wang, Guangxuan Xiao, Hao Peng, Yao Fu
Retrieval Head Mechanistically Explains Long-Context Factuality. CoRR (2024)
James Liu, Guangxuan Xiao, Kai Li, Jason D. Lee, Song Han, Tri Dao, Tianle Cai
BitDelta: Your Fine-Tune May Only Be Worth One Bit. CoRR (2024)
Zhengyan Zhang, Guangxuan Xiao, Yongwei Li, Tian Lv, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Xin Jiang, Maosong Sun
Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-level Backdoor Attacks. Mach. Intell. Res. 20 (2) (2023)
Guangxuan Xiao, Ji Lin, Song Han
Offsite-Tuning: Transfer Learning without Full Model. CoRR (2023)
Guangxuan Xiao, Ji Lin, Mickaël Seznec, Hao Wu, Julien Demouth, Song Han
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models. ICML (2023)
Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, Mike Lewis
Efficient Streaming Language Models with Attention Sinks. CoRR (2023)
Guangxuan Xiao, Tianwei Yin, William T. Freeman, Frédo Durand, Song Han
FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention. CoRR (2023)
Kezhao Huang, Haitian Jiang, Minjie Wang, Guangxuan Xiao, David Wipf, Xiang Song, Quan Gan, Zengfeng Huang, Jidong Zhai, Zheng Zhang
ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training. CoRR (2023)
Guangxuan Xiao, Leslie Pack Kaelbling, Jiajun Wu, Jiayuan Mao
Sparse and Local Networks for Hypergraph Reasoning. CoRR (2023)
Guangxuan Xiao, Leslie Pack Kaelbling, Jiajun Wu, Jiayuan Mao
Sparse and Local Networks for Hypergraph Reasoning. LoG (2022)
Guangxuan Xiao, Ji Lin, Mickaël Seznec, Julien Demouth, Song Han
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models. CoRR (2022)
Zhengyan Zhang, Guangxuan Xiao, Yongwei Li, Tian Lv, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Xin Jiang, Maosong Sun
Red Alarm for Pre-trained Models: Universal Vulnerabilities by Neuron-Level Backdoor Attacks. CoRR (2021)