Shaoduo Gan

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 22

Top Topics

Stochastic Gradient Descent

Machine Learning

Named Entity Recognition

Top Venues

SIGMOD Conference

Publications

Lijie Xu, Shuang Qiu, Binhang Yuan, Jiawei Jiang, Cedric Renggli, Shaoduo Gan, Kaan Kara, Guoliang Li, Ji Liu, Wentao Wu, Jieping Ye, Ce Zhang
Stochastic gradient descent without full data shuffle: with applications to in-database machine learning and deep learning systems. VLDB J. 33 (5) (2024)
Jiawei Jiang, Shaoduo Gan, Bo Du, Gustavo Alonso, Ana Klimovic, Ankit Singla, Wentao Wu, Sheng Wang, Ce Zhang
A systematic evaluation of machine learning on serverless infrastructure. VLDB J. 33 (2) (2024)
Zihao Wang, Shaoduo Gan
SqueezeAttention: 2D Management of KV-Cache in LLM Inference via Layer-wise Optimal Budget. CoRR (2024)
Lijie Xu, Shuang Qiu, Binhang Yuan, Jiawei Jiang, Cédric Renggli, Shaoduo Gan, Kaan Kara, Guoliang Li, Ji Liu, Wentao Wu, Jieping Ye, Ce Zhang
In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle. SIGMOD Conference (2022)
Bin Ji, Shasha Li, Shaoduo Gan, Jie Yu, Jun Ma, Huijun Liu, Jing Yang
Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypes. COLING (2022)
Shaoduo Gan, Akhil Mathur, Anton Isopoussu, Fahim Kawsar, Nadia Berthouze, Nicholas D. Lane
FRuDA: Framework for Distributed Adversarial Domain Adaptation. IEEE Trans. Parallel Distributed Syst. 33 (11) (2022)
Lijie Xu, Shuang Qiu, Binhang Yuan, Jiawei Jiang, Cédric Renggli, Shaoduo Gan, Kaan Kara, Guoliang Li, Ji Liu, Wentao Wu, Jieping Ye, Ce Zhang
Stochastic Gradient Descent without Full Data Shuffle. CoRR (2022)
Bin Ji, Shasha Li, Shaoduo Gan, Jie Yu, Jun Ma, Huijun Liu
Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypes. CoRR (2022)
Jiawei Jiang, Shaoduo Gan, Yue Liu, Fanlin Wang, Gustavo Alonso, Ana Klimovic, Ankit Singla, Wentao Wu, Ce Zhang
Towards Demystifying Serverless Machine Learning Training. CoRR (2021)
Shaoduo Gan, Akhil Mathur, Anton Isopoussu, Fahim Kawsar, Nadia Berthouze, Nicholas D. Lane
FRuDA: Framework for Distributed Adversarial Domain Adaptation. CoRR (2021)
Shaoduo Gan, Xiangru Lian, Rui Wang, Jianbin Chang, Chengjun Liu, Hongmei Shi, Shengzhuo Zhang, Xianghong Li, Tengxu Sun, Jiawei Jiang, Binhang Yuan, Sen Yang, Ji Liu, Ce Zhang
BAGUA: Scaling up Distributed Learning with System Relaxations. Proc. VLDB Endow. 15 (4) (2021)
Hanlin Tang, Shaoduo Gan, Ammar Ahmad Awan, Samyam Rajbhandari, Conglong Li, Xiangru Lian, Ji Liu, Ce Zhang, Yuxiong He
1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed. ICML (2021)
Shaoduo Gan, Xiangru Lian, Rui Wang, Jianbin Chang, Chengjun Liu, Hongmei Shi, Shengzhuo Zhang, Xianghong Li, Tengxu Sun, Jiawei Jiang, Binhang Yuan, Sen Yang, Ji Liu, Ce Zhang
BAGUA: Scaling up Distributed Learning with System Relaxations. CoRR (2021)
Hanlin Tang, Shaoduo Gan, Ammar Ahmad Awan, Samyam Rajbhandari, Conglong Li, Xiangru Lian, Ji Liu, Ce Zhang, Yuxiong He
1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed. CoRR (2021)
Jiawei Jiang, Shaoduo Gan, Yue Liu, Fanlin Wang, Gustavo Alonso, Ana Klimovic, Ankit Singla, Wentao Wu, Ce Zhang
Towards Demystifying Serverless Machine Learning Training. SIGMOD Conference (2021)
Leonel Aguilar Melgar, David Dao, Shaoduo Gan, Nezihe Merve Gürel, Nora Hollenstein, Jiawei Jiang, Bojan Karlas, Thomas Lemmin, Tian Li, Yang Li, Xi Rao, Johannes Rausch, Cédric Renggli, Luka Rimanic, Maurice Weber, Shuai Zhang, Zhikuan Zhao, Kevin Schawinski, Wentao Wu, Ce Zhang
Ease.ML: A Lifecycle Management System for Machine Learning. CIDR (2021)
Hanlin Tang, Shaoduo Gan, Samyam Rajbhandari, Xiangru Lian, Ji Liu, Yuxiong He, Ce Zhang
APMSqueeze: A Communication Efficient Adam-Preconditioned Momentum SGD Algorithm. CoRR (2020)
Hanlin Tang, Shaoduo Gan, Ce Zhang, Tong Zhang, Ji Liu
Communication Compression for Decentralized Training. NeurIPS (2018)
Hanlin Tang, Ce Zhang, Shaoduo Gan, Tong Zhang, Ji Liu
Decentralization Meets Quantization. CoRR (2018)
Shaoduo Gan, Jiexin Zhang, Jie Yu, Xiaoling Li, Jun Ma, Lei Luo, Qingbo Wu
A novel optimization scheme for caching in locality-aware P2P networks. ISCC (2016)
Jiexin Zhang, Shaoduo Gan, Xiaoxue Liu, Peidong Zhu
Intrusion detection in SCADA systems by traffic periodicity and telemetry analysis. ISCC (2016)
Shaoduo Gan, Jie Yu, Xiaoling Li, Jun Ma, Lei Luo, Qingbo Wu, Shasha Li
ERPC: An Edge-Resources Based Framework to Reduce Bandwidth Cost in the Personal Cloud. WAIM (2) (2016)