Xiaoxia Wu

Publication Activity (10 Years)

Years Active: 2006-2024
Publications (10 Years): 46

Top Topics

Gradient Method

Empirical Risk Minimization

Delta Bar Delta

Provably Convergent

Top Venues

Appl. Math. Comput.

Publications

Haojun Xia, Zhen Zheng, Xiaoxia Wu, Shiyang Chen, Zhewei Yao, Stephen Youn, Arash Bakhtiari, Michael Wyatt, Donglin Zhuang, Zhongzhu Zhou, Olatunji Ruwase, Yuxiong He, Shuaiwen Leon Song
Quant-LLM: Accelerating the Serving of Large Language Models via FP6-Centric Algorithm-System Co-Design on Modern GPUs. USENIX ATC (2024)
Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Xiaoxia Wu, Connor Holmes, Zhewei Yao, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, Yuxiong He
ZeRO++: Extremely Efficient Collective Communication for Large Model Training. ICLR (2024)
Zhewei Yao, Xiaoxia Wu, Cheng Li, Stephen Youn, Yuxiong He
Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation. AAAI (2024)
Xiaoxia Wu, Fuliang Lu, Lianzhu Zhang
Removable Edges in Claw-Free Bricks. Graphs Comb. 40 (3) (2024)
Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang
Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding. CoRR (2024)
Haojun Xia, Zhen Zheng, Xiaoxia Wu, Shiyang Chen, Zhewei Yao, Stephen Youn, Arash Bakhtiari, Michael Wyatt, Donglin Zhuang, Zhongzhu Zhou, Olatunji Ruwase, Yuxiong He, Shuaiwen Leon Song
FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design. CoRR (2024)
Conglong Li, Zhewei Yao, Xiaoxia Wu, Minjia Zhang, Connor Holmes, Cheng Li, Yuxiong He
DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing. AAAI (2024)
Fengxiang Bie, Yibo Yang, Zhongzhu Zhou, Adam Ghanem, Minjia Zhang, Zhewei Yao, Xiaoxia Wu, Connor Holmes, Pareesa Ameneh Golnari, David A. Clifton, Yuxiong He, Dacheng Tao, Shuaiwen Leon Song
RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model. CoRR (2023)
Zhewei Yao, Xiaoxia Wu, Conglong Li, Minjia Zhang, Heyang Qin, Olatunji Ruwase, Ammar Ahmad Awan, Samyam Rajbhandari, Yuxiong He
DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention. CoRR (2023)
Zhewei Yao, Reza Yazdani Aminabadi, Stephen Youn, Xiaoxia Wu, Elton Zheng, Yuxiong He
ZeroQuant-HERO: Hardware-Enhanced Robust Optimized Post-Training Quantization Framework for W8A8 Transformers. CoRR (2023)
Zhewei Yao, Reza Yazdani Aminabadi, Olatunji Ruwase, Samyam Rajbhandari, Xiaoxia Wu, Ammar Ahmad Awan, Jeff Rasley, Minjia Zhang, Conglong Li, Connor Holmes, Zhongzhu Zhou, Michael Wyatt, Molly Smith, Lev Kurilenko, Heyang Qin, Masahiro Tanaka, Shuai Che, Shuaiwen Leon Song, Yuxiong He
DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales. CoRR (2023)
Xiaoxia Wu, Zhewei Yao, Yuxiong He
ZeroQuant-FP: A Leap Forward in LLMs Post-Training W4A8 Quantization Using Floating-Point Formats. CoRR (2023)
Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He
Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases. ICML (2023)
Fang He, Xiaoxia Wu, Wenyu Zhang, Xiaoling Huang
A novel bias-alleviated hybrid ensemble model based on over-sampling and post-processing for fair classification. Connect. Sci. 35 (1) (2023)
Zhewei Yao, Cheng Li, Xiaoxia Wu, Stephen Youn, Yuxiong He
A Comprehensive Study on Post-Training Quantization for Large Language Models. CoRR (2023)
Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He
Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases. CoRR (2023)
Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang, Conglong Li, Shiyang Chen, Chengming Zhang, Masahiro Tanaka, Xiaoxia Wu, Jeff Rasley, Ammar Ahmad Awan, Connor Holmes, Martin Cai, Adam Ghanem, Zhongzhu Zhou, Yuxiong He, Pete Luferenko, Divya Kumar, Jonathan A. Weyn, Ruixiong Zhang, Sylwester Klocek, Volodymyr Vragov, Mohammed AlQuraishi, Gustaf Ahdritz, Christina Floristean, Cristina Negri, Rao Kotamarthi, Venkatram Vishwanath, Arvind Ramanathan, Sam Foreman, Kyle Hippe, Troy Arcomano, Romit Maulik, Maxim Zvyagin, Alexander Brace, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael W. Irvin, J. Gregory Pauloski, Logan T. Ward, Valérie Hayot-Sasson, Murali Emani, Zhen Xie, Diangen Lin, Maulik Shukla, Ian T. Foster, James J. Davis, Michael E. Papka, Thomas S. Brettin, Prasanna Balaprakash, Gina Tourassi, John Gounley, Heidi A. Hanson, Thomas E. Potok, Massimiliano Lupo Pasini, Kate Evans, Dan Lu, Dalton D. Lunga, Junqi Yin, Sajal Dash, Feiyi Wang, Mallikarjun Shankar, Isaac Lyngaas, Xiao Wang, Guojing Cong, Pei Zhang, Ming Fan, Siyan Liu, Adolfy Hoisie, Shinjae Yoo, Yihui Ren, William Tang, Kyle Felker, Alexey Svyatkovskiy, Hang Liu, Ashwin M. Aji, Angela Dalton, Michael J. Schulte, Karl Schulz, Yuntian Deng, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Anima Anandkumar, Rick Stevens
DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies. CoRR (2023)
Xiaoxia Wu, Haojun Xia, Stephen Youn, Zhen Zheng, Shiyang Chen, Arash Bakhtiari, Michael Wyatt, Reza Yazdani Aminabadi, Yuxiong He, Olatunji Ruwase, Leon Song, Zhewei Yao
ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks. CoRR (2023)
Xiaoxia Wu, Zhewei Yao, Minjia Zhang, Conglong Li, Yuxiong He
Extreme Compression for Pre-trained Transformers Made Simple and Efficient. CoRR (2022)
Zhewei Yao, Xiaoxia Wu, Conglong Li, Connor Holmes, Minjia Zhang, Cheng Li, Yuxiong He
Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers. CoRR (2022)
Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, Yuxiong He
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers. CoRR (2022)
Conglong Li, Zhewei Yao, Xiaoxia Wu, Minjia Zhang, Yuxiong He
DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing. CoRR (2022)
Xiaoxia Wu, Zhewei Yao, Minjia Zhang, Conglong Li, Yuxiong He
XTC: Extreme Compression for Pre-trained Transformers Made Simple and Efficient. NeurIPS (2022)
Xiaoxia Wu, Yuege Xie, Simon Shaolei Du, Rachel Ward
AdaLoss: A Computationally-Efficient and Provably Convergent Adaptive Gradient Method. AAAI (2022)
Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, Yuxiong He
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers. NeurIPS (2022)
Xiaoxia Wu, Lingxiao Wang, Irina Cristali, Quanquan Gu, Rebecca Willett
Adaptive Differentially Private Empirical Risk Minimization. CoRR (2021)
Xiaoxia Wu, Ethan Dyer, Behnam Neyshabur
When Do Curricula Work? ICLR (2021)
Tobias Rohde, Xiaoxia Wu, Yinhan Liu
Hierarchical Learning for Generation with Long Source Sequences. CoRR (2021)
Xiaoxia Wu, Yuege Xie, Simon S. Du, Rachel Ward
AdaLoss: A computationally-efficient and provably convergent adaptive gradient method. CoRR (2021)
Vatsal Shah, Xiaoxia Wu, Sujay Sanghavi
Choosing the Sample with Lowest Loss makes SGD Robust. AISTATS (2020)
Xiaoxia Wu, Edgar Dobriban, Tongzheng Ren, Shanshan Wu, Zhiyuan Li, Suriya Gunasekar, Rachel Ward, Qiang Liu
Implicit Regularization and Convergence for Weight Normalization. NeurIPS (2020)
Xiaoxia Wu, Ethan Dyer, Behnam Neyshabur
When Do Curricula Work? CoRR (2020)
Yuege Xie, Xiaoxia Wu, Rachel Ward
Linear Convergence of Adaptive Stochastic Gradient Descent. AISTATS (2020)
Vatsal Shah, Xiaoxia Wu, Sujay Sanghavi
Choosing the Sample with Lowest Loss makes SGD Robust. CoRR (2020)
Xiaoxia Wu, Simon S. Du, Rachel Ward
Global Convergence of Adaptive Gradient Methods for An Over-parameterized Neural Network. CoRR (2019)
Xiaoxia Wu, Lianzhu Zhang
-minimal chemical trees. Appl. Math. Comput. 362 (2019)
Xiaoxia Wu, Edgar Dobriban, Tongzheng Ren, Shanshan Wu, Zhiyuan Li, Suriya Gunasekar, Rachel Ward, Qiang Liu
Implicit Regularization of Normalization Methods. CoRR (2019)
Yuege Xie, Xiaoxia Wu, Rachel Ward
Linear Convergence of Adaptive Stochastic Gradient Descent. CoRR (2019)
Xiaoxia Wu, Heyu Xiao
Research on the Development Trend and Coping Strategies of Internet Finance. CSIA (2019)
Rachel Ward, Xiaoxia Wu, Léon Bottou
AdaGrad stepsizes: sharp convergence over nonconvex landscapes. ICML (2019)
Rachel Ward, Xiaoxia Wu, Léon Bottou
AdaGrad stepsizes: Sharp convergence over nonconvex landscapes, from any initialization. CoRR (2018)
Yan Peng, Maomao Wang, Xiaoxia Wu, Fu Wang, Lang Liu
Methionine-Capped Gold Nanoclusters as a Fluorescence-Enhanced Probe for Cadmium(II) Sensing. Sensors 18 (2) (2018)
Mark Filer, Hacene Chaouch, Xiaoxia Wu
Toward Transport Ecosystem Interoperability Enabled by Vendor-Diverse Coherent Optical Sources Over an Open Line System. JOCN 10 (2) (2018)
Xiaoxia Wu, Rachel Ward, Léon Bottou
WNGrad: Learn the Learning Rate in Gradient Descent. CoRR (2018)
Mark Filer, Hacene Chaouch, Xiaoxia Wu, Jamie Gaudette, Jeffrey L. Cox
Interoperation of layer-2/3 modular switches with 8QAM/16QAM integrated coherent optics over 2000 km open line system. OFC (2017)
Xiaoxia Wu, Lianzhu Zhang, Haiyan Chen
Spanning trees and recurrent configurations of a graph. Appl. Math. Comput. 314 (2017)
Xiaoxia Wu, Lian-zhu Zhang, Hawei Dong, Chengfu Qin
Height Probabilities in the Abelian Sandpile Model on the Generalized Trees. Ars Comb. 117 (2014)
Tz-Yi Liu, Tian Hong Yan, Roy Scheuerlein, Yingchang Chen, Jeffrey KoonYee Lee, Gopinath Balakrishnan, Gordon Yee, Henry Zhang, Alex Yap, Jingwen Ouyang, Takahiko Sasaki, Ali Al-Shamma, Chin-Yu Chen, Mayank Gupta, Greg Hilton, Achal Kathuria, Vincent Lai, Masahide Matsumoto, Anurag Nigam, Anil Pai, Jayesh Pakhale, Chang Hua Siau, Xiaoxia Wu, Yibo Yin, Nicolas Nagel, Yoichiro Tanaka, Masaaki Higashitani, Tim Minvielle, Chandu Gorla, Takayuki Tsukamoto, Takeshi Yamaguchi, Mutsumi Okajima, Takayuki Okamura, Satoru Takase, Hirofumi Inoue, Luca Fasoli
2-Layer 32-Gb ReRAM Memory Device in 24-nm Technology. IEEE J. Solid State Circuits 49 (1) (2014)
Tz-Yi Liu, Tian Hong Yan, Roy Scheuerlein, Yingchang Chen, Jeffrey KoonYee Lee, Gopinath Balakrishnan, Gordon Yee, Henry Zhang, Alex Yap, Jingwen Ouyang, Takahiko Sasaki, Sravanti Addepalli, Ali Al-Shamma, Chin-Yu Chen, Mayank Gupta, Greg Hilton, Saurabh Joshi, Achal Kathuria, Vincent Lai, Deep Masiwal, Masahide Matsumoto, Anurag Nigam, Anil Pai, Jayesh Pakhale, Chang Hua Siau, Xiaoxia Wu, Ronald Yin, Liping Peng, Jang Yong Kang, Sharon Huynh, Huijuan Wang, Nicolas Nagel, Yoichiro Tanaka, Masaaki Higashitani, Tim Minvielle, Chandu Gorla, Takayuki Tsukamoto, Takeshi Yamaguchi, Mutsumi Okajima, Takayuki Okamura, Satoru Takase, Takahiko Hara, Hirofumi Inoue, Luca Fasoli, Mehrdad Mofidi, Ritu Shrivastava, Khandker Quader
2-layer 32Gb ReRAM memory device in 24nm technology. ISSCC (2013)
Hualing Zhao, Xiaoxia Wu, Hong Zhang, Hanfeng Chen
Estimating the Proportion of True Null Hypotheses in Nonparametric Exponential Mixture Model with Appication to the Leukemia Gene Expression Data. Commun. Stat. Simul. Comput. 41 (9) (2012)
Xiaoxia Wu, Lian-zhu Zhang
Small Randic Index Ordering of Trees with k Pendant Vertices. Ars Comb. 103 (2012)
Xiaoxia Wu, Wei Zhao, Mark Nakamoto, Chandra Nimmagadda, Durodami Lisk, Sam Gu, Riko Radojcic, Matt Nowak, Yuan Xie
Electrical Characterization for Intertier Connections and Timing Analysis for 3-D ICs. IEEE Trans. Very Large Scale Integr. Syst. 20 (1) (2012)
Xiangyu Dong, Xiaoxia Wu, Yuan Xie, Yiran Chen, Hai (Helen) Li
Stacking magnetic random access memory atop microprocessors: an architecture-level evaluation. IET Comput. Digit. Tech. 5 (3) (2011)
Feng Wang, Yibo Chen, Chrysostomos Nicopoulos, Xiaoxia Wu, Yuan Xie, Narayanan Vijaykrishnan
Variation-Aware Task and Communication Mapping for MPSoC Architecture. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 30 (2) (2011)
Antonella Bogoni, Luca Potì, Alan E. Willner, Paolo Ghelfi, Claudio Porzi, Mirco Scaffardi, Gianluca Meloni, Gianluca Berrettini, Francesco Fresi, Emma Lazzeri, Xiaoxia Wu
Optical logic elementary circuits. IET Circuits Devices Syst. 5 (2) (2011)
Xiaoxia Wu, Yibo Chen, Krishnendu Chakrabarty, Yuan Xie
Test-access mechanism optimization for core-based three-dimensional SOCs. Microelectron. J. 41 (10) (2010)
Xiaoxia Wu, Guangyu Sun, Xiangyu Dong, Reetuparna Das, Yuan Xie, Chita R. Das, Jian Li
Cost-driven 3D integration with interconnect layers. DAC (2010)
Xiaoxia Wu, Jian Li, Lixin Zhang, Evan Speight, Ramakrishnan Rajamony, Yuan Xie
Design exploration of hybrid caches with disparate memory technologies. ACM Trans. Archit. Code Optim. 7 (3) (2010)
Guangyu Sun, Xiaoxia Wu, Yuan Xie
Exploration of 3D stacked L2 cache design for high performance and efficient thermal control. ISLPED (2009)
Xiaoxia Wu, Paul Falkenstern, Krishnendu Chakrabarty, Yuan Xie
Scan-chain design and optimization for three-dimensional integrated circuits. ACM J. Emerg. Technol. Comput. Syst. 5 (2) (2009)
Xiaoxia Wu, Jian Li, Lixin Zhang, Evan Speight, Yuan Xie
Power and performance of read-write aware Hybrid Caches with non-volatile memories. DATE (2009)
Xiaoxia Wu, Jian Li, Lixin Zhang, Evan Speight, Ramakrishnan Rajamony, Yuan Xie
Hybrid cache architecture with disparate memory technologies. ISCA (2009)
Xiaoxia Wu, Yibo Chen, Krishnendu Chakrabarty, Yuan Xie
Test-access mechanism optimization for core-based three-dimensional SOCs. ICCD (2008)
Xiaoxia Wu, Yibo Chen, Krishnendu Chakrabarty, Yuan Xie
Test-Access Solutions for Three-Dimensional SOCs. ITC (2008)
Krishnan Ramakrishnan, Xiaoxia Wu, Narayanan Vijaykrishnan, Yuan Xie
Comparative analysis of NBTI effects on low power and high performance flip-flops. ICCD (2008)
Feng Wang, Xiaoxia Wu, Yuan Xie
Variability-driven module selection with joint design time optimization and post-silicon tuning. ASP-DAC (2008)
Xiangyu Dong, Xiaoxia Wu, Guangyu Sun, Yuan Xie, Hai Li, Yiran Chen
Circuit and microarchitecture evaluation of 3D stacking magnetic RAM (MRAM) as a universal memory replacement. DAC (2008)
Xiaoxia Wu, Paul Falkenstern, Yuan Xie
Scan chain design for three-dimensional integrated circuits (3D ICs). ICCD (2007)
Feng Wang, Chrysostomos Nicopoulos, Xiaoxia Wu, Yuan Xie, Narayanan Vijaykrishnan
Variation-aware task allocation and scheduling for MPSoC. ICCAD (2007)
Feng Wang, Michael DeBole, Xiaoxia Wu, Yuan Xie, Narayanan Vijaykrishnan, Mary Jane Irwin
On-chip bus thermal analysis and optimisation. IET Comput. Digit. Tech. 1 (5) (2007)
Xiaoxia Wu, Feng Wang, Yuan Xie
Analysis of Subthreshold Finfet Circuits for Ultra-Low Power Design. SoCC (2006)
Wei-Lun Hung, Xiaoxia Wu, Yuan Xie
Guaranteeing performance yield in high-level synthesis. ICCAD (2006)