Wei Zhang

Publication Activity (10 Years)

Years Active: 2005-2023
Publications (10 Years): 43

Top Topics

Acoustic Models

Stochastic Gradient Descent

Speech Recognition

Top Venues

Publications

Xiaodong Cui, Ashish Mittal, Songtao Lu, Wei Zhang, George Saon, Brian Kingsbury
Soft Random Sampling: A Theoretical and Empirical Analysis. CoRR (2023)
Michael Crawshaw, Mingrui Liu, Francesco Orabona, Wei Zhang, Zhenxun Zhuang
Robustness to Unbounded Smoothness of Generalized SignSGD. CoRR (2022)
Michael Crawshaw, Mingrui Liu, Francesco Orabona, Wei Zhang, Zhenxun Zhuang
Robustness to Unbounded Smoothness of Generalized SignSGD. NeurIPS (2022)
Xiaodong Cui, Wei Zhang, Abdullah Kayi, Mingrui Liu, Ulrich Finkler, Brian Kingsbury, George Saon, David S. Kung
Asynchronous Decentralized Distributed Training of Acoustic Models. IEEE ACM Trans. Audio Speech Lang. Process. 29 (2021)
Ruchir Puri, David S. Kung, Geert Janssen, Wei Zhang, Giacomo Domeniconi, Vladimir Zolotov, Julian Dolby, Jie Chen, Mihir R. Choudhury, Lindsey Decker, Veronika Thost, Luca Buratti, Saurabh Pujar, Shyam Ramji, Ulrich Finkler, Susan Malaika, Frederick Reiss
CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Tasks. NeurIPS Datasets and Benchmarks (2021)
Xiaodong Cui, Wei Zhang, Abdullah Kayi, Mingrui Liu, Ulrich Finkler, Brian Kingsbury, George Saon, David S. Kung
Asynchronous Decentralized Distributed Training of Acoustic Models. CoRR (2021)
Chia-Yu Chen, Jiamin Ni, Songtao Lu, Xiaodong Cui, Pin-Yu Chen, Xiao Sun, Naigang Wang, Swagath Venkataramani, Vijayalakshmi Srinivasan, Wei Zhang, Kailash Gopalakrishnan
ScaleCom: Scalable Sparsified Gradient Compression for Communication-Efficient Distributed Training. CoRR (2021)
Wei Zhang, Mingrui Liu, Yu Feng, Xiaodong Cui, Brian Kingsbury, Yuhai Tu
Loss Landscape Dependent Self-Adjusting Learning Rates in Decentralized Stochastic Gradient Descent. CoRR (2021)
Andrea Fasoli, Chia-Yu Chen, Mauricio J. Serrano, Xiao Sun, Naigang Wang, Swagath Venkataramani, George Saon, Xiaodong Cui, Brian Kingsbury, Wei Zhang, Zoltán Tüske, Kailash Gopalakrishnan
4-Bit Quantization of LSTM-Based Speech Recognition Models. Interspeech (2021)
Andrea Fasoli, Chia-Yu Chen, Mauricio J. Serrano, Xiao Sun, Naigang Wang, Swagath Venkataramani, George Saon, Xiaodong Cui, Brian Kingsbury, Wei Zhang, Zoltán Tüske, Kailash Gopalakrishnan
4-bit Quantization of LSTM-based Speech Recognition Models. CoRR (2021)
Wei Zhang, Xiaodong Cui, Abdullah Kayi, Mingrui Liu, Ulrich Finkler, Brian Kingsbury, George Saon, Youssef Mroueh, Alper Buyuktosunoglu, Payel Das, David S. Kung, Michael Picheny
Improving Efficiency in Large-Scale Decentralized Distributed Training. ICASSP (2020)
Rui Zhang, Conrad M. Albrecht, Wei Zhang, Xiaodong Cui, Ulrich Finkler, David S. Kung, Siyuan Lu
Map Generation from Large Scale Incomplete and Inaccurate Data Labels. KDD (2020)
Chia-Yu Chen, Jiamin Ni, Songtao Lu, Xiaodong Cui, Pin-Yu Chen, Xiao Sun, Naigang Wang, Swagath Venkataramani, Vijayalakshmi Srinivasan, Wei Zhang, Kailash Gopalakrishnan
ScaleCom: Scalable Sparsified Gradient Compression for Communication-Efficient Distributed Training. NeurIPS (2020)
Rui Zhang, Conrad M. Albrecht, Wei Zhang, Xiaodong Cui, Ulrich Finkler, David S. Kung, Siyuan Lu
Map Generation from Large Scale Incomplete and Inaccurate Data Labels. CoRR (2020)
Xiaodong Cui, Wei Zhang, Ulrich Finkler, George Saon, Michael Picheny, David S. Kung
Distributed Training of Deep Neural Network Acoustic Models for Automatic Speech Recognition. CoRR (2020)
Mingrui Liu, Youssef Mroueh, Jerret Ross, Wei Zhang, Xiaodong Cui, Payel Das, Tianbao Yang
Towards Better Understanding of Adaptive Gradient Algorithms in Generative Adversarial Nets. ICLR (2020)
Mingrui Liu, Wei Zhang, Youssef Mroueh, Xiaodong Cui, Jarret Ross, Tianbao Yang, Payel Das
A Decentralized Parallel Algorithm for Training Generative Adversarial Nets. NeurIPS (2020)
Mingrui Liu, Wei Zhang, Francesco Orabona, Tianbao Yang
: A Stochastic Method with Adaptive Variance Reduction. CoRR (2020)
Conrad M. Albrecht, Rui Zhang, Xiaodong Cui, Marcus Freitag, Hendrik F. Hamann, Levente J. Klein, Ulrich Finkler, Fernando J. Marianno, Johannes Schmude, Norman Bobroff, Wei Zhang, Carlo Siebenschuh, Siyuan Lu
Change Detection from Remote Sensing to Guide OpenStreetMap Labeling. ISPRS Int. J. Geo Inf. 9 (7) (2020)
Xiaodong Cui, Wei Zhang, Ulrich Finkler, George Saon, Michael Picheny, David S. Kung
Distributed Training of Deep Neural Network Acoustic Models for Automatic Speech Recognition: A comparison of current training strategies. IEEE Signal Process. Mag. 37 (3) (2020)
Wei Zhang, Xiaodong Cui, Abdullah Kayi, Mingrui Liu, Ulrich Finkler, Brian Kingsbury, George Saon, Youssef Mroueh, Alper Buyuktosunoglu, Payel Das, David S. Kung, Michael Picheny
Improving Efficiency in Large-Scale Decentralized Distributed Training. CoRR (2020)
Wei Zhang, Xiaodong Cui, Ulrich Finkler, George Saon, Abdullah Kayi, Alper Buyuktosunoglu, Brian Kingsbury, David S. Kung, Michael Picheny
A Highly Efficient Distributed Deep Learning System For Automatic Speech Recognition. CoRR (2019)
Wei Zhang, Xiaodong Cui, Ulrich Finkler, George Saon, Abdullah Kayi, Alper Buyuktosunoglu, Brian Kingsbury, David S. Kung, Michael Picheny
A Highly Efficient Distributed Deep Learning System for Automatic Speech Recognition. INTERSPEECH (2019)
Wei Zhang, Xiaodong Cui, Ulrich Finkler, Brian Kingsbury, George Saon, David S. Kung, Michael Picheny
Distributed Deep Learning Strategies for Automatic Speech Recognition. ICASSP (2019)
Wei Zhang, Xiaodong Cui, Ulrich Finkler, Brian Kingsbury, George Saon, David S. Kung, Michael Picheny
Distributed Deep Learning Strategies For Automatic Speech Recognition. CoRR (2019)
Mingrui Liu, Youssef Mroueh, Jerret Ross, Wei Zhang, Xiaodong Cui, Payel Das, Tianbao Yang
Towards Better Understanding of Adaptive Gradient Algorithms in Generative Adversarial Nets. CoRR (2019)
Khoi-Nguyen C. Mac, Xiaodong Cui, Wei Zhang, Michael Picheny
Large-Scale Mixed-Bandwidth Deep Neural Network Acoustic Modeling for Automatic Speech Recognition. CoRR (2019)
Khoi-Nguyen C. Mac, Xiaodong Cui, Wei Zhang, Michael Picheny
Large-Scale Mixed-Bandwidth Deep Neural Network Acoustic Modeling for Automatic Speech Recognition. INTERSPEECH (2019)
Xiao Sun, Jungwook Choi, Chia-Yu Chen, Naigang Wang, Swagath Venkataramani, Vijayalakshmi Srinivasan, Xiaodong Cui, Wei Zhang, Kailash Gopalakrishnan
Hybrid 8-bit Floating Point (HFP8) Training and Inference for Deep Neural Networks. NeurIPS (2019)
Mingrui Liu, Youssef Mroueh, Wei Zhang, Xiaodong Cui, Jerret Ross, Tianbao Yang, Payel Das
Decentralized Parallel Algorithm for Training Generative Adversarial Nets. CoRR (2019)
Xiaodong Cui, Wei Zhang, Zoltán Tüske, Michael Picheny
Evolutionary Stochastic Gradient Descent for Optimization of Deep Neural Networks. NeurIPS (2018)
Rui Zhang, Minwei Feng, Wei Zhang, Siyuan Lu, Fei Wang
Forecast of Solar Energy Production - A Deep Learning Approach. ICBK (2018)
Xiangru Lian, Wei Zhang, Ce Zhang, Ji Liu
Asynchronous Decentralized Parallel Stochastic Gradient Descent. ICML (2018)
Xiaodong Cui, Wei Zhang, Zoltán Tüske, Michael Picheny
Evolutionary Stochastic Gradient Descent for Optimization of Deep Neural Networks. CoRR (2018)
Xiangru Lian, Wei Zhang, Ce Zhang, Ji Liu
Asynchronous Decentralized Parallel Stochastic Gradient Descent. CoRR (2017)
Xiangru Lian, Ce Zhang, Huan Zhang, Cho-Jui Hsieh, Wei Zhang, Ji Liu
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent. CoRR (2017)
Xiangru Lian, Ce Zhang, Huan Zhang, Cho-Jui Hsieh, Wei Zhang, Ji Liu
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent. NIPS (2017)
Suyog Gupta, Wei Zhang, Fei Wang
Model Accuracy and Runtime Tradeoff in Distributed Deep Learning: A Systematic Study. IJCAI (2017)
Olivier Tardieu, Benjamin Herta, David Cunningham, David Grove, Prabhanjan Kambadur, Vijay A. Saraswat, Avraham Shinnar, Mikio Takeuchi, Mandana Vaziri, Wei Zhang
X10 and APGAS at Petascale. ACM Trans. Parallel Comput. 2 (4) (2016)
Suyog Gupta, Wei Zhang, Fei Wang
Model Accuracy and Runtime Tradeoff in Distributed Deep Learning: A Systematic Study. ICDM (2016)
Wei Zhang, Suyog Gupta, Xiangru Lian, Ji Liu
Staleness-Aware Async-SGD for Distributed Deep Learning. IJCAI (2016)
Wei Zhang, Martin Hirzel, David Grove
AQuA: adaptive quality analytics. DEBS (2016)
Matthew Arnold, David Grove, Benjamin Herta, Michael Hind, Martin Hirzel, Arun Iyengar, Louis Mandel, Vijay A. Saraswat, Avraham Shinnar, Jérôme Siméon, Mikio Takeuchi, Olivier Tardieu, Wei Zhang
META: Middleware for Events, Transactions, and Analytics. IBM J. Res. Dev. 60 (2-3) (2016)
Suyog Gupta, Wei Zhang, Josh Milthorpe
Model Accuracy and Runtime Tradeoff in Distributed Deep Learning. CoRR (2015)
Dongdong Deng, Guoliang Jin, Marc de Kruijf, Ang Li, Ben Liblit, Shan Lu, Shanxiang Qi, Jinglei Ren, Karthikeyan Sankaralingam, Linhai Song, Yongwei Wu, Mingxing Zhang, Wei Zhang, Weimin Zheng
Fixing, preventing, and recovering from concurrency bugs. Sci. China Inf. Sci. 58 (5) (2015)
Wei Zhang, Suyog Gupta, Xiangru Lian, Ji Liu
Staleness-aware Async-SGD for Distributed Deep Learning. CoRR (2015)
Wei Zhang, Olivier Tardieu, David Grove, Benjamin Herta, Tomio Kamada, Vijay A. Saraswat, Mikio Takeuchi
GLB: lifeline-based global load balancing library in x10. PPAA@PPoPP (2014)
Wei Zhang, Marc de Kruijf, Ang Li, Shan Lu, Karthikeyan Sankaralingam
ConAir: featherweight concurrency bug recovery via single-threaded idempotent execution. ASPLOS (2013)
Wei Zhang, Olivier Tardieu, David Grove, Benjamin Herta, Tomio Kamada, Vijay A. Saraswat, Mikio Takeuchi
GLB: Lifeline-based Global Load Balancing library in X10. CoRR (2013)
Wei Zhang, Chong Sun, Junghee Lim, Shan Lu, Thomas W. Reps
ConMem: Detecting Crash-Triggering Concurrency Bugs through an Effect-Oriented Approach. ACM Trans. Softw. Eng. Methodol. 22 (2) (2013)
Dongdong Deng, Wei Zhang, Shan Lu
Efficient concurrency-bug detection across inputs. OOPSLA (2013)
Dongdong Deng, Wei Zhang, Borui Wang, Peisen Zhao, Shan Lu
Understanding the Interleaving-Space Overlap across Inputs and Software Versions. HotPar (2012)
Guoliang Jin, Wei Zhang, Dongdong Deng
Automated Concurrency-Bug Fixing. OSDI (2012)
Guoliang Jin, Linhai Song, Wei Zhang, Shan Lu, Ben Liblit
Automated atomicity-violation fixing. PLDI (2011)
Wei Zhang, Junghee Lim, Ramya Olichandran, Joel Scherpelz, Guoliang Jin, Shan Lu, Thomas W. Reps
ConSeq: detecting concurrency bugs through sequential errors. ASPLOS (2011)
Wei Zhang, Chong Sun, Shan Lu
ConMem: detecting severe concurrency bugs through an effect-oriented approach. ASPLOS (2010)
Wei Zhang, Xiaodong Cui
Applying scalable phonetic context similarity in unit selection of concatenative text-to-speech. INTERSPEECH (2010)
Xiaodong Cui, Liang Gu, Bing Xiang, Wei Zhang, Yuqing Gao
Developing high performance asr in the IBM multilingual speech-to-speech translation system. ICASSP (2008)
Raul Fernandez, Wei Zhang, Ellen Eide, Raimo Bakis, Wael Hamza, Yi Liu, Michael Picheny, John F. Pitrelli, Yong Qing, Zhiwei Shuang, Li Qin Shen
Toward multiple-language TTS: experiments in English and Mandarin. INTERSPEECH (2005)