Xia Song

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 62

Top Topics

Machine Translation

Resource Allocation

Top Venues

Publications

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat S. Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Amit Garg, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Eric Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olatunji Ruwase, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Masahiro Tanaka, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yue Zhang, Yunan Zhang, Xiren Zhou
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone. CoRR (2024)
Ying-Chun Lin, Jennifer Neville, Jack W. Stokes, Longqi Yang, Tara Safavi, Mengting Wan, Scott Counts, Siddharth Suri, Reid Andersen, Xiaofeng Xu, Deepak Gupta, Sujay Kumar Jauhar, Xia Song, Georg Buscher, Saurabh Tiwary, Brent J. Hecht, Jaime Teevan
Interpretable User Satisfaction Estimation for Conversational Systems with Large Language Models. CoRR (2024)
Xihui Lin, Yunan Zhang, Suyu Ge, Barun Patra, Vishrav Chaudhary, Xia Song
Efficient LLM Training and Serving with Heterogeneous Context Sharding among Attention Heads. CoRR (2024)
Kian Ahrabian, Alon Benhaim, Barun Patra, Jay Pujara, Saksham Singhal, Xia Song
On the Adaptation of Unlimiformer for Decoder-Only Transformers. LREC/COLING (2024)
Ying-Chun Lin, Jennifer Neville, Jack W. Stokes, Longqi Yang, Tara Safavi, Mengting Wan, Scott Counts, Siddharth Suri, Reid Andersen, Xiaofeng Xu, Deepak Gupta, Sujay Kumar Jauhar, Xia Song, Georg Buscher, Saurabh Tiwary, Brent J. Hecht, Jaime Teevan
Interpretable User Satisfaction Estimation for Conversational Systems with Large Language Models. ACL (1) (2024)
Kian Ahrabian, Xihui Lin, Barun Patra, Vishrav Chaudhary, Alon Benhaim, Jay Pujara, Xia Song
The Hitchhiker's Guide to Human Alignment with *PO. CoRR (2024)
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
Magneto: A Foundation Transformer. ICML (2023)
Linyuan Gong, Chenyan Xiong, Xiaodong Liu, Payal Bajaj, Yiqing Xie, Alvin Cheung, Jianfeng Gao, Xia Song
Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers. ACL (1) (2023)
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Nils Johan Bertil Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei
Language Is Not All You Need: Aligning Perception with Language Models. NeurIPS (2023)
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei
Language Is Not All You Need: Aligning Perception with Language Models. CoRR (2023)
Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. ACL (1) (2023)
Yutao Sun, Li Dong, Barun Patra, Shuming Ma, Shaohan Huang, Alon Benhaim, Vishrav Chaudhary, Xia Song, Furu Wei
A Length-Extrapolatable Transformer. ACL (1) (2023)
Linyuan Gong, Chenyan Xiong, Xiaodong Liu, Payal Bajaj, Yiqing Xie, Alvin Cheung, Jianfeng Gao, Xia Song
Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers. CoRR (2023)
Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song
Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators. CoRR (2022)
Shaden Smith, Mostofa Patwary, Brandon Norick, Patrick LeGresley, Samyam Rajbhandari, Jared Casper, Zhun Liu, Shrimai Prabhumoye, George Zerveas, Vijay Korthikanti, Elton Zheng, Rewon Child, Reza Yazdani Aminabadi, Julie Bernauer, Xia Song, Mohammad Shoeybi, Yuxiong He, Michael Houston, Saurabh Tiwary, Bryan Catanzaro
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model. CoRR (2022)
Shuming Ma, Hongyu Wang, Shaohan Huang, Wenhui Wang, Zewen Chi, Li Dong, Alon Benhaim, Barun Patra, Vishrav Chaudhary, Xia Song, Furu Wei
TorchScale: Transformers at Scale. CoRR (2022)
Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Bo Zheng, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. ACL (1) (2022)
Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. CoRR (2022)
Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei
On the Representation Collapse of Sparse Mixture of Experts. NeurIPS (2022)
Yutao Sun, Li Dong, Barun Patra, Shuming Ma, Shaohan Huang, Alon Benhaim, Vishrav Chaudhary, Xia Song, Furu Wei
A Length-Extrapolatable Transformer. CoRR (2022)
Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul N. Bennett, Jiawei Han, Xia Song
Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators. ICLR (2022)
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
Foundation Transformers. CoRR (2022)
Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Di He, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals. CoRR (2022)
Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei
On the Representation Collapse of Sparse Mixture of Experts. CoRR (2022)
Xia Song, Bo Xu, Zhenzhen Zhao
Can people experience romantic love for artificial intelligence? An empirical study of intelligent assistants. Inf. Manag. 59 (2) (2022)
Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining. NeurIPS (2021)
Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. CoRR (2021)
Shuming Ma, Li Dong, Shaohan Huang, Dongdong Zhang, Alexandre Muzio, Saksham Singhal, Hany Hassan Awadalla, Xia Song, Furu Wei
DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders. CoRR (2021)
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Consistency Regularization for Cross-Lingual Fine-Tuning. CoRR (2021)
Jianzhao Liu, Yunjiang Zuo, Nannan Wang, Fenghui Yuan, Xinhao Zhu, Lihua Zhang, Jingwei Zhang, Ying Sun, Ziyu Guo, Yuedong Guo, Xia Song, Changchun Song, Xiaofeng Xu
Comparative Analysis of Two Machine Learning Algorithms in Predicting Site-Level Net Ecosystem Exchange in Major Biomes. Remote. Sens. 13 (12) (2021)
Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining. CoRR (2021)
Zewen Chi, Li Dong, Shuming Ma, Shaohan Huang, Saksham Singhal, Xian-Ling Mao, Heyan Huang, Xia Song, Furu Wei
mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. EMNLP (1) (2021)
Jian Yang, Shuming Ma, Haoyang Huang, Dongdong Zhang, Li Dong, Shaohan Huang, Alexandre Muzio, Saksham Singhal, Hany Hassan, Xia Song, Furu Wei
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task. WMT@EMNLP (2021)
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Consistency Regularization for Cross-Lingual Fine-Tuning. ACL/IJCNLP (1) (2021)
Bo Zheng, Li Dong, Shaohan Huang, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training. CoRR (2021)
Qianlan Ying, Payal Bajaj, Budhaditya Deb, Yu Yang, Wei Wang, Bojia Lin, Milad Shokouhi, Xia Song, Yang Yang, Daxin Jiang
Language Scaling for Universal Suggested Replies Model. CoRR (2021)
Zewen Chi, Li Dong, Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, Ming Zhou
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. NAACL-HLT (2021)
Jian Yang, Shuming Ma, Haoyang Huang, Dongdong Zhang, Li Dong, Shaohan Huang, Alexandre Muzio, Saksham Singhal, Hany Hassan Awadalla, Xia Song, Furu Wei
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task. CoRR (2021)
Qianlan Ying, Payal Bajaj, Budhaditya Deb, Yu Yang, Wei Wang, Bojia Lin, Milad Shokouhi, Xia Song, Yang Yang, Daxin Jiang
Language Scaling for Universal Suggested Replies Model. NAACL-HLT (Industry Papers) (2021)
Bo Zheng, Li Dong, Shaohan Huang, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Allocating Large Vocabulary Capacity for Cross-Lingual Language Model Pre-Training. EMNLP (1) (2021)
Rong Chai, Xia Song, Qianbin Chen
Joint Task Offloading, CNN Layer Scheduling, and Resource Allocation in Cooperative Computing System. IEEE Syst. J. 14 (4) (2020)
Zewen Chi, Li Dong, Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, Ming Zhou
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. CoRR (2020)
Corbin Rosset, Chenyan Xiong, Xia Song, Daniel Campos, Nick Craswell, Saurabh Tiwary, Paul N. Bennett
Leading Conversational Search by Suggesting Useful Questions. WWW (2020)
Corby Rosset, Chenyan Xiong, Minh Phan, Xia Song, Paul N. Bennett, Saurabh Tiwary
Knowledge-Aware Language Model Pretraining. CoRR (2020)
Bita Darvish Rouhani, Daniel Lo, Ritchie Zhao, Ming Liu, Jeremy Fowers, Kalin Ovtcharov, Anna Vinogradsky, Sarah Massengill, Lita Yang, Ray Bittner, Alessandro Forin, Haishan Zhu, Taesik Na, Prerak Patel, Shuai Che, Lok Chand Koppaka, Xia Song, Subhojit Som, Kaustav Das, Saurabh T., Steven K. Reinhardt, Sitaram Lanka, Eric S. Chung, Doug Burger
Pushing the Limits of Narrow Precision Inferencing at Cloud Scale with Microsoft Floating Point. NeurIPS (2020)
Shuming Ma, Jian Yang, Haoyang Huang, Zewen Chi, Li Dong, Dongdong Zhang, Hany Hassan Awadalla, Alexandre Muzio, Akiko Eriguchi, Saksham Singhal, Xia Song, Arul Menezes, Furu Wei
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders. CoRR (2020)
Chen Zhao, Chenyan Xiong, Corby Rosset, Xia Song, Paul N. Bennett, Saurabh Tiwary
Transformer-XH: Multi-Evidence Reasoning with eXtra Hop Attention. ICLR (2020)
Hongfei Zhang, Xia Song, Chenyan Xiong, Corby Rosset, Paul N. Bennett, Nick Craswell, Saurabh Tiwary
Generic Intent Representation in Web Search. CoRR (2019)
Hongfei Zhang, Xia Song, Chenyan Xiong, Corby Rosset, Paul N. Bennett, Nick Craswell, Saurabh Tiwary
Generic Intent Representation in Web Search. SIGIR (2019)
Armen Aghajanyan, Xia Song, Saurabh Tiwary
Towards Language Agnostic Universal Representations. ACL (1) (2019)
Jia Wang, Xia Song, Qibing Jin, Dan Song
Research on recommender algorithm optimization based on statistics and preference model. AIPR (2019)
Shiqi Yang, Di Yin, Xia Song, Xiaoming Dong, Gunasekaran Manogaran, George Mastorakis, Constandinos X. Mavromoustakis, Jordi Mongay Batalla
Security situation assessment for massive MIMO systems for 5G communications. Future Gener. Comput. Syst. 98 (2019)
Xia Song, Rong Chai, Qianbin Chen
Joint Task Offloading, CNN Layer Scheduling and Resource Allocation in Cooperative Computing System. ChinaCom (1) (2019)
Corby Rosset, Bhaskar Mitra, Chenyan Xiong, Nick Craswell, Xia Song, Saurabh Tiwary
An Axiomatic Approach to Regularizing Neural Ranking Models. CoRR (2019)
Corby Rosset, Bhaskar Mitra, Chenyan Xiong, Nick Craswell, Xia Song, Saurabh Tiwary
An Axiomatic Approach to Regularizing Neural Ranking Models. SIGIR (2019)
Hamed Zamani, Bhaskar Mitra, Xia Song, Nick Craswell, Saurabh Tiwary
Neural Ranking Models with Multiple Document Fields. WSDM (2018)
Armen Aghajanyan, Xia Song, Saurabh Tiwary
Towards Language Agnostic Universal Representations. CoRR (2018)
Hamed Zamani, Bhaskar Mitra, Xia Song, Nick Craswell, Saurabh Tiwary
Neural Ranking Models with Multiple Document Fields. CoRR (2017)
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. CoCo@NIPS (2016)
Xia Song, Fang Huang
Research on the Application of Data Mining in the Field of Electronic Commerce. FSDM (2016)
Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. CoRR (2016)
Zhifu Tao, Huayou Chen, Xia Song, Ligang Zhou, Jinpei Liu
Uncertain linguistic fuzzy soft sets and their applications in group decision making. Appl. Soft Comput. 34 (2015)