Shaohan Huang

ORCID

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 132

Top Venues

Publications

Jiaxing Qi, Zhongzhi Luan, Shaohan Huang, Carol J. Fung, Hailong Yang
LogSay: An Efficient Comprehension System for Log Numerical Reasoning. IEEE Trans. Computers 73 (7) (2024)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
Calibrating LLM-Based Evaluator. LREC/COLING (2024)
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, Jilong Xue, Furu Wei
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits. CoRR (2024)
Jiaxing Qi, Zhongzhi Luan, Shaohan Huang, Carol J. Fung, Hailong Yang, Depei Qian
FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning. CoRR (2024)
Daixuan Cheng, Shaohan Huang, Furu Wei
Adapting Large Language Models via Reading Comprehension. ICLR (2024)
Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
Kosmos-G: Generating Images in Context with Multimodal Large Language Models. ICLR (2024)
Xun Wu, Shaohan Huang, Furu Wei
Mixture of LoRA Experts. CoRR (2024)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
Text Diffusion with Reinforced Conditioning. AAAI (2024)
Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang
Improving Domain Adaptation through Extended-Text Reading Comprehension. CoRR (2024)
Xun Wu, Shaohan Huang, Furu Wei
Mixture of LoRA Experts. ICLR (2024)
Haoyu Liu, Jianfeng Liu, Shaohan Huang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Furu Wei, Qi Zhang
Se²: Sequential Example Selection for In-Context Learning. ACL (Findings) (2024)
Xun Wu, Shaohan Huang, Wenhui Wang, Furu Wei
Multi-Head Mixture-of-Experts. CoRR (2024)
Shuhua Shi, Shaohan Huang, Minghui Song, Zhoujun Li, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
ResLoRA: Identity Residual Mapping in Low-Rank Adaption. ACL (Findings) (2024)
Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning. CoRR (2024)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition. CoRR (2024)
Haoyu Liu, Jianfeng Liu, Shaohan Huang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Furu Wei, Qi Zhang
: Sequential Example Selection for In-Context Learning. CoRR (2024)
Yizhen Li, Shaohan Huang, Jiaxing Qi, Lei Quan, Dongran Han, Zhongzhi Luan
Exploring the Comprehension of ChatGPT in Traditional Chinese Medicine Knowledge. CoRR (2024)
Daixuan Cheng, Yuxian Gu, Shaohan Huang, Junyu Bi, Minlie Huang, Furu Wei
Instruction Pre-Training: Language Models are Supervised Multitask Learners. CoRR (2024)
Shuhua Shi, Shaohan Huang, Minghui Song, Zhoujun Li, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
ResLoRA: Identity Residual Mapping in Low-Rank Adaption. CoRR (2024)
Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, Qixiang Ye, Furu Wei
Grounding Multimodal Large Language Models to the World. ICLR (2024)
Shaohan Huang, Yi Liu, Jiaxing Qi, Jing Shang, Zhiwen Xiao, Carol J. Fung, Zhihui Wu, Hailong Yang, Zhongzhi Luan, Depei Qian
Gloss: Guiding Large Language Models to Answer Questions from System Logs. SANER (2024)
Haoran Li, Qingxiu Dong, Zhengyang Tang, Chaojun Wang, Xingxing Zhang, Haoyang Huang, Shaohan Huang, Xiaolong Huang, Zeqiang Huang, Dongdong Zhang, Yuxian Gu, Xin Cheng, Xun Wang, Si-Qing Chen, Li Dong, Wei Lu, Zhifang Sui, Benyou Wang, Wai Lam, Furu Wei
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models. CoRR (2024)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
Text Diffusion with Reinforced Conditioning. CoRR (2024)
Yutao Sun, Li Dong, Yi Zhu, Shaohan Huang, Wenhui Wang, Shuming Ma, Quanlu Zhang, Jianyong Wang, Furu Wei
You Only Cache Once: Decoder-Decoder Architectures for Language Models. CoRR (2024)
Xun Wu, Shaohan Huang, Furu Wei
Multimodal Large Language Model is a Human-Aligned Annotator for Text-to-Image Generation. CoRR (2024)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition. ACL (1) (2024)
Daixuan Cheng, Shaohan Huang, Junyu Bi, Yuefeng Zhan, Jianfeng Liu, Yujing Wang, Hao Sun, Furu Wei, Denvy Deng, Qi Zhang
UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation. CoRR (2023)
Beiduo Chen, Shaohan Huang, Zihan Zhang, Wu Guo, Zhenhua Ling, Haizhen Huang, Furu Wei, Weiwei Deng, Qi Zhang
Pre-training Language Model as a Multi-perspective Course Learner. ACL (Findings) (2023)
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
Magneto: A Foundation Transformer. ICML (2023)
Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, Furu Wei
Kosmos-2: Grounding Multimodal Large Language Models to the World. CoRR (2023)
Jiaxing Qi, Shaohan Huang, Zhongzhi Luan, Carol J. Fung, Hailong Yang, Depei Qian
LogGPT: Exploring ChatGPT for Log-Based Anomaly Detection. CoRR (2023)
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
BitNet: Scaling 1-bit Transformers for Large Language Models. CoRR (2023)
Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Furu Wei, Zhoujun Li
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator. ACL (1) (2023)
Zhaoyang Wang, Shaohan Huang, Yuxuan Liu, Jiahai Wang, Minghui Song, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
Democratizing Reasoning Ability: Tailored Learning from Large Language Model. EMNLP (2023)
Shaohan Huang, Yi Liu, Carol J. Fung, Jiaxing Qi, Hailong Yang, Zhongzhi Luan
LogQA: Question Answering in Unstructured Logs. CoRR (2023)
Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
Kosmos-G: Generating Images in Context with Multimodal Large Language Models. CoRR (2023)
Beiduo Chen, Shaohan Huang, Zihan Zhang, Wu Guo, Zhenhua Ling, Haizhen Huang, Furu Wei, Weiwei Deng, Qi Zhang
Pre-training Language Model as a Multi-perspective Course Learner. CoRR (2023)
Tianyu Chen, Yuan Xie, Shuai Zhang, Shaohan Huang, Haoyi Zhou, Jianxin Li
Learning Music Sequence Representation from Text Supervision. CoRR (2023)
Daixuan Cheng, Shaohan Huang, Furu Wei
Adapting Large Language Models via Reading Comprehension. CoRR (2023)
Jiayu Ding, Shuming Ma, Li Dong, Xingxing Zhang, Shaohan Huang, Wenhui Wang, Nanning Zheng, Furu Wei
LongNet: Scaling Transformers to 1, 000, 000, 000 Tokens. CoRR (2023)
Jiaxing Qi, Shaohan Huang, Zhongzhi Luan, Shu Yang, Carol J. Fung, Hailong Yang, Depei Qian, Jing Shang, Zhiwen Xiao, Zhihui Wu
LogGPT: Exploring ChatGPT for Log-Based Anomaly Detection. HPCC/DSS/SmartCity/DependSys (2023)
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Nils Johan Bertil Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei
Language Is Not All You Need: Aligning Perception with Language Models. NeurIPS (2023)
Ziheng Li, Shaohan Huang, Zihan Zhang, Zhi-Hong Deng, Qiang Lou, Haizhen Huang, Jian Jiao, Furu Wei, Weiwei Deng, Qi Zhang
Dual-Alignment Pre-training for Cross-lingual Sentence Embedding. CoRR (2023)
Ziheng Li, Shaohan Huang, Zihan Zhang, Zhi-Hong Deng, Qiang Lou, Haizhen Huang, Jian Jiao, Furu Wei, Weiwei Deng, Qi Zhang
Dual-Alignment Pre-training for Cross-lingual Sentence Embedding. ACL (1) (2023)
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
Kosmos-2.5: A Multimodal Literate Model. CoRR (2023)
Jiaxing Qi, Zhongzhi Luan, Shaohan Huang, Carol J. Fung, Hailong Yang, Hanlu Li, Danfeng Zhu, Depei Qian
LogEncoder: Log-Based Contrastive Representation Learning for Anomaly Detection. IEEE Trans. Netw. Serv. Manag. 20 (2) (2023)
Yuan Xie, Shaohan Huang, Tianyu Chen, Furu Wei
MoEC: Mixture of Expert Clusters. AAAI (2023)
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
Retentive Network: A Successor to Transformer for Large Language Models. CoRR (2023)
Daixuan Cheng, Shaohan Huang, Junyu Bi, Yuefeng Zhan, Jianfeng Liu, Yujing Wang, Hao Sun, Furu Wei, Weiwei Deng, Qi Zhang
UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation. EMNLP (2023)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
Calibrating LLM-Based Evaluator. CoRR (2023)
Shaohan Huang, Yi Liu, Carol J. Fung, He Wang, Hailong Yang, Zhongzhi Luan
Improving Log-Based Anomaly Detection by Pre-Training Hierarchical Transformers. IEEE Trans. Computers 72 (9) (2023)
Ting Jiang, Shaohan Huang, Zhongzhi Luan, Deqing Wang, Fuzhen Zhuang
Scaling Sentence Embeddings with Large Language Models. CoRR (2023)
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei
Language Is Not All You Need: Aligning Perception with Language Models. CoRR (2023)
Zhaoyang Wang, Shaohan Huang, Yuxuan Liu, Jiahai Wang, Minghui Song, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
Democratizing Reasoning Ability: Tailored Learning from Large Language Model. CoRR (2023)
Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. ACL (1) (2023)
Yutao Sun, Li Dong, Barun Patra, Shuming Ma, Shaohan Huang, Alon Benhaim, Vishrav Chaudhary, Xia Song, Furu Wei
A Length-Extrapolatable Transformer. ACL (1) (2023)
Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei
CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation. CoRR (2022)
Shaozhi Dai, Zhongzhi Luan, Shaohan Huang, Carol J. Fung, He Wang, Hailong Yang, Depei Qian
REVAL: Recommend Which Variables to Log With Pretrained Model and Graph Neural Network. IEEE Trans. Netw. Serv. Manag. 19 (4) (2022)
Shuming Ma, Hongyu Wang, Shaohan Huang, Wenhui Wang, Zewen Chi, Li Dong, Alon Benhaim, Barun Patra, Vishrav Chaudhary, Xia Song, Furu Wei
TorchScale: Transformers at Scale. CoRR (2022)
Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Bo Zheng, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. ACL (1) (2022)
Ting Jiang, Jian Jiao, Shaohan Huang, Zihan Zhang, Deqing Wang, Fuzhen Zhuang, Furu Wei, Haizhen Huang, Denvy Deng, Qi Zhang
PromptBERT: Improving BERT Sentence Embeddings with Prompts. EMNLP (2022)
Tianyu Chen, Yuan Xie, Shuai Zhang, Shaohan Huang, Haoyi Zhou, Jianxin Li
Learning Music Sequence Representation From Text Supervision. ICASSP (2022)
Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. CoRR (2022)
Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li, Furu Wei
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption. CoRR (2022)
Yaru Hao, Haoyu Song, Li Dong, Shaohan Huang, Zewen Chi, Wenhui Wang, Shuming Ma, Furu Wei
Language Models are General-Purpose Interfaces. CoRR (2022)
Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei
CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation. EMNLP (Findings) (2022)
Yunzhi Yao, Shaohan Huang, Ningyu Zhang, Li Dong, Furu Wei, Huajun Chen
Kformer: Knowledge Injection in Transformer Feed-Forward Layers. CoRR (2022)
Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Zhoujun Li, Furu Wei
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator. CoRR (2022)
Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei
On the Representation Collapse of Sparse Mixture of Experts. NeurIPS (2022)
Shaohan Huang, Yi Liu, Carol J. Fung, Hailong Yang, Zhongzhi Luan
Black-box Attacks to Log-based Anomaly Detection. CNSM (2022)
Jiaxing Qi, Zhongzhi Luan, Shaohan Huang, Yukun Wang, Carol J. Fung, Hailong Yang, Depei Qian
Adanomaly: Adaptive Anomaly Detection for System Logs with Adversarial Learning. NOMS (2022)
Ting Jiang, Shaohan Huang, Zihan Zhang, Deqing Wang, Fuzhen Zhuang, Furu Wei, Haizhen Huang, Liangjie Zhang, Qi Zhang
PromptBERT: Improving BERT Sentence Embeddings with Prompts. CoRR (2022)
Yunzhi Yao, Shaohan Huang, Li Dong, Furu Wei, Huajun Chen, Ningyu Zhang
Kformer: Knowledge Injection in Transformer Feed-Forward Layers. NLPCC (1) (2022)
Daixuan Cheng, Shaohan Huang, Jianfeng Liu, Yuefeng Zhan, Hao Sun, Furu Wei, Denvy Deng, Qi Zhang
Snapshot-Guided Domain Adaptation for ELECTRA. EMNLP (Findings) (2022)
Yutao Sun, Li Dong, Barun Patra, Shuming Ma, Shaohan Huang, Alon Benhaim, Vishrav Chaudhary, Xia Song, Furu Wei
A Length-Extrapolatable Transformer. CoRR (2022)
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Dongdong Zhang, Furu Wei
DeepNet: Scaling Transformers to 1, 000 Layers. CoRR (2022)
Xin Sui, Guifen Shi, Guanchong Hou, Shaohan Huang, Yanshuang Li
Impacts of COVID-19 on the Return and Volatility Nexus among Cryptocurrency Market. Complex. 2022 (2022)
Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li, Furu Wei
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption. ACL (Findings) (2022)
Tianyu Chen, Shaohan Huang, Yuan Xie, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li, Furu Wei
Task-Specific Expert Pruning for Sparse Mixture-of-Experts. CoRR (2022)
Yuan Xie, Shaohan Huang, Tianyu Chen, Furu Wei
MoEC: Mixture of Expert Clusters. CoRR (2022)
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
Foundation Transformers. CoRR (2022)
Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei
On the Representation Collapse of Sparse Mixture of Experts. CoRR (2022)
Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. CoRR (2021)
Shuming Ma, Li Dong, Shaohan Huang, Dongdong Zhang, Alexandre Muzio, Saksham Singhal, Hany Hassan Awadalla, Xia Song, Furu Wei
DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders. CoRR (2021)
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Consistency Regularization for Cross-Lingual Fine-Tuning. CoRR (2021)
Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, Furu Wei
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers. ACL/IJCNLP (Findings) (2021)
Yunzhi Yao, Shaohan Huang, Wenhui Wang, Li Dong, Furu Wei
Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains. CoRR (2021)
Zewen Chi, Li Dong, Bo Zheng, Shaohan Huang, Xian-Ling Mao, Heyan Huang, Furu Wei
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment. ACL/IJCNLP (1) (2021)
Yunzhi Yao, Shaohan Huang, Wenhui Wang, Li Dong, Furu Wei
Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains. ACL/IJCNLP (Findings) (2021)
Ruiyuan Gao, Hailong Yang, Shaohan Huang, Ming Dun, Mingzhen Li, Zerong Luan, Zhongzhi Luan, Depei Qian
PriPro: Towards Effective Privacy Protection on Edge-Cloud System running DNN Inference. CCGRID (2021)
Zewen Chi, Li Dong, Shuming Ma, Shaohan Huang, Saksham Singhal, Xian-Ling Mao, Heyan Huang, Xia Song, Furu Wei
mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. EMNLP (1) (2021)
Jian Yang, Shuming Ma, Haoyang Huang, Dongdong Zhang, Li Dong, Shaohan Huang, Alexandre Muzio, Saksham Singhal, Hany Hassan, Xia Song, Furu Wei
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task. WMT@EMNLP (2021)
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Consistency Regularization for Cross-Lingual Fine-Tuning. ACL/IJCNLP (1) (2021)
Ting Jiang, Shaohan Huang, Zihan Zhang, Deqing Wang, Fuzhen Zhuang, Furu Wei, Haizhen Huang, Liangjie Zhang, Qi Zhang
Improving Non-autoregressive Generation with Mixup Training. CoRR (2021)
Bo Zheng, Li Dong, Shaohan Huang, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training. CoRR (2021)
Jian Yang, Shuming Ma, Haoyang Huang, Dongdong Zhang, Li Dong, Shaohan Huang, Alexandre Muzio, Saksham Singhal, Hany Hassan Awadalla, Xia Song, Furu Wei
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task. CoRR (2021)
Zewen Chi, Li Dong, Bo Zheng, Shaohan Huang, Xian-Ling Mao, Heyan Huang, Furu Wei
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment. CoRR (2021)
Bo Zheng, Li Dong, Shaohan Huang, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Allocating Large Vocabulary Capacity for Cross-Lingual Language Model Pre-Training. EMNLP (1) (2021)
Zewen Chi, Li Dong, Shuming Ma, Shaohan Huang, Xian-Ling Mao, Heyan Huang, Furu Wei
mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. CoRR (2021)
Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou
LayoutLM: Pre-training of Text and Layout for Document Image Understanding. KDD (2020)

Shaohan Huang.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Shaohan Huang