Hangbo Bao

Publication Activity (10 Years)

Years Active: 2017-2024
Publications (10 Years): 31

Top Topics

Secure Multi Party Computation

Reading Comprehension

Top Venues

ACL/IJCNLP (Findings)

Publications

Hangbo Bao, Li Dong, Wenhui Wang, Nan Yang, Songhao Piao, Furu Wei
Fine-tuning pretrained transformer encoders for sequence-to-sequence learning. Int. J. Mach. Learn. Cybern. 15 (5) (2024)
Zhiliang Peng, Li Dong, Hangbo Bao, Furu Wei, Qixiang Ye
A Unified View of Masked Image Modeling. Trans. Mach. Learn. Res. 2023 (2023)
Yuxin Fang, Li Dong, Hangbo Bao, Xinggang Wang, Furu Wei
Corrupted Image Modeling for Self-Supervised Visual Pre-Training. ICLR (2023)
Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei
Image as a Foreign Language: BEIT Pretraining for Vision and Vision-Language Tasks. CVPR (2023)
Shengqiang Zhang, Xingxing Zhang, Hangbo Bao, Furu Wei
Attention Temperature Matters in Abstractive Summarization Distillation. ACL (1) (2022)
Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li, Furu Wei
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption. CoRR (2022)
Zhiliang Peng, Li Dong, Hangbo Bao, Qixiang Ye, Furu Wei
A Unified View of Masked Image Modeling. CoRR (2022)
Yuxin Fang, Li Dong, Hangbo Bao, Xinggang Wang, Furu Wei
Corrupted Image Modeling for Self-Supervised Visual Pre-Training. CoRR (2022)
Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks. CoRR (2022)
Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li, Furu Wei
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption. ACL (Findings) (2022)
Hangbo Bao, Wenhui Wang, Li Dong, Furu Wei
VL-BEiT: Generative Vision-Language Pretraining. CoRR (2022)
Hangbo Bao, Wenhui Wang, Li Dong, Qiang Liu, Owais Khan Mohammed, Kriti Aggarwal, Subhojit Som, Songhao Piao, Furu Wei
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. NeurIPS (2022)
Hangbo Bao, Li Dong, Songhao Piao, Furu Wei
BEiT: BERT Pre-Training of Image Transformers. ICLR (2022)
Zhiliang Peng, Li Dong, Hangbo Bao, Qixiang Ye, Furu Wei
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers. CoRR (2022)
Hangbo Bao, Li Dong, Wenhui Wang, Nan Yang, Furu Wei
s2s-ft: Fine-Tuning Pretrained Transformer Encoders for Sequence-to-Sequence Learning. CoRR (2021)
Wenhui Wang, Hangbo Bao, Li Dong, Furu Wei
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. CoRR (2021)
Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, Furu Wei
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers. ACL/IJCNLP (Findings) (2021)
Yaru Hao, Li Dong, Hangbo Bao, Ke Xu, Furu Wei
Learning to Sample Replacements for ELECTRA Pre-Training. ACL/IJCNLP (Findings) (2021)
Hangbo Bao, Li Dong, Furu Wei
BEiT: BERT Pre-Training of Image Transformers. CoRR (2021)
Yaru Hao, Li Dong, Hangbo Bao, Ke Xu, Furu Wei
Learning to Sample Replacements for ELECTRA Pre-Training. CoRR (2021)
Shengqiang Zhang, Xingxing Zhang, Hangbo Bao, Furu Wei
Attention Temperature Matters in Abstractive Summarization Distillation. CoRR (2021)
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training. CoRR (2020)
Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers. NeurIPS (2020)
Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers. CoRR (2020)
Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, Furu Wei
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers. CoRR (2020)
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Jianfeng Gao, Songhao Piao, Ming Zhou, Hsiao-Wuen Hon
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training. ICML (2020)
Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu, Chuanqi Tan, Songhao Piao, Ming Zhou
Neural Melody Composition from Lyrics. NLPCC (1) (2019)
Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Lei Cui, Songhao Piao, Ming Zhou
Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension. MRQA@EMNLP (2019)
Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu, Chuanqi Tan, Songhao Piao, Ming Zhou
Neural Melody Composition from Lyrics. CoRR (2018)
Qingyu Zhou, Nan Yang, Furu Wei, Chuanqi Tan, Hangbo Bao, Ming Zhou
Neural Question Generation from Text: A Preliminary Study. NLPCC (2017)
Qingyu Zhou, Nan Yang, Furu Wei, Chuanqi Tan, Hangbo Bao, Ming Zhou
Neural Question Generation from Text: A Preliminary Study. CoRR (2017)