Saksham Singhal

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 25

Top Topics

Machine Translation

Parallel Corpora

Pseudo Relevance Feedback

Top Venues

Publications

Kian Ahrabian, Alon Benhaim, Barun Patra, Jay Pujara, Saksham Singhal, Xia Song
On the Adaptation of Unlimiformer for Decoder-Only Transformers. LREC/COLING (2024)
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
Magneto: A Foundation Transformer. ICML (2023)
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Barun Patra, Qiang Liu, Kriti Aggarwal, Zewen Chi, Nils Johan Bertil Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei
Language Is Not All You Need: Aligning Perception with Language Models. NeurIPS (2023)
Shaohan Huang, Li Dong, Wenhui Wang, Yaru Hao, Saksham Singhal, Shuming Ma, Tengchao Lv, Lei Cui, Owais Khan Mohammed, Qiang Liu, Kriti Aggarwal, Zewen Chi, Johan Bjorck, Vishrav Chaudhary, Subhojit Som, Xia Song, Furu Wei
Language Is Not All You Need: Aligning Perception with Language Models. CoRR (2023)
Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei
Image as a Foreign Language: BEIT Pretraining for Vision and Vision-Language Tasks. CVPR (2023)
Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. ACL (1) (2023)
Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Bo Zheng, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. ACL (1) (2022)
Barun Patra, Saksham Singhal, Shaohan Huang, Zewen Chi, Li Dong, Furu Wei, Vishrav Chaudhary, Xia Song
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. CoRR (2022)
Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei
On the Representation Collapse of Sparse Mixture of Experts. NeurIPS (2022)
Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks. CoRR (2022)
Owais Khan Mohammed, Kriti Aggarwal, Qiang Liu, Saksham Singhal, Johan Bjorck, Subhojit Som
Bootstrapping a high quality multilingual multimodal dataset for Bletchley. ACML (2022)
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
Foundation Transformers. CoRR (2022)
Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei
On the Representation Collapse of Sparse Mixture of Experts. CoRR (2022)
Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. CoRR (2021)
Shuming Ma, Li Dong, Shaohan Huang, Dongdong Zhang, Alexandre Muzio, Saksham Singhal, Hany Hassan Awadalla, Xia Song, Furu Wei
DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders. CoRR (2021)
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Consistency Regularization for Cross-Lingual Fine-Tuning. CoRR (2021)
Zewen Chi, Li Dong, Shuming Ma, Shaohan Huang, Saksham Singhal, Xian-Ling Mao, Heyan Huang, Xia Song, Furu Wei
mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. EMNLP (1) (2021)
Jian Yang, Shuming Ma, Haoyang Huang, Dongdong Zhang, Li Dong, Shaohan Huang, Alexandre Muzio, Saksham Singhal, Hany Hassan, Xia Song, Furu Wei
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task. WMT@EMNLP (2021)
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Consistency Regularization for Cross-Lingual Fine-Tuning. ACL/IJCNLP (1) (2021)
Bo Zheng, Li Dong, Shaohan Huang, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training. CoRR (2021)
Zewen Chi, Li Dong, Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, Ming Zhou
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. NAACL-HLT (2021)
Jian Yang, Shuming Ma, Haoyang Huang, Dongdong Zhang, Li Dong, Shaohan Huang, Alexandre Muzio, Saksham Singhal, Hany Hassan Awadalla, Xia Song, Furu Wei
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task. CoRR (2021)
Bo Zheng, Li Dong, Shaohan Huang, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
Allocating Large Vocabulary Capacity for Cross-Lingual Language Model Pre-Training. EMNLP (1) (2021)
Zewen Chi, Li Dong, Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, Ming Zhou
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. CoRR (2020)
Shuming Ma, Jian Yang, Haoyang Huang, Zewen Chi, Li Dong, Dongdong Zhang, Hany Hassan Awadalla, Alexandre Muzio, Akiko Eriguchi, Saksham Singhal, Xia Song, Arul Menezes, Furu Wei
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders. CoRR (2020)
Saksham Singhal, Vikram Pudi
Dispersion Based Similarity for Mining Similar Papers in Citation Network. ICDM Workshops (2015)