M. Saiful Bari

Publication Activity (10 Years)

Years Active: 2019-2024
Publications (10 Years): 30

Top Topics

Comprehensive Evaluation

Natural Language

Top Venues

Publications

Mohsinul Kabir, Mohammed Saidul Islam, Md. Tahmid Rahman Laskar, Mir Tafseer Nayeem, M. Saiful Bari, Enamul Hoque
BenLLM-Eval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLP. LREC/COLING (2024)
Norah Alzahrani, Hisham Abdullah Alyahya, Yazeed Alnumay, Sultan Alrashed, Shaykhah Alsubaie, Yousef Almushayqih, Faisal Mirza, Nouf Alotaibi, Nora Al-Twairesh, Areeb Alowisheq, M. Saiful Bari, Haidar Khan
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards. ACL (1) (2024)
Norah Alzahrani, Hisham Abdullah Alyahya, Yazeed Alnumay, Sultan Alrashed, Shaykhah Alsubaie, Yusef Almushaykeh, Faisal Mirza, Nouf Alotaibi, Nora Al-Twairesh, Areeb Alowisheq, M. Saiful Bari, Haidar Khan
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards. CoRR (2024)
M. Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, Nouf M. Alotaibi, Hisham Abdullah Alyahya, Sultan Alrashed, Faisal Mirza, Shaykhah Alsubaie, Hassan A. Alahmed, Ghadah Alabduljabbar, Raghad Alkhathran, Yousef Almushayqih, Raneem Alnajim, Salman Alsubaihi, Maryam Al Mansour, Majed Alrubaian, Ali Alammari, Zaki Alawami, Abdulmohsen Al-Thubaity, Ahmed Abdelali, Jeril Kuriakose, Abdalghani Abujabal, Nora Al-Twairesh, Areeb Alowisheq, Haidar Khan
ALLaM: Large Language Models for Arabic and English. CoRR (2024)
Md. Tahmid Rahman Laskar, Sawsan Alqahtani, M. Saiful Bari, Mizanur Rahman, Mohammad Abdullah Matin Khan, Haidar Khan, Israt Jahan, Amran Bhuiyan, Chee Wei Tan, Md. Rizwan Parvez, Enamul Hoque, Shafiq Joty, Jimmy Xiangji Huang
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations. CoRR (2024)
Mohammad Abdullah Matin Khan, M. Saiful Bari, Xuan Do Long, Weishi Wang, Md. Rizwan Parvez, Shafiq Joty
XCodeEval: An Execution-based Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval. ACL (1) (2024)
Mohsinul Kabir, Mohammed Saidul Islam, Md. Tahmid Rahman Laskar, Mir Tafseer Nayeem, M. Saiful Bari, Enamul Hoque
BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLP. CoRR (2023)
Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M. Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward Raff, Colin Raffel
Crosslingual Generalization through Multitask Finetuning. ACL (1) (2023)
Mohammad Abdullah Matin Khan, M. Saiful Bari, Xuan Long Do, Weishi Wang, Md. Rizwan Parvez, Shafiq R. Joty
xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval. CoRR (2023)
Md. Tahmid Rahman Laskar, M. Saiful Bari, Mizanur Rahman, Md Amran Hossen Bhuiyan, Shafiq Joty, Jimmy X. Huang
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets. ACL (Findings) (2023)
Md. Tahmid Rahman Laskar, M. Saiful Bari, Mizanur Rahman, Md Amran Hossen Bhuiyan, Shafiq Joty, Jimmy Xiangji Huang
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets. CoRR (2023)
Zheng Xin Yong, Hailey Schoelkopf, Niklas Muennighoff, Alham Fikri Aji, David Ifeoluwa Adelani, Khalid Almubarak, M. Saiful Bari, Lintang Sutawika, Jungo Kasai, Ahmed Baruwa, Genta Indra Winata, Stella Biderman, Edward Raff, Dragomir Radev, Vassilina Nikoulina
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting. ACL (1) (2023)
Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
What Language Model to Train if You Have One Million GPU Hours? CoRR (2022)
Zheng Xin Yong, Hailey Schoelkopf, Niklas Muennighoff, Alham Fikri Aji, David Ifeoluwa Adelani, Khalid Almubarak, M. Saiful Bari, Lintang Sutawika, Jungo Kasai, Ahmed Baruwa, Genta Indra Winata, Stella Biderman, Dragomir Radev, Vassilina Nikoulina
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting. CoRR (2022)
Stephen H. Bach, Victor Sanh, Zheng Xin Yong, Albert Webson, Colin Raffel, Nihal V. Nayak, Abheesht Sharma, Taewoon Kim, M. Saiful Bari, Thibault Févry, Zaid Alyafeai, Manan Dey, Andrea Santilli, Zhiqing Sun, Srulik Ben-David, Canwen Xu, Gunjan Chhablani, Han Wang, Jason Alan Fries, Maged Saeed AlShaibani, Shanya Sharma, Urmish Thakker, Khalid Almubarak, Xiangru Tang, Mike Tian-Jian Jiang, Alexander M. Rush
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts. CoRR (2022)
Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M. Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward Raff, Colin Raffel
Crosslingual Generalization through Multitask Finetuning. CoRR (2022)
M. Saiful Bari, Aston Zhang, Shuai Zheng, Xingjian Shi, Yi Zhu, Shafiq Joty, Mu Li
SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning. CoRR (2022)
Stephen H. Bach, Victor Sanh, Zheng Xin Yong, Albert Webson, Colin Raffel, Nihal V. Nayak, Abheesht Sharma, Taewoon Kim, M. Saiful Bari, Thibault Févry, Zaid Alyafeai, Manan Dey, Andrea Santilli, Zhiqing Sun, Srulik Ben-David, Canwen Xu, Gunjan Chhablani, Han Wang, Jason Alan Fries, Maged Saeed AlShaibani, Shanya Sharma, Urmish Thakker, Khalid Almubarak, Xiangru Tang, Dragomir R. Radev, Mike Tian-Jian Jiang, Alexander M. Rush
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts. ACL (demo) (2022)
Teven Le Scao, Thomas Wang, Daniel Hesslow, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
What Language Model to Train if You Have One Million GPU Hours? EMNLP (Findings) (2022)
Tasnim Mohiuddin, M. Saiful Bari, Shafiq R. Joty
AugVic: Exploiting BiText Vicinity for Low-Resource NMT. ACL/IJCNLP (Findings) (2021)
M. Saiful Bari, Batool Haider, Saab Mansour
Nearest Neighbour Few-Shot Learning for Cross-lingual Classification. EMNLP (1) (2021)
Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M. Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal V. Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Févry, Jason Alan Fries, Ryan Teehan, Stella Biderman, Leo Gao, Tali Bers, Thomas Wolf, Alexander M. Rush
Multitask Prompted Training Enables Zero-Shot Task Generalization. CoRR (2021)
M. Saiful Bari, Batool Haider, Saab Mansour
Nearest Neighbour Few-Shot Learning for Cross-lingual Classification. CoRR (2021)
Tasnim Mohiuddin, M. Saiful Bari, Shafiq R. Joty
AUGVIC: Exploiting BiText Vicinity for Low-Resource NMT. CoRR (2021)
M. Saiful Bari, Tasnim Mohiuddin, Shafiq R. Joty
UXLA: A Robust Unsupervised Data Augmentation Framework for Zero-Resource Cross-Lingual NLP. ACL/IJCNLP (1) (2021)
Tasnim Mohiuddin, M. Saiful Bari, Shafiq Rayhan Joty
LNMap: Departures from Isomorphic Assumption in Bilingual Lexicon Induction Through Non-Linear Mapping in Latent Space. EMNLP (1) (2020)
M. Saiful Bari, Shafiq R. Joty, Prathyusha Jwalapuram
Zero-Resource Cross-Lingual Named Entity Recognition. AAAI (2020)
Tasnim Mohiuddin, M. Saiful Bari, Shafiq R. Joty
LNMap: Departures from Isomorphic Assumption in Bilingual Lexicon Induction Through Non-Linear Mapping in Latent Space. CoRR (2020)
M. Saiful Bari, Muhammad Tasnim Mohiuddin, Shafiq R. Joty
MultiMix: A Robust Data Augmentation Strategy for Cross-Lingual NLP. CoRR (2020)
M. Saiful Bari, Shafiq R. Joty, Prathyusha Jwalapuram
Zero-Resource Cross-Lingual Named Entity Recognition. CoRR (2019)