Orhan Firat

Publication Activity (10 Years)

Years Active: 2012-2024
Publications (10 Years): 132

Top Venues

CoRR

ICLR

NeurIPS

ICML

Publications

Biao Zhang, Zhongtao Liu, Colin Cherry, Orhan Firat
When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method. ICLR (2024)
Biao Zhang, Zhongtao Liu, Colin Cherry, Orhan Firat
When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method. CoRR (2024)
Bernd Bohnet, Kevin Swersky, Rosanne Liu, Pranjal Awasthi, Azade Nova, Javier Snaider, Hanie Sedghi, Aaron T. Parisi, Michael Collins, Angeliki Lazaridou, Orhan Firat, Noah Fiedel
Long-Span Question-Answering: Automatic Question Generation and QA-System Ranking via Side-by-Side Evaluation. CoRR (2024)
Biao Zhang, Garrett Tanzer, Orhan Firat
Scaling Sign Language Translation. CoRR (2024)
Machel Reid, Nikolay Savinov, Denis Teplyashin, Dmitry Lepikhin, Timothy P. Lillicrap, Jean-Baptiste Alayrac, Radu Soricut, Angeliki Lazaridou, Orhan Firat, Julian Schrittwieser, Ioannis Antonoglou, Rohan Anil, Sebastian Borgeaud, Andrew M. Dai, Katie Millican, Ethan Dyer, Mia Glaese, Thibault Sottiaux, Benjamin Lee, Fabio Viola, Malcolm Reynolds, Yuanzhong Xu, James Molloy, Jilin Chen, Michael Isard, Paul Barham, Tom Hennigan, Ross McIlroy, Melvin Johnson, Johan Schalkwyk, Eli Collins, Eliza Rutherford, Erica Moreira, Kareem Ayoub, Megha Goel, Clemens Meyer, Gregory Thornton, Zhen Yang, Henryk Michalewski, Zaheer Abbas, Nathan Schucher, Ankesh Anand, Richard Ives, James Keeling, Karel Lenc, Salem Haykal, Siamak Shakeri, Pranav Shyam, Aakanksha Chowdhery, Roman Ring, Stephen Spencer, Eren Sezener, et al.
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. CoRR (2024)
Alex Jones, Isaac Caswell, Ishank Saxena, Orhan Firat
Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translation. CoRR (2023)
Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, Parker Riley, André Martins, Graham Neubig, Ankush Garg, Jonathan H. Clark, Markus Freitag, Orhan Firat
The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation. WMT (2023)
Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Slav Petrov, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy P. Lillicrap, Angeliki Lazaridou, Orhan Firat, James Molloy, Michael Isard, Paul Ronald Barham, Tom Hennigan, Benjamin Lee, Fabio Viola, Malcolm Reynolds, Yuanzhong Xu, Ryan Doherty, Eli Collins, Clemens Meyer, Eliza Rutherford, Erica Moreira, Kareem Ayoub, Megha Goel, George Tucker, Enrique Piqueras, Maxim Krikun, Iain Barr, Nikolay Savinov, Ivo Danihelka, Becca Roelofs, Anaïs White, Anders Andreassen, Tamara von Glehn, Lakshman Yagati, Mehran Kazemi, Lucas Gonzalez, Misha Khalman, Jakub Sygnowski, et al.
Gemini: A Family of Highly Capable Multimodal Models. CoRR (2023)
Andrea Schioppa, Xavier Garcia, Orhan Firat
Cross-Lingual Supervision improves Large Language Models Pre-training. CoRR (2023)
Patrick Fernandes, Behrooz Ghorbani, Xavier Garcia, Markus Freitag, Orhan Firat
Scaling Laws for Multilingual Neural Machine Translation. ICML (2023)
Jonathan Pilault, Xavier Garcia, Arthur Brazinskas, Orhan Firat
Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction. IJCNLP (1) (2023)
Dami Choi, Derrick Xin, Hamid Dadkhahi, Justin Gilmer, Ankush Garg, Orhan Firat, Chih-Kuan Yeh, Andrew M. Dai, Behrooz Ghorbani
Order Matters in the Presence of Dataset Imbalance for Multilingual Learning. NeurIPS (2023)
Yichi Zhang, Ankush Garg, Yuan Cao, Lukasz Lew, Behrooz Ghorbani, Zhiru Zhang, Orhan Firat
Binarized Neural Machine Translation. CoRR (2023)
Jonathan Pilault, Mahan Fathi, Orhan Firat, Chris Pal, Pierre-Luc Bacon, Ross Goroshin
Block-State Transformers. NeurIPS (2023)
Parker Riley, Timothy Dozat, Jan A. Botha, Xavier Garcia, Dan Garrette, Jason Riesa, Orhan Firat, Noah Constant
FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation. Trans. Assoc. Comput. Linguistics 11 (2023)
Yichi Zhang, Ankush Garg, Yuan Cao, Lukasz Lew, Behrooz Ghorbani, Zhiru Zhang, Orhan Firat
Binarized Neural Machine Translation. NeurIPS (2023)
Jonathan Pilault, Xavier Garcia, Arthur Brazinskas, Orhan Firat
Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction. CoRR (2023)
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
PaLM: Scaling Language Modeling with Pathways. J. Mach. Learn. Res. 24 (2023)
Xavier Garcia, Yamini Bansal, Colin Cherry, George F. Foster, Maxim Krikun, Fangxiaoyu Feng, Melvin Johnson, Orhan Firat
The unreasonable effectiveness of few-shot learning for machine translation. CoRR (2023)
Çaglar Gülçehre, Tom Le Paine, Srivatsan Srinivasan, Ksenia Konyushkova, Lotte Weerts, Abhishek Sharma, Aditya Siddhant, Alex Ahern, Miaosen Wang, Chenjie Gu, Wolfgang Macherey, Arnaud Doucet, Orhan Firat, Nando de Freitas
Reinforced Self-Training (ReST) for Language Modeling. CoRR (2023)
Alexander Jones, Isaac Caswell, Orhan Firat, Ishank Saxena
GATITOS: Using a New Multilingual Lexicon for Low-resource Machine Translation. EMNLP (2023)
Dami Choi, Derrick Xin, Hamid Dadkhahi, Justin Gilmer, Ankush Garg, Orhan Firat, Chih-Kuan Yeh, Andrew M. Dai, Behrooz Ghorbani
Order Matters in the Presence of Dataset Imbalance for Multilingual Learning. CoRR (2023)
Patrick Fernandes, Behrooz Ghorbani, Xavier Garcia, Markus Freitag, Orhan Firat
Scaling Laws for Multilingual Neural Machine Translation. CoRR (2023)
Hyung Won Chung, Noah Constant, Xavier Garcia, Adam Roberts, Yi Tay, Sharan Narang, Orhan Firat
UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretraining. CoRR (2023)
Xavier Garcia, Yamini Bansal, Colin Cherry, George F. Foster, Maxim Krikun, Melvin Johnson, Orhan Firat
The Unreasonable Effectiveness of Few-shot Learning for Machine Translation. ICML (2023)
Mahan Fathi, Jonathan Pilault, Pierre-Luc Bacon, Christopher Pal, Orhan Firat, Ross Goroshin
Block-State Transformer. CoRR (2023)
Sneha Kudugunta, Isaac Caswell, Biao Zhang, Xavier Garcia, Christopher A. Choquette-Choo, Katherine Lee, Derrick Xin, Aditya Kusupati, Romi Stella, Ankur Bapna, Orhan Firat
MADLAD-400: A Multilingual And Document-Level Large Audited Dataset. CoRR (2023)
Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, Parker Riley, André F. T. Martins, Graham Neubig, Ankush Garg, Jonathan H. Clark, Markus Freitag, Orhan Firat
The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation. CoRR (2023)
Sneha Kudugunta, Isaac Caswell, Biao Zhang, Xavier Garcia, Derrick Xin, Aditya Kusupati, Romi Stella, Ankur Bapna, Orhan Firat
MADLAD-400: A Multilingual And Document-Level Large Audited Dataset. NeurIPS (2023)
Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.
PaLM 2 Technical Report. CoRR (2023)
Hyung Won Chung, Xavier Garcia, Adam Roberts, Yi Tay, Orhan Firat, Sharan Narang, Noah Constant
UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining. ICLR (2023)
Yamini Bansal, Behrooz Ghorbani, Ankush Garg, Biao Zhang, Colin Cherry, Behnam Neyshabur, Orhan Firat
Data Scaling Laws in NMT: The Effect of Noise and Architecture. ICML (2022)
Biao Zhang, Ankur Bapna, Melvin Johnson, Ali Dabirmoghaddam, Naveen Arivazhagan, Orhan Firat
Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents. ACL (1) (2022)
Derrick Xin, Behrooz Ghorbani, Ankush Garg, Orhan Firat, Justin Gilmer
Do Current Multi-Task Optimization Methods in Deep Learning Even Help? CoRR (2022)
Parker Riley, Timothy Dozat, Jan A. Botha, Xavier Garcia, Dan Garrette, Jason Riesa, Orhan Firat, Noah Constant
FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation. CoRR (2022)
Xavier Garcia, Orhan Firat
Using natural language prompts for machine translation. CoRR (2022)
Biao Zhang, Behrooz Ghorbani, Ankur Bapna, Yong Cheng, Xavier Garcia, Jonathan Shen, Orhan Firat
Examining Scaling and Transfer of Language Model Architectures for Machine Translation. ICML (2022)
Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson
XTREME-S: Evaluating Cross-lingual Speech Representations. CoRR (2022)
Nan Du, Yanping Huang, Andrew M. Dai, Simon Tong, Dmitry Lepikhin, Yuanzhong Xu, Maxim Krikun, Yanqi Zhou, Adams Wei Yu, Orhan Firat, Barret Zoph, Liam Fedus, Maarten P. Bosma, Zongwei Zhou, Tao Wang, Yu Emma Wang, Kellie Webster, Marie Pellat, Kevin Robinson, Kathleen S. Meier-Hellstern, Toju Duke, Lucas Dixon, Kun Zhang, Quoc V. Le, Yonghui Wu, Zhifeng Chen, Claire Cui
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts. ICML (2022)
Justin Gilmer, Behrooz Ghorbani, Ankush Garg, Sneha Kudugunta, Behnam Neyshabur, David Cardoze, George Edward Dahl, Zachary Nado, Orhan Firat
A Loss Curvature Perspective on Training Instabilities of Deep Learning Models. ICLR (2022)
Aditya Siddhant, Ankur Bapna, Orhan Firat, Yuan Cao, Mia Xu Chen, Isaac Caswell, Xavier Garcia
Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning. CoRR (2022)
Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson
XTREME-S: Evaluating Cross-lingual Speech Representations. INTERSPEECH (2022)
Yong Cheng, Ankur Bapna, Orhan Firat, Yuan Cao, Pidong Wang, Wolfgang Macherey
Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation. CoRR (2022)
Yamini Bansal, Behrooz Ghorbani, Ankush Garg, Biao Zhang, Maxim Krikun, Colin Cherry, Behnam Neyshabur, Orhan Firat
Data Scaling Laws in NMT: The Effect of Noise and Architecture. CoRR (2022)
Biao Zhang, Behrooz Ghorbani, Ankur Bapna, Yong Cheng, Xavier Garcia, Jonathan Shen, Orhan Firat
Examining Scaling and Transfer of Language Model Architectures for Machine Translation. CoRR (2022)
Yong Cheng, Ankur Bapna, Orhan Firat, Yuan Cao, Pidong Wang, Wolfgang Macherey
Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation. ACL (1) (2022)
Behrooz Ghorbani, Orhan Firat, Markus Freitag, Ankur Bapna, Maxim Krikun, Xavier Garcia, Ciprian Chelba, Colin Cherry
Scaling Laws for Neural Machine Translation. ICLR (2022)
Ankur Bapna, Isaac Caswell, Julia Kreutzer, Orhan Firat, Daan van Esch, Aditya Siddhant, Mengmeng Niu, Pallavi Baljekar, Xavier Garcia, Wolfgang Macherey, Theresa Breiner, Vera Axelrod, Jason Riesa, Yuan Cao, Mia Xu Chen, Klaus Macherey, Maxim Krikun, Pidong Wang, Alexander Gutkin, Apurva Shah, Yanping Huang, Zhifeng Chen, Yonghui Wu, Macduff Hughes
Building Machine Translation Systems for the Next Thousand Languages. CoRR (2022)
Derrick Xin, Behrooz Ghorbani, Justin Gilmer, Ankush Garg, Orhan Firat
Do Current Multi-Task Optimization Methods in Deep Learning Even Help? NeurIPS (2022)
Julia Kreutzer, Isaac Caswell, Lisa Wang, Ahsan Wahab, Daan van Esch, Nasanbayar Ulzii-Orshikh, Allahsera Tapo, Nishant Subramani, Artem Sokolov, Claytone Sikasote, Monang Setyawan, Supheakmungkol Sarin, Sokhar Samb, Benoît Sagot, Clara Rivera, Annette Rios, Isabel Papadimitriou, Salomey Osei, Pedro Javier Ortiz Suárez, Iroro Orife, Kelechi Ogueji, Andre Niyongabo Rubungo, Toan Q. Nguyen, Mathias Müller, André Müller, Shamsuddeen Hassan Muhammad, Nanda Muhammad, Ayanda Mnyakeni, Jamshidbek Mirzakhalov, Tapiwanashe Matangira, Colin Leong, Nze Lawson, Sneha Kudugunta, Yacine Jernite, Mathias Jenny, Orhan Firat, Bonaventure F. P. Dossou, Sakhile Dlamini, Nisansa de Silva, Sakine Çabuk Balli, Stella Biderman, Alessia Battisti, Ahmed Baruwa, Ankur Bapna, Pallavi Baljekar, Israel Abebe Azime, Ayodele Awokoya, Duygu Ataman, Orevaoghene Ahia, Oghenefego Ahia, Sweta Agrawal, Mofetoluwa Adeyemi
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets. Trans. Assoc. Comput. Linguistics 10 (2022)
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
PaLM: Scaling Language Modeling with Pathways. CoRR (2022)
Biao Zhang, Ankur Bapna, Melvin Johnson, Ali Dabirmoghaddam, Naveen Arivazhagan, Orhan Firat
Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents. CoRR (2021)
Xavier Garcia, Aditya Siddhant, Orhan Firat, Ankur P. Parikh
Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages. NAACL-HLT (2021)
Behrooz Ghorbani, Orhan Firat, Markus Freitag, Ankur Bapna, Maxim Krikun, Xavier Garcia, Ciprian Chelba, Colin Cherry
Scaling Laws for Neural Machine Translation. CoRR (2021)
Nan Du, Yanping Huang, Andrew M. Dai, Simon Tong, Dmitry Lepikhin, Yuanzhong Xu, Maxim Krikun, Yanqi Zhou, Adams Wei Yu, Orhan Firat, Barret Zoph, Liam Fedus, Maarten Bosma, Zongwei Zhou, Tao Wang, Yu Emma Wang, Kellie Webster, Marie Pellat, Kevin Robinson, Kathy Meier-Hellstern, Toju Duke, Lucas Dixon, Kun Zhang, Quoc V. Le, Yonghui Wu, Zhifeng Chen, Claire Cui
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts. CoRR (2021)
Xavier Garcia, Noah Constant, Ankur P. Parikh, Orhan Firat
Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution. NAACL-HLT (2021)
Sneha Kudugunta, Yanping Huang, Ankur Bapna, Maxim Krikun, Dmitry Lepikhin, Minh-Thang Luong, Orhan Firat
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference. EMNLP (Findings) (2021)
Xinyi Wang, Ankur Bapna, Melvin Johnson, Orhan Firat
Gradient-guided Loss Masking for Neural Machine Translation. CoRR (2021)
Jamshidbek Mirzakhalov, Anoop Babu, Duygu Ataman, Sherzod Kariev, Francis Tyers, Otabek Abduraufov, Mammad Hajili, Sardana Ivanova, Abror Khaytbaev, Antonio Laverghetta Jr., Behzodbek Moydinboyev, Esra Onal, Shaxnoza Pulatova, Ahsan Wahab, Orhan Firat, Sriram Chellappan
A Large-Scale Study of Machine Translation in Turkic Languages. EMNLP (1) (2021)
Isaac Caswell, Julia Kreutzer, Lisa Wang, Ahsan Wahab, Daan van Esch, Nasanbayar Ulzii-Orshikh, Allahsera Tapo, Nishant Subramani, Artem Sokolov, Claytone Sikasote, Monang Setyawan, Supheakmungkol Sarin, Sokhar Samb, Benoît Sagot, Clara Rivera, Annette Rios, Isabel Papadimitriou, Salomey Osei, Pedro Javier Ortiz Suárez, Iroro Orife, Kelechi Ogueji, Rubungo Andre Niyongabo, Toan Q. Nguyen, Mathias Müller, André Müller, Shamsuddeen Hassan Muhammad, Nanda Muhammad, Ayanda Mnyakeni, Jamshidbek Mirzakhalov, Tapiwanashe Matangira, Colin Leong, Nze Lawson, Sneha Kudugunta, Yacine Jernite, Mathias Jenny, Orhan Firat, Bonaventure F. P. Dossou, Sakhile Dlamini, Nisansa de Silva, Sakine Çabuk Balli, Stella Biderman, Alessia Battisti, Ahmed Baruwa, Ankur Bapna, Pallavi Baljekar, Israel Abebe Azime, Ayodele Awokoya, Duygu Ataman, Orevaoghene Ahia, Oghenefego Ahia, Sweta Agrawal, Mofetoluwa Adeyemi
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets. CoRR (2021)
Jamshidbek Mirzakhalov, Anoop Babu, Duygu Ataman, Sherzod Kariev, Francis M. Tyers, Otabek Abduraufov, Mammad Hajili, Sardana Ivanova, Abror Khaytbaev, Antonio Laverghetta Jr., Behzodbek Moydinboyev, Esra Onal, Shaxnoza Pulatova, Ahsan Wahab, Orhan Firat, Sriram Chellappan
A Large-Scale Study of Machine Translation in the Turkic Languages. CoRR (2021)
Zirui Wang, Yulia Tsvetkov, Orhan Firat, Yuan Cao
Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models. ICLR (2021)
Xavier Garcia, Noah Constant, Mandy Guo, Orhan Firat
Towards Universality in Multilingual Text Rewriting. CoRR (2021)
Sneha Kudugunta, Yanping Huang, Ankur Bapna, Maxim Krikun, Dmitry Lepikhin, Minh-Thang Luong, Orhan Firat
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference. CoRR (2021)
Biao Zhang, Ankur Bapna, Rico Sennrich, Orhan Firat
Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation. ICLR (2021)
Xavier Garcia, Noah Constant, Ankur P. Parikh, Orhan Firat
Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution. CoRR (2021)
Zirui Wang, Adams Wei Yu, Orhan Firat, Yuan Cao
Towards Zero-Label Language Learning. CoRR (2021)
Jamshidbek Mirzakhalov, Anoop Babu, Aigiz Kunafin, Ahsan Wahab, Behzodbek Moydinboyev, Sardana Ivanova, Mokhiyakhon Uzokova, Shaxnoza Pulatova, Duygu Ataman, Julia Kreutzer, Francis Tyers, Orhan Firat, John Licato, Sriram Chellappan
Evaluating Multiway Multilingual NMT in the Turkic Languages. WMT@EMNLP (2021)
Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig
Explicit Alignment Objectives for Multilingual Bidirectional Encoders. NAACL-HLT (2021)
Sebastian Ruder, Noah Constant, Jan Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Graham Neubig, Melvin Johnson
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. CoRR (2021)
Jamshidbek Mirzakhalov, Anoop Babu, Aigiz Kunafin, Ahsan Wahab, Behzod Moydinboyev, Sardana Ivanova, Mokhiyakhon Uzokova, Shaxnoza Pulatova, Duygu Ataman, Julia Kreutzer, Francis Tyers, Orhan Firat, John Licato, Sriram Chellappan
Evaluating Multiway Multilingual NMT in the Turkic Languages. CoRR (2021)
Justin Gilmer, Behrooz Ghorbani, Ankush Garg, Sneha Kudugunta, Behnam Neyshabur, David Cardoze, George E. Dahl, Zachary Nado, Orhan Firat
A Loss Curvature Perspective on Training Instability in Deep Learning. CoRR (2021)
Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, Zhifeng Chen
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding. ICLR (2021)
Sebastian Ruder, Noah Constant, Jan Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Dan Garrette, Graham Neubig, Melvin Johnson
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. EMNLP (1) (2021)
Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Ari, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman
Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation. AAAI (2020)
Mahdis Mahdieh, Mia Xu Chen, Yuan Cao, Orhan Firat
Rapid Domain Adaptation for Machine Translation with Monolingual Data. CoRR (2020)
Elman Mansimov, Mitchell Stern, Mia Xu Chen, Orhan Firat, Jakob Uszkoreit, Puneet Jain
Towards End-to-End In-Image Neural Machine Translation. CoRR (2020)
Markus Freitag, Orhan Firat
Complete Multilingual Neural Machine Translation. WMT@EMNLP (2020)
Ankur Bapna, Naveen Arivazhagan, Orhan Firat
Controlling Computation versus Quality for Neural Sequence Models. CoRR (2020)
Jason Lee, Dustin Tran, Orhan Firat, Kyunghyun Cho
On the Discrepancy between Density Estimation and Sequence Generation. CoRR (2020)
Markus Freitag, Orhan Firat
Complete Multilingual Neural Machine Translation. CoRR (2020)
Zirui Wang, Yulia Tsvetkov, Orhan Firat, Yuan Cao
Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models. CoRR (2020)
Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, Zhifeng Chen
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding. CoRR (2020)
Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation. ICML (2020)
Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Xu Chen, Sneha Reddy Kudugunta, Naveen Arivazhagan, Yonghui Wu
Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation. ACL (2020)
Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig
Explicit Alignment Objectives for Multilingual Bidirectional Encoders. CoRR (2020)
Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization. CoRR (2020)
Jason Lee, Dustin Tran, Orhan Firat, Kyunghyun Cho
On the Discrepancy between Density Estimation and Sequence Generation. SPNLP@EMNLP (2020)
Xavier Garcia, Aditya Siddhant, Orhan Firat, Ankur P. Parikh
Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages. CoRR (2020)
Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Xu Chen, Sneha Reddy Kudugunta, Naveen Arivazhagan, Yonghui Wu
Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation. CoRR (2020)
Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Dmitry Lepikhin, Melvin Johnson, Maxim Krikun, Mia Xu Chen, Yuan Cao, George F. Foster, Colin Cherry, Wolfgang Macherey, Zhifeng Chen, Yonghui Wu
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges. CoRR (2019)
Xian Li, Paul Michel, Antonios Anastasopoulos, Yonatan Belinkov, Nadir Durrani, Orhan Firat, Philipp Koehn, Graham Neubig, Juan Miguel Pino, Hassan Sajjad
Findings of the First Shared Task on Machine Translation Robustness. CoRR (2019)
Roee Aharoni, Melvin Johnson, Orhan Firat
Massively Multilingual Neural Machine Translation. NAACL-HLT (1) (2019)
Duygu Ataman, Orhan Firat, Mattia Antonino Di Gangi, Marcello Federico, Alexandra Birch
On the Importance of Word Boundaries in Character-level Neural Machine Translation. NGT@EMNLP-IJCNLP (2019)
Sébastien Jean, Ankur Bapna, Orhan Firat
Fill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation. CoRR (2019)
Ankur Bapna, Orhan Firat
Non-Parametric Adaptation for Neural Machine Translation. NAACL-HLT (1) (2019)
Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Roee Aharoni, Melvin Johnson, Wolfgang Macherey
The Missing Ingredient in Zero-Shot Neural Machine Translation. CoRR (2019)
Sébastien Jean, Orhan Firat, Melvin Johnson
Adaptive Scheduling for Multi-Task Learning. CoRR (2019)
Duygu Ataman, Orhan Firat, Mattia Antonino Di Gangi, Marcello Federico, Alexandra Birch
On the Importance of Word Boundaries in Character-level Neural Machine Translation. CoRR (2019)
Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, Dehao Chen, Mia Xu Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V. Le, Yonghui Wu, Zhifeng Chen
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism. NeurIPS (2019)

Orhan Firat.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Orhan Firat