Jacob Devlin

Publication Activity (10 Years)

Years Active: 2011-2023
Publications (10 Years): 32

Top Topics

Machine Translation

Contextual Constraints

Top Venues

Publications

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
PaLM: Scaling Language Modeling with Pathways. J. Mach. Learn. Res. 24 (2023)
Zifeng Wang, Zizhao Zhang, Jacob Devlin, Chen-Yu Lee, Guolong Su, Hao Zhang, Jennifer G. Dy, Vincent Perot, Tomas Pfister
QueryForm: A Simple Zero-shot Form Entity Query Framework. ACL (Findings) (2023)
Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.
PaLM 2 Technical Report. CoRR (2023)
Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Jonathan Heek, Kefan Xiao, Shivani Agrawal, Jeff Dean
Efficiently Scaling Transformer Inference. MLSys (2023)
Zifeng Wang, Zizhao Zhang, Jacob Devlin, Chen-Yu Lee, Guolong Su, Hao Zhang, Jennifer G. Dy, Vincent Perot, Tomas Pfister
QueryForm: A Simple Zero-shot Form Entity Query Framework. CoRR (2022)
Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Anselm Levskaya, Jonathan Heek, Kefan Xiao, Shivani Agrawal, Jeff Dean
Efficiently Scaling Transformer Inference. CoRR (2022)
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei
Scaling Instruction-Finetuned Language Models. CoRR (2022)
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
PaLM: Scaling Language Modeling with Pathways. CoRR (2022)
Giulio Zhou, Jacob Devlin
Multi-Vector Attention Models for Deep Re-ranking. EMNLP (1) (2021)
Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur P. Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, Slav Petrov
Natural Questions: a Benchmark for Question Answering Research. Trans. Assoc. Comput. Linguistics 7 (2019)
Lajanugen Logeswaran, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, Jacob Devlin, Honglak Lee
Zero-Shot Entity Linking by Reading Entity Descriptions. ACL (1) (2019)
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT (1) (2019)
Ming-Wei Chang, Kristina Toutanova, Kenton Lee, Jacob Devlin
Language Model Pre-training for Hierarchical Document Representations. CoRR (2019)
Chris Alberti, Daniel Andor, Emily Pitler, Jacob Devlin, Michael Collins
Synthetic QA Corpora Generation with Roundtrip Consistency. ACL (1) (2019)
Chris Alberti, Daniel Andor, Emily Pitler, Jacob Devlin, Michael Collins
Synthetic QA Corpora Generation with Roundtrip Consistency. CoRR (2019)
Lajanugen Logeswaran, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, Jacob Devlin, Honglak Lee
Zero-Shot Entity Linking by Reading Entity Descriptions. CoRR (2019)
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. CoRR (2018)
Jiatao Gu, Hany Hassan, Jacob Devlin, Victor O. K. Li
Universal Neural Machine Translation for Extremely Low Resource Languages. NAACL-HLT (2018)
Rudy Bunel, Matthew J. Hausknecht, Jacob Devlin, Rishabh Singh, Pushmeet Kohli
Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis. ICLR (Poster) (2018)
Jiatao Gu, Hany Hassan, Jacob Devlin, Victor O. K. Li
Universal Neural Machine Translation for Extremely Low Resource Languages. CoRR (2018)
Rudy Bunel, Matthew J. Hausknecht, Jacob Devlin, Rishabh Singh, Pushmeet Kohli
Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis. CoRR (2018)
Jacob Devlin, Jonathan Uesato, Surya Bhupatiraju, Rishabh Singh, Abdel-rahman Mohamed, Pushmeet Kohli
RobustFill: Neural Program Learning under Noisy I/O. ICML (2017)
Jacob Devlin, Rudy Bunel, Rishabh Singh, Matthew J. Hausknecht, Pushmeet Kohli
Neural Program Meta-Induction. NIPS (2017)
Jacob Devlin
Sharp Models on Dull Hardware: Fast and Accurate Neural Machine Translation Decoding on the CPU. CoRR (2017)
Jacob Devlin, Jonathan Uesato, Rishabh Singh, Pushmeet Kohli
Semantic Code Repair using Neuro-Symbolic Transformation Networks. CoRR (2017)
Jacob Devlin, Rudy Bunel, Rishabh Singh, Matthew J. Hausknecht, Pushmeet Kohli
Neural Program Meta-Induction. CoRR (2017)
Jacob Devlin
Sharp Models on Dull Hardware: Fast and Accurate Neural Machine Translation Decoding on the CPU. EMNLP (2017)
Jacob Devlin, Jonathan Uesato, Surya Bhupatiraju, Rishabh Singh, Abdel-rahman Mohamed, Pushmeet Kohli
RobustFill: Neural Program Learning under Noisy I/O. CoRR (2017)
Nasrin Mostafazadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende
Generating Natural Questions About an Image. ACL (1) (2016)
Nasrin Mostafazadeh, Ishan Misra, Jacob Devlin, Larry Zitnick, Margaret Mitchell, Xiaodong He, Lucy Vanderwende
Generating Natural Questions About an Image. CoRR (2016)
Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross B. Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell
Visual Storytelling. CoRR (2016)
Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross B. Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell
Visual Storytelling. HLT-NAACL (2016)
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell
Language Models for Image Captioning: The Quirks and What Works. CoRR (2015)
Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao (Kenneth) Huang, Lucy Vanderwende, Jacob Devlin, Michel Galley, Margaret Mitchell
A Survey of Current Datasets for Vision and Language Research. EMNLP (2015)
Jacob Devlin, Saurabh Gupta, Ross B. Girshick, Margaret Mitchell, C. Lawrence Zitnick
Exploring Nearest Neighbor Approaches for Image Captioning. CoRR (2015)
Hendra Setiawan, Zhongqiang Huang, Jacob Devlin, Thomas Lamar, Rabih Zbib, Richard M. Schwartz, John Makhoul
Statistical Machine Translation Features with Multitask Tensor Networks. ACL (1) (2015)
Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao (Kenneth) Huang, Lucy Vanderwende, Jacob Devlin, Michel Galley, Margaret Mitchell
On Available Corpora for Empirical Methods in Vision & Language. CoRR (2015)
Jacob Devlin, Chris Quirk, Arul Menezes
Pre-Computable Multi-Layer Neural Network Language Models. EMNLP (2015)
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell
Language Models for Image Captioning: The Quirks and What Works. ACL (2) (2015)
Junyoung Chung, Jacob Devlin, Hany Hassan Awadalla
Detecting Interrogative Utterances with Recurrent Neural Networks. CoRR (2015)
Hendra Setiawan, Zhongqiang Huang, Jacob Devlin, Thomas Lamar, Rabih Zbib, Richard M. Schwartz, John Makhoul
Statistical Machine Translation Features with Multitask Tensor Networks. CoRR (2015)
Jacob Devlin, Rabih Zbib, Zhongqiang Huang, Thomas Lamar, Richard M. Schwartz, John Makhoul
Fast and Robust Neural Network Joint Models for Statistical Machine Translation. ACL (1) (2014)
Zhongqiang Huang, Jacob Devlin, Spyros Matsoukas
BBN's Systems for the Chinese-English Sub-task of the NTCIR-10 PatentMT Evaluation. NTCIR (2013)
Rohit Prasad, Prem Natarajan, David Stallard, Shirin Saleem, Shankar Ananthakrishnan, Stavros Tsakalidis, Chia-Lin Kao, Fred Choi, Ralf Meermeier, Mark Rawls, Jacob Devlin, Kriste Krstovski, Aaron Challenner
BBN TransTalk: Robust multilingual two-way speech-to-speech translation for mobile platforms. Comput. Speech Lang. 27 (2) (2013)
Zhongqiang Huang, Jacob Devlin, Rabih Zbib
Factored Soft Source Syntactic Constraints for Hierarchical Machine Translation. EMNLP (2013)
Rabih Zbib, Erika Malchiodi, Jacob Devlin, David Stallard, Spyros Matsoukas, Richard M. Schwartz, John Makhoul, Omar Zaidan, Chris Callison-Burch
Machine Translation of Arabic Dialects. HLT-NAACL (2012)
Huaigu Cao, Jinying Chen, Jacob Devlin, Rohit Prasad, Prem Natarajan
Document recognition and translation system for unconstrained Arabic documents. ICPR (2012)
Jinying Chen, Jacob Devlin, Huaigu Cao, Rohit Prasad, Premkumar Natarajan
Automatic Tune Set Generation for Machine Translation with Limited Indomain Data. EAMT (2012)
Jacob Devlin, Matin Kamali, Krishna Subramanian, Rohit Prasad, Prem Natarajan
Statistical Machine Translation as a Language Model for Handwriting Recognition. ICFHR (2012)
David Stallard, Jacob Devlin, Michael Kayser, Yoong Keok Lee, Regina Barzilay
Unsupervised Morphology Rivals Supervised Morphology for Arabic MT. ACL (2) (2012)
Jacob Devlin, Spyros Matsoukas
Trait-Based Hypothesis Selection For Machine Translation. HLT-NAACL (2012)
Jacob Devlin, Antti-Veikko I. Rosti, Sankaranarayanan Ananthakrishnan, Spyros Matsoukas
System Combination Using Discriminative Cross-Adaptation. IJCNLP (2011)