Kenneth Heafield

Publication Activity (10 Years)

Years Active: 2008-2024
Publications (10 Years): 73

Top Topics

Language Identification

Machine Translation

Stochastic Gradient Descent

Stanford University

Top Venues

NGT@EMNLP-IJCNLP

Publications

Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, Arun Rao, Aston Zhang, Aurélien Rodriguez, Austen Gregerson, Ava Spataru, Baptiste Rozière, Bethany Biron, Binh Tang, Bobbie Chern, Charlotte Caucheteux, Chaya Nayak, Chloe Bi, Chris Marra, Chris McConnell, Christian Keller, Christophe Touret, Chunyang Wu, Corinne Wong, Cristian Canton Ferrer, Cyrus Nikolaidis, Damien Allonsius, Daniel Song, Danielle Pintz, Danny Livshits, David Esiobu, Dhruv Choudhary, Dhruv Mahajan, Diego Garcia-Olano, Diego Perino, Dieuwke Hupkes, Egor Lakomkin, Ehab AlBadawy, Elina Lobanova, Emily Dinan, Eric Michael Smith, Filip Radenovic, Frank Zhang, Gabriel Synnaeve, Gabrielle Lee, Georgia Lewis Anderson, Graeme Nail, Grégoire Mialon, Guan Pang, Guillem Cucurell, Hailey Nguyen, Hannah Korevaar, Hu Xu, Hugo Touvron, Iliyan Zarov, Imanol Arrieta Ibarra, Isabel M. Kloumann, Ishan Misra, Ivan Evtimov, Jade Copet, Jaewon Lee, Jan Geffert, Jana Vranes, Jason Park, Jay Mahadeokar, Jeet Shah, Jelmer van der Linde, Jennifer Billock, Jenny Hong, Jenya Lee, Jeremy Fu, Jianfeng Chi, Jianyu Huang, Jiawen Liu, Jie Wang, Jiecao Yu, Joanna Bitton, Joe Spisak, Jongsoo Park, Joseph Rocca, Joshua Johnstun, Joshua Saxe, Junteng Jia, Kalyan Vasuden Alwala, Kartikeya Upasani, Kate Plawiak, Ke Li, Kenneth Heafield, Kevin Stone, et al.
The Llama 3 Herd of Models. CoRR (2024)
Laurie Burchell, Alexandra Birch, Robert P. Thompson, Kenneth Heafield
Code-Switched Language Identification is Harder Than You Think. CoRR (2024)
Laurie Burchell, Alexandra Birch, Robert P. Thompson, Kenneth Heafield
Code-Switched Language Identification is Harder Than You Think. EACL (1) (2024)
Proyag Pal, Alexandra Birch, Kenneth Heafield
Document-Level Machine Translation with Large-Scale Public Parallel Corpora. ACL (1) (2024)
Pinzhen Chen, Shaoxiong Ji, Nikolay Bogoychev, Andrey Kutuzov, Barry Haddow, Kenneth Heafield
Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca. EACL (Findings) (2024)
Laurie Burchell, Alexandra Birch, Nikolay Bogoychev, Kenneth Heafield
An Open Dataset and Model for Language Identification. ACL (2) (2023)
Laurie Burchell, Alexandra Birch, Nikolay Bogoychev, Kenneth Heafield
An Open Dataset and Model for Language Identification. CoRR (2023)
Marcos V. Treviso, Ji-Ung Lee, Tianchu Ji, Betty van Aken, Qingqing Cao, Manuel R. Ciosici, Michael Hassid, Kenneth Heafield, Sara Hooker, Colin Raffel, Pedro Henrique Martins, André F. T. Martins, Jessica Zosa Forde, Peter A. Milder, Edwin Simpson, Noam Slonim, Jesse Dodge, Emma Strubell, Niranjan Balasubramanian, Leon Derczynski, Iryna Gurevych, Roy Schwartz
Efficient Methods for Natural Language Processing: A Survey. Trans. Assoc. Comput. Linguistics 11 (2023)
Pinzhen Chen, Shaoxiong Ji, Nikolay Bogoychev, Barry Haddow, Kenneth Heafield
Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca. CoRR (2023)
Proyag Pal, Kenneth Heafield
Cheating to Identify Hard Problems for Neural Machine Translation. EACL (Findings) (2023)
Pinzhen Chen, Zhicheng Guo, Barry Haddow, Kenneth Heafield
Iterative Translation Refinement with Large Language Models. CoRR (2023)
Laurie Burchell, Alexandra Birch, Kenneth Heafield
Exploring Diversity in Back Translation for Low-Resource Machine Translation. CoRR (2022)
Marta R. Costa-jussà, James Cross, Onur Çelebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, Anna Sun, Skyler Wang, Guillaume Wenzek, Al Youngblood, Bapi Akula, Loïc Barrault, Gabriel Mejia Gonzalez, Prangthip Hansanti, John Hoffman, Semarley Jarrett, Kaushik Ram Sadagopan, Dirk Rowe, Shannon Spruit, Chau Tran, Pierre Andrews, Necip Fazil Ayan, Shruti Bhosale, Sergey Edunov, Angela Fan, Cynthia Gao, Vedanuj Goswami, Francisco Guzmán, Philipp Koehn, Alexandre Mourachko, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, Jeff Wang
No Language Left Behind: Scaling Human-Centered Machine Translation. CoRR (2022)
Nikolay Bogoychev, Maximiliana Behnke, Jelmer van der Linde, Graeme Nail, Kenneth Heafield, Biao Zhang, Sidharth Kashyap
Edinburgh's Submission to the WMT 2022 Efficiency Task. WMT (2022)
Kenneth Heafield, Elaine Farrow, Jelmer van der Linde, Gema Ramírez-Sánchez, Dion Wiggins
The EuroPat Corpus: A Parallel Corpus of European Patent Data. LREC (2022)
Kenneth Heafield, Biao Zhang, Graeme Nail, Jelmer van der Linde, Nikolay Bogoychev
Findings of the WMT 2022 Shared Task on Efficient Translation. WMT (2022)
Marcos V. Treviso, Tianchu Ji, Ji-Ung Lee, Betty van Aken, Qingqing Cao, Manuel R. Ciosici, Michael Hassid, Kenneth Heafield, Sara Hooker, Pedro Henrique Martins, André F. T. Martins, Peter A. Milder, Colin Raffel, Edwin Simpson, Noam Slonim, Niranjan Balasubramanian, Leon Derczynski, Roy Schwartz
Efficient Methods for Natural Language Processing: A Survey. CoRR (2022)
Elsbeth Turcan, David Wan, Faisal Ladhak, Petra Galuscáková, Sukanta Sen, Svetlana Tchistiakova, Weijia Xu, Marine Carpuat, Kenneth Heafield, Douglas W. Oard, Kathleen R. McKeown
Constrained Regeneration for Cross-Lingual Query-Focused Extractive Summarization. COLING (2022)
Proyag Pal, Kenneth Heafield
Cheat Codes to Quantify Missing Source Information in Neural Machine Translation. NAACL-HLT (2022)
Pinzhen Chen, Kenneth Heafield
Approaching Neural Chinese Word Segmentation as a Low-Resource Machine Translation Task. PACLIC (2022)
Nikolay Bogoychev, Jelmer van der Linde, Kenneth Heafield
TranslateLocally: Blazing-fast translation running on the local CPU. CoRR (2021)
Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, Ondrej Bojar, Rajen Chatterjee, Vishrav Chaudhary, Marta R. Costa-jussà, Cristina España-Bonet, Angela Fan, Christian Federmann, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Leonie Harter, Kenneth Heafield, Christopher Homan, Matthias Huck, Kwabena Amponsah-Kaakyire, Jungo Kasai, Daniel Khashabi, Kevin Knight, Tom Kocmi, Philipp Koehn, Nicholas Lourie, Christof Monz, Makoto Morishita, Masaaki Nagata, Ajay Nagesh, Toshiaki Nakazawa, Matteo Negri, Santanu Pal, Allahsera Auguste Tapo, Marco Turchi, Valentin Vydrin, Marcos Zampieri
Findings of the 2021 Conference on Machine Translation (WMT21). WMT@EMNLP (2021)
Kenneth Heafield, Qianqian Zhu, Roman Grundkiewicz
Findings of the WMT 2021 Shared Task on Efficient Translation. WMT@EMNLP (2021)
Maximiliana Behnke, Nikolay Bogoychev, Alham Fikri Aji, Kenneth Heafield, Graeme Nail, Qianqian Zhu, Svetlana Tchistiakova, Jelmer van der Linde, Pinzhen Chen, Sidharth Kashyap, Roman Grundkiewicz
Efficient Machine Translation with Model Pruning and Quantization. WMT@EMNLP (2021)
Adithya Renduchintala, Denise Diaz, Kenneth Heafield, Xian Li, Mona T. Diab
Gender Bias Amplification During Speed-Quality Optimization in Neural Machine Translation. CoRR (2021)
Maximiliana Behnke, Kenneth Heafield
Pruning Neural Machine Translation for Speed Using Group Lasso. WMT@EMNLP (2021)
Nikolay Bogoychev, Jelmer van der Linde, Kenneth Heafield
TranslateLocally: Blazing-fast translation running on the local CPU. EMNLP (Demos) (2021)
Pinzhen Chen, Jindrich Helcl, Ulrich Germann, Laurie Burchell, Nikolay Bogoychev, Antonio Valerio Miceli Barone, Jonas Waldendorf, Alexandra Birch, Kenneth Heafield
The University of Edinburgh's English-German and English-Hausa Submissions to the WMT21 News Translation Task. WMT@EMNLP (2021)
Xutai Ma, Hongyu Gong, Danni Liu, Ann Lee, Yun Tang, Peng-Jen Chen, Wei-Ning Hsu, Kenneth Heafield, Phillip Koehn, Juan Pino
Direct simultaneous speech to speech translation. CoRR (2021)
Adithya Renduchintala, Denise Diaz, Kenneth Heafield, Xian Li, Mona T. Diab
Gender bias amplification during Speed-Quality optimization in Neural Machine Translation. ACL/IJCNLP (2) (2021)
Alham Fikri Aji, Kenneth Heafield
Exploring Monolingual Data for Neural Machine Translation with Knowledge Distillation. CoRR (2020)
Marta Bañón, Pinzhen Chen, Barry Haddow, Kenneth Heafield, Hieu Hoang, Miquel Esplà-Gomis, Mikel L. Forcada, Amir Kamran, Faheem Kirefu, Philipp Koehn, Sergio Ortiz-Rojas, Leopoldo Pla Sempere, Gema Ramírez-Sánchez, Elsa Sarrías, Marek Strelec, Brian Thompson, William Waites, Dion Wiggins, Jaume Zaragoza
ParaCrawl: Web-Scale Acquisition of Parallel Corpora. ACL (2020)
Tobias Domhan, Michael J. Denkowski, David Vilar, Xing Niu, Felix Hieber, Kenneth Heafield
The Sockeye 2 Neural Machine Translation Toolkit at AMTA 2020. CoRR (2020)
Kenneth Heafield, Hiroaki Hayashi, Yusuke Oda, Ioannis Konstas, Andrew M. Finch, Graham Neubig, Xian Li, Alexandra Birch
Findings of the Fourth Workshop on Neural Generation and Translation. NGT@ACL (2020)
Ulrich Germann, Roman Grundkiewicz, Martin Popel, Radina Dobreva, Nikolay Bogoychev, Kenneth Heafield
Speed-optimized, Compact Student Models that Distill Knowledge from a Larger Teacher Model: the UEDIN-CUNI Submission to the WMT 2020 News Translation Task. WMT@EMNLP (2020)
Pinzhen Chen, Nikolay Bogoychev, Kenneth Heafield, Faheem Kirefu
Parallel Sentence Mining by Constrained Decoding. ACL (2020)
Alham Fikri Aji, Kenneth Heafield
Compressing Neural Machine Translation Models with 4-bit Precision. NGT@ACL (2020)
Tobias Domhan, Michael J. Denkowski, David Vilar, Xing Niu, Felix Hieber, Kenneth Heafield
The Sockeye 2 Neural Machine Translation Toolkit at AMTA 2020. AMTA (2020)
Maximiliana Behnke, Kenneth Heafield
Losing Heads in the Lottery: Pruning Transformer Attention in Neural Machine Translation. EMNLP (1) (2020)
Alham Fikri Aji, Nikolay Bogoychev, Kenneth Heafield, Rico Sennrich
In Neural Machine Translation, What Does Transfer Learning Transfer? ACL (2020)
Pinzhen Chen, Kenneth Heafield
Approaching Neural Chinese Word Segmentation as a Low-Resource Machine Translation Task. CoRR (2020)
Nikolay Bogoychev, Roman Grundkiewicz, Alham Fikri Aji, Maximiliana Behnke, Kenneth Heafield, Sidharth Kashyap, Emmanouil-Ioannis Farsarakis, Mateusz Chudyk
Edinburgh's Submissions to the 2020 Machine Translation Efficiency Task. NGT@ACL (2020)
Young Jin Kim, Marcin Junczys-Dowmunt, Hany Hassan, Alham Fikri Aji, Kenneth Heafield, Roman Grundkiewicz, Nikolay Bogoychev
From Research to Production and Back: Ludicrously Fast Neural Machine Translation. NGT@EMNLP-IJCNLP (2019)
Alham Fikri Aji, Kenneth Heafield, Nikolay Bogoychev
Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training. EMNLP/IJCNLP (1) (2019)
Roman Grundkiewicz, Marcin Junczys-Dowmunt, Kenneth Heafield
Neural Grammatical Error Correction Systems with Unsupervised Pre-training on Synthetic Data. BEA@ACL (2019)
Anna Currey, Kenneth Heafield
Incorporating Source Syntax into Transformer-Based Neural Machine Translation. WMT (1) (2019)
Douglas W. Oard, Marine Carpuat, Petra Galuscáková, Joseph Barrow, Suraj Nair, Xing Niu, Han-Chin Shing, Weijia Xu, Elena Zotkina, Kathleen R. McKeown, Smaranda Muresan, Efsun Selin Kayi, Ramy Eskander, Chris Kedzie, Yan Virin, Dragomir R. Radev, Rui Zhang, Mark J. F. Gales, Anton Ragni, Kenneth Heafield
Surprise Languages: Rapid-Response Cross-Language IR. EVIA@NTCIR (2019)
Anna Currey, Kenneth Heafield
Zero-Resource Neural Machine Translation with Monolingual Pivot Data. NGT@EMNLP-IJCNLP (2019)
Alham Fikri Aji, Kenneth Heafield
Making Asynchronous Stochastic Gradient Descent Work for Transformers. CoRR (2019)
Alham Fikri Aji, Kenneth Heafield
Making Asynchronous Stochastic Gradient Descent Work for Transformers. NGT@EMNLP-IJCNLP (2019)
Alham Fikri Aji, Kenneth Heafield
Neural Machine Translation with 4-Bit Precision and Beyond. CoRR (2019)
Anna Currey, Kenneth Heafield
Multi-Source Syntactic Neural Machine Translation. EMNLP (2018)
Marcin Junczys-Dowmunt, Roman Grundkiewicz, Shubha Guha, Kenneth Heafield
Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Task. CoRR (2018)
Marcin Junczys-Dowmunt, Kenneth Heafield, Hieu Hoang, Roman Grundkiewicz, Anthony Aue
Marian: Cost-effective High-Quality Neural Machine Translation in C++. NMT@ACL (2018)
Anna Currey, Kenneth Heafield
Multi-Source Syntactic Neural Machine Translation. CoRR (2018)
Roman Grundkiewicz, Kenneth Heafield
Neural Machine Translation Techniques for Named Entity Transliteration. NEWS@ACL (2018)
Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, André F. T. Martins, Alexandra Birch
Marian: Fast Neural Machine Translation in C++. CoRR (2018)
Robert V. Lim, Kenneth Heafield, Hieu Hoang, Mark Briers, Allen D. Malony
Exploring Hyper-Parameter Optimization for Neural Machine Translation on GPU Architectures. CoRR (2018)
Nikolay Bogoychev, Marcin Junczys-Dowmunt, Kenneth Heafield, Alham Fikri Aji
Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation. CoRR (2018)
Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, André F. T. Martins, Alexandra Birch
Marian: Fast Neural Machine Translation in C++. ACL (4) (2018)
Barry Haddow, Nikolay Bogoychev, Denis Emelin, Ulrich Germann, Roman Grundkiewicz, Kenneth Heafield, Antonio Valerio Miceli Barone, Rico Sennrich
The University of Edinburgh's Submissions to the WMT18 News Translation Task. WMT (shared task) (2018)
Hieu Hoang, Tomasz Dwojak, Rihards Krislauks, Daniel Torregrosa, Kenneth Heafield
Fast Neural Machine Translation Implementation. CoRR (2018)
Marcin Junczys-Dowmunt, Roman Grundkiewicz, Shubha Guha, Kenneth Heafield
Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Task. NAACL-HLT (2018)
Hieu Hoang, Tomasz Dwojak, Rihards Krislauks, Daniel Torregrosa, Kenneth Heafield
Fast Neural Machine Translation Implementation. NMT@ACL (2018)
Nikolay Bogoychev, Kenneth Heafield, Alham Fikri Aji, Marcin Junczys-Dowmunt
Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation. EMNLP (2018)
Marcin Junczys-Dowmunt, Kenneth Heafield, Hieu Hoang, Roman Grundkiewicz, Anthony Aue
Marian: Cost-effective High-Quality Neural Machine Translation in C++. CoRR (2018)
Philipp Koehn, Huda Khayrallah, Kenneth Heafield, Mikel L. Forcada
Findings of the WMT 2018 Shared Task on Parallel Corpus Filtering. WMT (shared task) (2018)
Rico Sennrich, Alexandra Birch, Anna Currey, Ulrich Germann, Barry Haddow, Kenneth Heafield, Antonio Valerio Miceli Barone, Philip Williams
The University of Edinburgh's Neural MT Systems for WMT17. WMT (2017)
Alham Fikri Aji, Kenneth Heafield
Sparse Communication for Distributed Gradient Descent. CoRR (2017)
Anna Currey, Antonio Valerio Miceli Barone, Kenneth Heafield
Copied Monolingual Data Improves Low-Resource Neural Machine Translation. WMT (2017)
Alham Fikri Aji, Kenneth Heafield
Sparse Communication for Distributed Gradient Descent. EMNLP (2017)
Rico Sennrich, Alexandra Birch, Anna Currey, Ulrich Germann, Barry Haddow, Kenneth Heafield, Antonio Valerio Miceli Barone, Philip Williams
The University of Edinburgh's Neural MT Systems for WMT17. CoRR (2017)
Kenneth Heafield, Chase Geigle, Sean Massung, Lane Schwartz
Normalized Log-Linear Interpolation of Backoff Language Models is Efficient. ACL (1) (2016)
Kenneth Heafield, Rohan Kshirsagar, Santiago Barona
Language Identification and Modeling in Specialized Hardware. ACL (2) (2015)
Kenneth Heafield, Michael Kayser, Christopher D. Manning
Faster Phrase-Based Decoding by Refining Feature State. ACL (2) (2014)
Christian Buck, Kenneth Heafield, Bas van Ooyen
N-gram Counts and Language Models from the Common Crawl. LREC (2014)
Nadir Durrani, Barry Haddow, Philipp Koehn, Kenneth Heafield
Edinburgh's Phrase-based Machine Translation Systems for WMT-14. WMT@ACL (2014)
Julia Neidert, Sebastian Schuster, Spence Green, Kenneth Heafield, Christopher D. Manning
Stanford University's Submissions to the WMT 2014 Translation Task. WMT@ACL (2014)
Nadir Durrani, Barry Haddow, Kenneth Heafield, Philipp Koehn
Edinburgh's Machine Translation Systems for European Language Pairs. WMT@ACL (2013)
Kenneth Heafield, Ivan Pouzyrevsky, Jonathan H. Clark, Philipp Koehn
Scalable Modified Kneser-Ney Language Model Estimation. ACL (2) (2013)
Kenneth Heafield, Philipp Koehn, Alon Lavie
Grouping Language Model Boundary Words to Speed K-Best Extraction from Hypergraphs. HLT-NAACL (2013)
Kenneth Heafield, Philipp Koehn, Alon Lavie
Language Model Rest Costs and Space-Efficient Storage. EMNLP-CoNLL (2012)
Kenneth Heafield, Alon Lavie
CMU System Combination in WMT 2011. WMT@EMNLP (2011)
Kenneth Heafield
KenLM: Faster and Smaller Language Model Queries. WMT@EMNLP (2011)
Kenneth Heafield, Hieu Hoang, Philipp Koehn, Tetsuo Kiso, Marcello Federico
Left language model state for syntactic machine translation. IWSLT (2011)
Kenneth Heafield, Alon Lavie
Voting on N-grams for Machine Translation System Combination. AMTA (2010)
Kenneth Heafield, Alon Lavie
Combining Machine Translation Output with Open SourceThe Carnegie Mellon Multi-Engine Machine Translation Scheme. Prague Bull. Math. Linguistics 93 (2010)
Jonathan H. Clark, Jonathan Weese, Byung-Gyu Ahn, Andreas Zollmann, Qin Gao, Kenneth Heafield, Alon Lavie
The Machine Translation Toolpack for LoonyBin: Automated Management of Experimental Machine Translation HyperWorkflows. Prague Bull. Math. Linguistics 93 (2010)
Kenneth Heafield, Alon Lavie
CMU Multi-Engine Machine Translation for WMT 2010. WMT@ACL (2010)
Kenneth Heafield, Greg Hanneman, Alon Lavie
Machine Translation System Combination with Flexible Word Ordering. WMT@EACL (2009)
Girish Maskeri Rama, Santonu Sarkar, Kenneth Heafield
Mining business topics in source code using latent dirichlet allocation. ISEC (2008)