Chi-kiu Lo

Publication Activity (10 Years)

Years Active: 2007-2023
Publications (10 Years): 22

Top Topics

Machine Translation

Top Venues

IWSLT (Evaluation Campaign)

Publications

Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Tom Kocmi, Frédéric Blain, Daniel Deutsch, Craig Stewart, Chrysoula Zerva, Sheila Castilho, Alon Lavie, George F. Foster
Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent. WMT (2023)
Chi-kiu Lo, Rebecca Knowles
Data Sampling and (In)stability in Machine Translation Evaluation. ACL (Findings) (2023)
Chi-kiu Lo, Samuel Larkin, Rebecca Knowles
Metric Score Landscape Challenge (MSLC23): Understanding Metrics' Performance on a Wider Landscape of Translation Quality. WMT (2023)
Rebecca Knowles, Chi-kiu Lo
Test Set Sampling Affects System Rankings: Expanded Human Evaluation of WMT20 English-Inuktitut Systems. WMT (2022)
Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, Eleftherios Avramidis, Tom Kocmi, George F. Foster, Alon Lavie, André F. T. Martins
Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust. WMT (2022)
Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, George F. Foster, Alon Lavie, Ondrej Bojar
Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain. WMT@EMNLP (2021)
Chi-kiu Lo, Samuel Larkin
Machine Translation Reference-less Evaluation using YiSi-2 with Bilingual Mappings of Massive Multilingual Language Model. WMT@EMNLP (2020)
Lane Schwartz, Francis M. Tyers, Lori S. Levin, Christo Kirov, Patrick Littell, Chi-kiu Lo, Emily Prud'hommeaux, Hyunji Hayley Park, Kenneth Steimel, Rebecca Knowles, Jeffrey Micher, Lonny Strunk, Han Liu, Coleman Haley, Katherine J. Zhang, Robbie Jimerson, Vasilisa Andriyanets, Aldrian Obaja Muis, Naoki Otani, Jong Hyuk Park, Zhisong Zhang
Neural Polysynthetic Language Modelling. CoRR (2020)
Loïc Barrault, Magdalena Biesialska, Ondrej Bojar, Marta R. Costa-jussà, Christian Federmann, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Matthias Huck, Eric Joanis, Tom Kocmi, Philipp Koehn, Chi-kiu Lo, Nikola Ljubesic, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Santanu Pal, Matt Post, Marcos Zampieri
Findings of the 2020 Conference on Machine Translation (WMT20). WMT@EMNLP (2020)
Eric Joanis, Rebecca Knowles, Roland Kuhn, Samuel Larkin, Patrick Littell, Chi-kiu Lo, Darlene A. Stewart, Jeffrey Micher
The Nunavut Hansard Inuktitut-English Parallel Corpus 3.0 with Preliminary Machine Translation Results. LREC (2020)
Chi-kiu Lo
Extended Study on Using Pretrained Language Models and YiSi-1 for Machine Translation Evaluation. WMT@EMNLP (2020)
Chi-kiu Lo, Eric Joanis
Improving Parallel Data Identification using Iteratively Refined Sentence Alignments and Bilingual Mappings of Pre-trained Language Models. WMT@EMNLP (2020)
Chi-kiu Lo, Michel Simard
Fully Unsupervised Crosslingual Semantic Textual Similarity Metric Based on BERT for Identifying Parallel Data. CoNLL (2019)
Gabriel Bernier-Colborne, Chi-kiu Lo
NRC Parallel Corpus Filtering System for WMT 2019. WMT (3) (2019)
Patrick Littell, Chi-kiu Lo, Samuel Larkin, Darlene A. Stewart
Multi-Source Transformer for Kazakh-Russian-English Neural Machine Translation. WMT (2) (2019)
Chi-kiu Lo
YiSi - a Unified Semantic MT Quality Evaluation and Estimation Metric for Languages with Different Levels of Available Resources. WMT (2) (2019)
Patrick Littell, Samuel Larkin, Darlene A. Stewart, Michel Simard, Cyril Goutte, Chi-kiu Lo
Measuring sentence parallelism using Mahalanobis distances: The NRC unsupervised submissions to the WMT18 Parallel Corpus Filtering shared task. WMT (shared task) (2018)
Chi-kiu Lo, Michel Simard, Darlene A. Stewart, Samuel Larkin, Cyril Goutte, Patrick Littell
Accurate semantic textual similarity for cleaning noisy parallel corpora using semantic machine translation evaluation metric: The NRC supervised submissions to the Parallel Corpus Filtering task. WMT (shared task) (2018)
Chi-kiu Lo, Boxing Chen, Colin Cherry, George F. Foster, Samuel Larkin, Darlene A. Stewart, Roland Kuhn
NRC Machine Translation System for WMT 2017. WMT (2017)
Chi-kiu Lo
MEANT 2.0: Accurate semantic MT evaluation for any output language. WMT (2017)
Chi-kiu Lo, Colin Cherry, George F. Foster, Darlene A. Stewart, Rabib Islam, Anna Kazantseva, Roland Kuhn
NRC Russian-English Machine Translation System for WMT 2016. WMT (2016)
Chi-kiu Lo, Cyril Goutte, Michel Simard
CNRC at SemEval-2016 Task 1: Experiments in Crosslingual Semantic Textual Similarity. SemEval@NAACL-HLT (2016)
Chi-kiu Lo, Philipp Dowling, Dekai Wu
Improving evaluation and optimization of MT systems against MEANT. WMT@EMNLP (2015)
Meriem Beloucif, Chi-kiu Lo, Dekai Wu
Improving MEANT based semantically tuned SMT. IWSLT (Evaluation Campaign) (2014)
Dekai Wu, Chi-kiu Lo, Markus Saers
Lexical Access Preference and Constraint Strategies for Improving Multiword Expression Association within Semantic MT Evaluation. CogALex@COLING (2014)
Chi-kiu Lo, Dekai Wu
On the reliability and inter-annotator agreement of human semantic MT evaluation via HMEANT. LREC (2014)
Chi-kiu Lo, Meriem Beloucif, Markus Saers, Dekai Wu
XMEANT: Better semantic MT evaluation without reference translations. ACL (2) (2014)
Chi-kiu Lo, Dekai Wu
BiMEANT: Integrating Cross-Lingual and Monolingual Semantic Frame Similarities in the MEANT Semantic MT Evaluation Metric. SLSP (2014)
Dekai Wu, Chi-kiu Lo, Meriem Beloucif, Markus Saers
Better Semantic Frame Based MT Evaluation via Inversion Transduction Grammars. SSST@EMNLP (2014)
Chi-kiu Lo, Dekai Wu
MEANT at WMT 2013: A Tunable, Accurate yet Inexpensive Semantic Frame Based MT Evaluation Metric. WMT@ACL (2013)
Chi-kiu Lo, Dekai Wu
Can Informal Genres be better Translated by Tuning on Automatic Semantic Metrics? MTSummit (2013)
Chi-kiu Lo, Dekai Wu
Human semantic MT evaluation with HMEANT for IWSLT 2013. IWSLT (Evaluation Campaign) (2013)
Chi-kiu Lo, Meriem Beloucif, Dekai Wu
Improving machine translation into Chinese by tuning against Chinese MEANT. IWSLT (Evaluation Campaign) (2013)
Chi-kiu Lo, Karteek Addanki, Markus Saers, Dekai Wu
Improving machine translation by training against an automatic semantic frame based evaluation metric. ACL (2) (2013)
Chi-kiu Lo, Anand Karthik Tumuluru, Dekai Wu
Fully Automatic Semantic MT Evaluation. WMT@NAACL-HLT (2012)
Anand Karthik Tumuluru, Chi-kiu Lo, Dekai Wu
Accuracy and robustness in measuring the lexical similarity of semantic role fillers for automatic semantic MT evaluation. PACLIC (2012)
Karteek Addanki, Chi-kiu Lo, Markus Saers, Dekai Wu
LTG vs. ITG Coverage of Cross-Lingual Verb Frame Alternations. EAMT (2012)
Chi-kiu Lo, Dekai Wu
Unsupervised vs. supervised weight estimation for semantic MT evaluation metrics. SSST@ACL (2012)
Chi-kiu Lo, Dekai Wu
MEANT: An inexpensive, high-accuracy, semi-automatic metric for evaluating translation utility based on semantic roles. ACL (2011)
Markus Saers, Dekai Wu, Chi-kiu Lo, Karteek Addanki
Speech Translation with Grammar Driven Probabilistic Phrasal Bilexica Extraction. INTERSPEECH (2011)
Simon Shi, Pascale Fung, Emmanuel Prochasson, Chi-kiu Lo, Dekai Wu
Mining Parallel Documents Using Low Bandwidth and High Precision CLIR from the Heterogeneous Web. IJCNLP (2011)
Chi-kiu Lo, Dekai Wu
Structured vs. Flat Semantic Role Representations for Machine Translation Evaluation. SSST@ACL (2011)
Chi-kiu Lo, Dekai Wu
SMT Versus AI Redux: How Semantic Frames Evaluate MT More Accurately. IJCAI (2011)
Chi-kiu Lo, Dekai Wu
Semantic vs. Syntactic vs. N-gram Structure for Machine Translation Evaluation. SSST@COLING (2010)
Chi-kiu Lo, Dekai Wu
Evaluating Machine Translation Utility via Semantic Role Labels. LREC (2010)
Yihai Shen, Chi-kiu Lo, Marine Carpuat, Dekai Wu
HKUST statistical machine translation experiments for IWSLT 2007. IWSLT (2007)