Maja Popovic

Publication Activity (10 Years)

Years Active: 2004-2024
Publications (10 Years): 54

Top Topics

Machine Translation

Cognitive Effort

Product Descriptions

Top Venues

Publications

Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinþór Steingrímsson, Vilém Zouhar
Preliminary WMT24 Ranking of General MT Systems and LLMs. CoRR (2024)
Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, Roman Grundkiewicz, Marzena Karpinska, Maja Popovic, Mrinmaya Sachan, Mariya Shmatova
Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation. CoRR (2024)
Maja Popovic, Vasudevan Nedumpozhimana, Meegan Gower, Sneha Rautmare, Nishtha Jain, John D. Kelleher
Using MT for multilingual covid-19 case load prediction from social media texts. EAMT (2023)
Vasudevan Nedumpozhimana, Sneha Rautmare, Meegan Gower, Nishtha Jain, Maja Popovic, Patricia Buffini, John D. Kelleher
Medical Concept Mention Identification in Social Media Posts Using a Small Number of Sample References. RANLP (2023)
Kanishk Verma, Maja Popovic, Alexandros Poulis, Yelena Cherkasova, Cathal Ó Hóbáin, Angela Mazzone, Tijana Milosevic, Brian Davis
Leveraging machine translation for cross-lingual fine-grained cyberbullying classification amongst pre-adolescents. Nat. Lang. Eng. 29 (6) (2023)
Maja Popovic, Ekaterina Lapshinova-Koltunski, Maarit Koponen
Computational analysis of different translations: by professionals, students and machines. EAMT (2023)
Maja Popovic, Mohammad Arvan, Natalie Parde, Anya Belz
Exploring Variation of Results from Different Experimental Conditions. ACL (Findings) (2023)
Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Philipp Koehn, Benjamin Marie, Christof Monz, Makoto Morishita, Kenton Murray, Makoto Nagata, Toshiaki Nakazawa, Martin Popel, Maja Popovic, Mariya Shmatova
Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet. WMT (2023)
Anya Belz, Maja Popovic, Simon Mille
Quantified Reproducibility Assessment of NLP Results. CoRR (2022)
Anya Belz, Maja Popovic, Simon Mille
Quantified Reproducibility Assessment of NLP Results. ACL (1) (2022)
Pintu Lohar, Sinead Madden, Edmond O'Connor, Maja Popovic, Tanya Habruseva
Building Machine Translation System for Software Product Descriptions Using Domain-specific Sub-corpora Extraction. AMTA (2022)
Marija Brkic Bakaric, Lucia Nacinovic Prskalo, Maja Popovic
A General Framework for Detecting Metaphorical Collocations. MWE@LREC2022 (2022)
Tom Kocmi, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Thamme Gowda, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Rebecca Knowles, Philipp Koehn, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Michal Novák, Martin Popel, Maja Popovic
Findings of the 2022 Conference on Machine Translation (WMT22). WMT (2022)
Ekaterina Lapshinova-Koltunski, Maja Popovic, Maarit Koponen
DiHuTra: a Parallel Corpus to Analyse Differences between Human Translations. LREC (2022)
Nishtha Jain, Declan Groves, Lucia Specia, Maja Popovic
Leveraging Pre-trained Language Models for Gender Debiasing. LREC (2022)
Ekaterina Lapshinova-Koltunski, Maja Popovic, Maarit Koponen
DiHuTra: a Parallel Corpus to Analyse Differences between Human Translations. EAMT (2022)
Maja Popovic
Agree to Disagree: Analysis of Inter-Annotator Disagreements in Human Evaluation of Machine Translation Output. CoNLL (2021)
Maja Popovic
From MT to LREV: managing the transition. Mach. Transl. 35 (4) (2021)
Maja Popovic, Anya Belz
A Reproduction Study of an Annotation-based Human Evaluation of MT Outputs. INLG (2021)
Nishtha Jain, Maja Popovic, Declan Groves, Eva Vanmassenhove
Generating Gender Augmented Data for NLP. CoRR (2021)
Maja Popovic, Alberto Poncelas, Marija Brkic, Andy Way
On Machine Translation of User Reviews. RANLP (2021)
Maja Popovic
On nature and causes of observed MT errors. MTSummit (1) (2021)
Maja Popovic
Informative Manual Evaluation of Machine Translation Output. COLING (2020)
Maja Popovic
On the differences between human translations. EAMT (2020)
Andy Way, Rejwanul Haque, Guodong Xie, Federico Gaspari, Maja Popovic, Alberto Poncelas
Rapid Development of Competitive Translation Engines for Access to Multilingual COVID-19 Information. Informatics 7 (2) (2020)
Maja Popovic, Alberto Poncelas, Marija Brkic, Andy Way
Neural Machine Translation for translating into Croatian and Serbian. VarDial@COLING (2020)
Sheila Castilho, Maja Popovic, Andy Way
On Context Span Needed for Machine Translation Evaluation. LREC (2020)
Andy Way, Rejwanul Haque, Guodong Xie, Federico Gaspari, Maja Popovic, Alberto Poncelas
Facilitating Access to Multilingual COVID-19 Information via Neural Machine Translation. CoRR (2020)
Maja Popovic
Relations between comprehensibility and adequacy errors in machine translation output. CoNLL (2020)
Maja Popovic
QRev: Machine Translation of User Reviews: What Influences the Translation Quality? EAMT (2020)
Maja Popovic, Alberto Poncelas
Neural Machine Translation between similar South-Slavic languages. WMT@EMNLP (2020)
Maja Popovic
On reducing translation shifts in translations intended for MT evaluation. MTSummit (2) (2019)
Maja Popovic
Evaluating Conjunction Disambiguation on English-to-German and French-to-German WMT 2019 Translation Hypotheses. WMT (2) (2019)
Sanja Stajner, Maja Popovic
Automated Text Simplification as a Preprocessing Step for Machine Translation into an Under-resourced Language. RANLP (2019)
Maja Popovic, Sheila Castilho
Are ambiguous conjunctions problematic for machine translation? RANLP (2019)
Alberto Poncelas, Maja Popovic, Dimitar Sht. Shterionov, Gideon Maillette de Buy Wenniger, Andy Way
Combining SMT and NMT Back-Translated Data for Efficient NMT. CoRR (2019)
Pintu Lohar, Maja Popovic, Andy Way
Building English-to-Serbian Machine Translation System for IMDb Movie Reviews. BSNLP@ACL (2019)
Alberto Poncelas, Maja Popovic, Dimitar Sht. Shterionov, Gideon Maillette de Buy Wenniger, Andy Way
Combining PBSMT and NMT Back-translated Data for Efficient NMT. RANLP (2019)
Sheila Castilho, Federico Gaspari, Joss Moorkens, Maja Popovic, Antonio Toral
Editors' foreword to the special issue on human factors in neural machine translation. Mach. Transl. 33 (1-2) (2019)
Maja Popovic, David Vilar
Automatic error classification with multiple error labels. MTSummit (1) (2019)
Maja Popovic
Language-related issues for NMT and PBMT for English-German and English-Serbian. Mach. Transl. 32 (3) (2018)
Iris Hendrickx, Eirini Takoulidou, Thanasis Naskos, Katia Lida Kermanidis, Vilelmini Sosoni, Hugo De Vos, Maria Stasimioti, Menno van Zaanen, Panayota Georgakopoulou, Valia Kordoni, Maja Popovic, Markus Egg, Antal van den Bosch
A Multilingual Wikified Data Set of Educational Material. LREC (2018)
Juan Antonio Pérez-Ortiz, Felipe Sánchez-Martínez, Miquel Esplà-Gomis, Maja Popovic, Celia Rico, André Martins, Joachim Van den Bogaert, Mikel L. Forcada
Proceedings of the 21st Annual Conference of the European Association for Machine Translation. EAMT (2018)
Maja Popovic
Complex Word Identification Using Character n-grams. BEA@NAACL-HLT (2018)
Maja Popovic
Comparing Language Related Issues for NMT and PBMT between German and English. Prague Bull. Math. Linguistics 108 (2017)
Maja Popovic
chrF++: words helping character n-grams. WMT (2017)
Nora Aranberri, Eleftherios Avramidis, Aljoscha Burchardt, Ondrej Klejch, Martin Popel, Maja Popovic
Tools and Guidelines for Principled Machine Translation Development. LREC (2016)
Valia Kordoni, Lexi Birch, Ioana Buliga, Kostadin Cholakov, Markus Egg, Federico Gaspari, Yota Georgakopoulou, Maria Gialama, Iris Hendrickx, Mitja Jermol, Katia Kermanidis, Joss Moorkens, Davor Orlic, Michael Papadopoulos, Maja Popovic, Rico Sennrich, Vilelmini Sosoni, Dimitrios Tsoumakos, Antal van den Bosch, Menno van Zaanen, Andy Way
TraMOOC (Translation for Massive Open Online Courses): providing reliable MT for MOOCs. EAMT (Projects/Products) (2016)
Maja Popovic, Mihael Arcan
PE2rr Corpus: Manual Error Annotation of Automatically Pre-annotated MT Post-edits. LREC (2016)
Sanja Stajner, Maja Popovic
Can Text Simplification Help Machine Translation? EAMT (2016)
Maja Popovic, Mihael Arcan, Arle Lommel
Potential and Limits of Using Post-edits as Reference Translations for MT Evaluation. EAMT (2016)
Maja Popovic, Mihael Arcan, Filip Klubicka
Language Related Issues for Machine Translation between Closely Related South Slavic Languages. VarDial@COLING (2016)
Maja Popovic
chrF deconstructed: beta parameters and n-gram weights. WMT (2016)
Maja Popovic, Kostadin Cholakov, Valia Kordoni, Nikola Ljubesic
Enlarging Scarce In-domain English-Croatian Corpus for SMT of MOOCs Using Serbian. VarDial@COLING (2016)
Maja Popovic, Mihael Arcan
Identifying main obstacles for statistical machine translation of morphologically rich South Slavic languages. EAMT (2015)
Maja Popovic, Mihael Arcan, Eleftherios Avramidis, Aljoscha Burchardt, Arle Lommel
Poor man's lemmatisation for automatic error classification. EAMT (2015)
Eleftherios Avramidis, Aljoscha Burchardt, Maja Popovic, Hans Uszkoreit
Towards Deeper MT - A Hybrid System for German. DMTW (2015)
Eleftherios Avramidis, Maja Popovic, Aljoscha Burchardt
DFKI's experimental hybrid MT system for WMT 2015. WMT@EMNLP (2015)
Maja Popovic
chrF: character n-gram F-score for automatic MT evaluation. WMT@EMNLP (2015)
Eleftherios Avramidis, Aljoscha Burchardt, Sabine Hunsicker, Maja Popovic, Cindy Tscherwinka, David Vilar, Hans Uszkoreit
The taraXÜ corpus of human-annotated machine translations. LREC (2014)
Maja Popovic, Eleftherios Avramidis, Aljoscha Burchardt, Sabine Hunsicker, Sven Schmeier, Cindy Tscherwinka, David Vilar, Hans Uszkoreit
Involving language professionals in the evaluation of machine translation. Lang. Resour. Evaluation 48 (4) (2014)
Maja Popovic, Arle Lommel, Aljoscha Burchardt, Eleftherios Avramidis, Hans Uszkoreit
Relations between different types of post-editing operations, cognitive effort and temporal effort. EAMT (2014)
Arle Lommel, Aljoscha Burchardt, Maja Popovic, Kim Harris, Eleftherios Avramidis, Hans Uszkoreit
Using a new analytic measure for the annotation and analysis of MT errors on real data. EAMT (2014)
Eleftherios Avramidis, Maja Popovic
Correlating decoding events with errors in Statistical Machine Translation. ICON (2014)
Maja Popovic, Eleftherios Avramidis, Aljoscha Burchardt, David Vilar, Hans Uszkoreit
What can we learn about the selection mechanism for post-editing? WPTP@MTSummit (2013)
Eleftherios Avramidis, Maja Popovic
Selecting Feature Sets for Comparative and Time-Oriented Quality Estimation of Machine Translation Output. WMT@ACL (2013)
Maja Popovic, Eleftherios Avramidis, Aljoscha Burchardt, Sabine Hunsicker, Sven Schmeier, Cindy Tscherwinka, David Vilar
Learning from Human Judgments of Machine Translation Output. MTSummit (Posters) (2013)
Maja Popovic, Eleftherios Avramidis, Aljoscha Burchardt, Sabine Hunsicker, Sven Schmeier, Cindy Tscherwinka, David Vilar
A CCG-based Quality Estimation Metric for Statistical Machine Translation Learning from Human Judgments of Machine Translation Output. MTSummit (Posters) (2013)
Mireia Farrús, Marta R. Costa-jussà, Maja Popovic
Study and correlation analysis of linguistic, perceptual, and automatic machine translation evaluations. J. Assoc. Inf. Sci. Technol. 63 (1) (2012)
Jan Berka, Ondrej Bojar, Mark Fishel, Maja Popovic, Daniel Zeman
Automatic MT Error Analysis: Hjerson Helping Addicter. LREC (2012)
Eleftherios Avramidis, Aljoscha Burchardt, Christian Federmann, Maja Popovic, Cindy Tscherwinka, David Vilar
Involving Language Professionals in the Evaluation of Machine Translation. LREC (2012)
Maja Popovic
rgbF: An Open Source Tool for n-gram Based Automatic Evaluation of Machine Translation Output. Prague Bull. Math. Linguistics 98 (2012)
Maja Popovic
Morpheme- and POS-based IBM1 and language model scores for translation quality estimation. WMT@NAACL-HLT (2012)
Mark Fishel, Ondrej Bojar, Maja Popovic
Terra: a Collection of Translation Error-Annotated Corpora. LREC (2012)
Maja Popovic
Class error rates for evaluation of machine translation output. WMT@NAACL-HLT (2012)
Mark Fishel, Rico Sennrich, Maja Popovic, Ondrej Bojar
TerrorCat: a Translation Error Categorization-based MT Quality Metric. WMT@NAACL-HLT (2012)
Maja Popovic, Aljoscha Burchardt
From Human to Automatic Error Classification for Machine Translation Output. EAMT (2011)
Maja Popovic
Hjerson: An Open Source Tool for Automatic Error Classification of Machine Translation Output. Prague Bull. Math. Linguistics 96 (2011)
David Vilar, Eleftherios Avramidis, Maja Popovic, Sabine Hunsicker
DFKI's SC and MT submissions to IWSLT 2011. IWSLT (2011)
Eleftherios Avramidis, Maja Popovic, David Vilar, Aljoscha Burchardt
Evaluate with Confidence Estimation: Machine ranking of translation outputs using grammatical features. WMT@EMNLP (2011)
Maja Popovic, Hermann Ney
Towards Automatic Error Analysis of Machine Translation Output. Comput. Linguistics 37 (4) (2011)
Maja Popovic, David Vilar, Eleftherios Avramidis, Aljoscha Burchardt
Evaluation without references: IBM1 scores as evaluation metrics. WMT@EMNLP (2011)
Maja Popovic
Morphemes and POS tags for n-gram based evaluation metrics. WMT@EMNLP (2011)
Maja Popovic, Hermann Ney
Syntax-Oriented Evaluation Measures for Machine Translation Output. WMT@EACL (2009)
Maja Popovic, David Vilar, Daniel Stein, Evgeny Matusov, Hermann Ney
The RWTH Machine Translation System for WMT 2009. WMT@EACL (2009)
Maja Popovic, Hermann Ney
Word Error Rates: Decomposition over POS classes and Applications for Error Analysis. WMT@ACL (2007)
Maja Popovic, Hermann Ney
POS-based Word Reorderings for Statistical Machine Translation. LREC (2006)
Adrià de Gispert, Deepa Gupta, Maja Popovic, Patrik Lambert, José B. Mariño, Marcello Federico, Hermann Ney, Rafael E. Banchs
Improving Statistical Word Alignments with Morpho-syntactic Transformations. FinTAL (2006)
David Vilar, Maja Popovic, Hermann Ney
AER: do we need to "improve" our alignments? IWSLT (2006)
Maja Popovic, Adrià de Gispert, Deepa Gupta, Patrik Lambert, Hermann Ney, José B. Mariño, Marcello Federico, Rafael E. Banchs
Morpho-syntactic Information for Automatic Error Analysis of Statistical Machine Translation Output. WMT@HLT-NAACL (2006)
Maja Popovic, Daniel Stein, Hermann Ney
Statistical Machine Translation of German Compound Words. FinTAL (2006)
Maja Popovic, Hermann Ney
Exploiting phrasal lexica and additional morpho-syntactic language resources for statistical machine translation with scarce training data. EAMT (2005)
Maja Popovic, David Vilar, Hermann Ney, Slobodan Jovicic, Zoran Saric
Augmenting a Small Parallel Text with Morpho-Syntactic Language. ParallelText@ACL (2005)
Hermann Ney, Maja Popovic, David Sündermann
Error Measures and Bayes Decision Rules Revisited with Applications to POS Tagging. EMNLP (2004)
Evgeny Matusov, Maja Popovic, Richard Zens, Hermann Ney
Statistical machine translation of spontaneous speech with scarce resources. IWSLT (2004)
Hermann Ney, Maja Popovic
Improving Word Alignment Quality using Morpho-syntactic Information. COLING (2004)
Maja Popovic, Hermann Ney
Towards the Use of Word Stems and Suffixes for Statistical Machine Translation. LREC (2004)