Mark Harman

ORCID

Publication Activity (10 Years)

Years Active: 1993-2024
Publications (10 Years): 152

Top Venues

CoRR

IEEE Trans. Software Eng.

SSBSE

ICSE

London Metropolitan University, UK (PHD)

Education History

London Metropolitan University, UK

PHD

Publications

Giovani Guizzo, Jie M. Zhang, Federica Sarro, Christoph Treude, Mark Harman
Mutation analysis for evaluating code translation. Empir. Softw. Eng. 29 (1) (2024)
Nadia Alshahwan, Mark Harman, Alexandru Marginean, Rotem Tal, Eddy Wang
Observation-based unit test generation at Meta. CoRR (2024)
Nadia Alshahwan, Mark Harman, Inna Harper, Alexandru Marginean, Shubho Sengupta, Eddy Wang
Assured LLM-Based Software Engineering. CoRR (2024)
Nadia Alshahwan, Jubin Chheda, Anastasia Finegenova, Beliz Gokkaya, Mark Harman, Inna Harper, Alexandru Marginean, Shubho Sengupta, Eddy Wang
Automated Unit Test Improvement using Large Language Models at Meta. CoRR (2024)
Max Hort, Jie M. Zhang, Federica Sarro, Mark Harman
Search-based Automatic Repair for Fairness and Accuracy in Decision-making Software. Empir. Softw. Eng. 29 (1) (2024)
Giovani Guizzo, Francesco Califano, Federica Sarro, Filomena Ferrucci, Mark Harman
Inferring test models from user bug reports using multi-objective search. Empir. Softw. Eng. 28 (4) (2023)
Milos Ojdanic, Mike Papadakis, Mark Harman
Keeping Mutation Test Suites Consistent and Relevant with Long-Standing Mutants. ESEC/SIGSOFT FSE (2023)
Nadia Alshahwan, Mark Harman, Alexandru Marginean
Software Testing Research Challenges: An Industrial Perspective. ICST (2023)
Shuyin Ouyang, Jie M. Zhang, Mark Harman, Meng Wang
LLM is Like a Box of Chocolates: the Non-determinism of ChatGPT in Code Generation. CoRR (2023)
Shreshth Tuli, Kinga Bojarczuk, Natalija Gucevska, Mark Harman, Xiao-Yu Wang, Graham Wright
Simulation-Driven Automated End-to-End Test and Oracle Inference. ICSE-SEIP (2023)
Ming Yan, Junjie Chen, Jie M. Zhang, Xuejie Cao, Chen Yang, Mark Harman
COCO: Testing Code Generation Systems via Concretized Instructions. CoRR (2023)
Yonghao Wu, Zheng Li, Jie M. Zhang, Mike Papadakis, Mark Harman, Yong Liu
Large Language Models in Fault Localisation. CoRR (2023)
Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Mark Harman
An Empirical Study on Fairness Improvement with Multiple Protected Attributes. CoRR (2023)
Kaibo Liu, Yudong Han, Jie M. Zhang, Zhenpeng Chen, Federica Sarro, Mark Harman, Gang Huang, Yun Ma
Who Judges the Judge: An Empirical Study on Online Judge Tests. ISSTA (2023)
Angela Fan, Beliz Gokkaya, Mark Harman, Mitya Lyubarskiy, Shubho Sengupta, Shin Yoo, Jie M. Zhang
Large Language Models for Software Engineering: Survey and Open Problems. CoRR (2023)
Jie M. Zhang, Mark Harman, Benjamin Guedj, Earl T. Barr, John Shawe-Taylor
Model validation using mutated training labels: An exploratory study. Neurocomputing 539 (2023)
Shreshth Tuli, Kinga Bojarczuk, Natalija Gucevska, Mark Harman, Xiao-Yu Wang, Graham Wright
Simulation-Driven Automated End-to-End Test and Oracle Inference. CoRR (2023)
Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Mark Harman
A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers. ACM Trans. Softw. Eng. Methodol. 32 (4) (2023)
Baptiste Rozière, Jie Zhang, François Charton, Mark Harman, Gabriel Synnaeve, Guillaume Lample
Leveraging Automated Unit Tests for Unsupervised Code Translation. ICLR (2022)
Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Mark Harman
MAAT: a novel ensemble approach to addressing fairness and performance bugs for machine learning software. ESEC/SIGSOFT FSE (2022)
Vali Tawosi, Federica Sarro, Alessio Petrozziello, Mark Harman
Multi-Objective Software Effort Estimation: A Replication Study. IEEE Trans. Software Eng. 48 (8) (2022)
Zeyu Sun, Jie M. Zhang, Yingfei Xiong, Mark Harman, Mike Papadakis, Lu Zhang
Improving Machine Translation Systems via Isotopic Replacement. ICSE (2022)
Zhenpeng Chen, Jie M. Zhang, Max Hort, Federica Sarro, Mark Harman
Fairness Testing: A Comprehensive Survey and Analysis of Trends. CoRR (2022)
Maria Kechagia, Sergey Mechtaev, Federica Sarro, Mark Harman
Evaluating Automatic Program Repair Capabilities to Repair API Misuses. IEEE Trans. Software Eng. 48 (7) (2022)
Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Mark Harman
A Comprehensive Empirical Study of Bias Mitigation Methods for Software Fairness. CoRR (2022)
Maxime Cordy, Renaud Rwemalika, Adriano Franci, Mike Papadakis, Mark Harman
FlakiMe: Laboratory-Controlled Test Flakiness Impact Assessment. ICSE (2022)
Mark Harman, Heather Miller
Message from the SEIP Chairs of ICSE 2022. ICSE (SEIP) (2022)
Max Hort, Zhenpeng Chen, Jie M. Zhang, Federica Sarro, Mark Harman
Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey. CoRR (2022)
Ke Mao, Timotej Kapus, Lambros Petrou, Ákos Hajdu, Matteo Marescotti, Andreas Löscher, Mark Harman, Dino Distefano
FAUSTA: Scaling Dynamic Analysis with Traffic Generation at WhatsApp. ICST (2022)
Milos Ojdanic, Mike Papadakis, Mark Harman
Keeping Mutation Test Suites Consistent and Relevant with Long-Standing Mutants. CoRR (2022)
Jie M. Zhang, Mark Harman, Lei Ma, Yang Liu
Machine Learning Testing: Survey, Landscapes and Horizons. IEEE Trans. Software Eng. 48 (2) (2022)
Mark Harman
Scaling Genetic Improvement and Automated Program Repair. APR@ICSE (2022)
Federica Sarro, Rebecca Moussa, Alessio Petrozziello, Mark Harman
Learning From Mistakes: Machine Learning Enhanced Human Expert Effort Estimates. IEEE Trans. Software Eng. 48 (6) (2022)
Max Hort, Maria Kechagia, Federica Sarro, Mark Harman
A Survey of Performance Optimization for Mobile Applications. IEEE Trans. Software Eng. 48 (8) (2022)
Baptiste Rozière, Jie M. Zhang, François Charton, Mark Harman, Gabriel Synnaeve, Guillaume Lample
Leveraging Automated Unit Tests for Unsupervised Code Translation. CoRR (2021)
Kinga Bojarczuk, Natalija Gucevska, Simon M. M. Lucas, Inna Dvortsova, Mark Harman, Erik Meijer, Silvia Sapora, Johann George, Maria Lomeli, Rubmary Rojas
Measurement Challenges for Cyber Cyber Digital Twins: Experiences from the Deployment of Facebook's WW Simulation System. ESEM (2021)
Jie M. Zhang, Mark Harman
"Ignorance and Prejudice" in Software Fairness. ICSE (2021)
Matheus Paixão, Jens Krinke, DongGyun Han, Chaiyong Ragkhitwetsagul, Mark Harman
The Impact of Code Review on Architectural Changes. IEEE Trans. Software Eng. 47 (5) (2021)
John Ahlgren, Kinga Bojarczuk, Sophia Drossopoulou, Inna Dvortsova, Johann George, Natalija Gucevska, Mark Harman, Maria Lomeli, Simon M. M. Lucas, Erik Meijer, Steve Omohundro, Rubmary Rojas, Silvia Sapora, Norm Zhou
Facebook's Cyber-Cyber and Cyber-Physical Digital Twins. EASE (2021)
Carlos Gavidia-Calderon, Federica Sarro, Mark Harman, Earl T. Barr
The Assessor's Dilemma: Improving Bug Repair via Empirical Game Theory. IEEE Trans. Software Eng. 47 (10) (2021)
Giovani Guizzo, Justyna Petke, Federica Sarro, Mark Harman
Enhancing Genetic Improvement of Software with Regression Test Selection. ICSE (2021)
Wei Ma, Thierry Titcheu Chekam, Mike Papadakis, Mark Harman
MuDelta: Delta-Oriented Mutation Testing at Commit Time. ICSE (2021)
Giovani Guizzo, Justyna Petke, Federica Sarro, Mark Harman
Artifact for Enhancing Genetic Improvement of Software with Regression Test Selection. ICSE (Companion Volume) (2021)
Jie M. Zhang, Feng Li, Dan Hao, Meng Wang, Hao Tang, Lu Zhang, Mark Harman
A Study of Bug Resolution Characteristics in Popular Programming Languages. IEEE Trans. Software Eng. 47 (12) (2021)
Gunel Jahangirova, David Clark, Mark Harman, Paolo Tonella
An Empirical Validation of Oracle Improvement. IEEE Trans. Software Eng. 47 (8) (2021)
Max Hort, Jie M. Zhang, Federica Sarro, Mark Harman
Fairea: a model behaviour mutation approach to benchmarking bias mitigation methods. ESEC/SIGSOFT FSE (2021)
John Ahlgren, Maria Eugenia Berezin, Kinga Bojarczuk, Elena Dulskyte, Inna Dvortsova, Johann George, Natalija Gucevska, Mark Harman, Maria Lomeli, Erik Meijer, Silvia Sapora, Justin Spahr-Summers
Testing Web Enabled Simulation at Scale Using Metamorphic Testing. ICSE (SEIP) (2021)
Afnan A. Al-Subaihin, Federica Sarro, Sue Black, Licia Capra, Mark Harman
App Store Effects on Software Engineering Practices. IEEE Trans. Software Eng. 47 (2) (2021)
Youcong Ni, Xin Du, Peng Ye, Leandro L. Minku, Xin Yao, Mark Harman, Ruliang Xiao
Multi-objective software performance optimisation at the architecture level using randomised search rules. Inf. Softw. Technol. 135 (2021)
Huayao Wu, Changhai Nie, Justyna Petke, Yue Jia, Mark Harman
Comparative Analysis of Constraint Handling Techniques for Constrained Combinatorial Testing. IEEE Trans. Software Eng. 47 (11) (2021)
John Ahlgren, Maria Eugenia Berezin, Kinga Bojarczuk, Elena Dulskyte, Inna Dvortsova, Johann George, Natalija Gucevska, Mark Harman, Shan He, Ralf Lämmel, Erik Meijer, Silvia Sapora, Justin Spahr-Summers
Ownership at Large: Open Problems and Challenges in Ownership Management. ICPC (2020)
Zeyu Sun, Jie M. Zhang, Mark Harman, Mike Papadakis, Lu Zhang
Automatic testing and improvement of machine translation. ICSE (2020)
Gunel Jahangirova, David Clark, Mark Harman, Paolo Tonella
An Empirical Study on Failed Error Propagation in Java Programs with Real Faults. CoRR (2020)
John Ahlgren, Maria Eugenia Berezin, Kinga Bojarczuk, Elena Dulskyte, Inna Dvortsova, Johann George, Natalija Gucevska, Mark Harman, Ralf Lämmel, Erik Meijer, Silvia Sapora, Justin Spahr-Summers
WES: Agent-based User Interaction Simulation on Real Infrastructure. ICSE (Workshops) (2020)
John Ahlgren, Maria Eugenia Berezin, Kinga Bojarczuk, Elena Dulskyte, Inna Dvortsova, Johann George, Natalija Gucevska, Mark Harman, Ralf Lämmel, Erik Meijer, Silvia Sapora, Justin Spahr-Summers
WES: Agent-based User Interaction Simulation on Real Infrastructure. CoRR (2020)
John Ahlgren, Maria Eugenia Berezin, Kinga Bojarczuk, Elena Dulskyte, Inna Dvortsova, Johann George, Natalija Gucevska, Mark Harman, Shan He, Ralf Lämmel, Erik Meijer, Silvia Sapora, Justin Spahr-Summers
Ownership at Large - Open Problems and Challenges in Ownership Management. CoRR (2020)
Huayao Wu, Changhai Nie, Justyna Petke, Yue Jia, Mark Harman
An Empirical Comparison of Combinatorial Testing, Random Testing and Adaptive Random Testing. IEEE Trans. Software Eng. 46 (3) (2020)
Yixue Zhao, Justin Chen, Adriana Sejfia, Marcelo Schmitt Laser, Jie Zhang, Federica Sarro, Mark Harman, Nenad Medvidovic
FrUITeR - A Framework for Evaluating UI Test Reuse. CoRR (2020)
Giovani Guizzo, Federica Sarro, Mark Harman
Cost measures matter for mutation testing study validity. ESEC/SIGSOFT FSE (2020)
Carlos Gavidia-Calderon, Federica Sarro, Mark Harman, Earl T. Barr
Game-theoretic analysis of development practices: Challenges and opportunities. J. Syst. Softw. 159 (2020)
Yixue Zhao, Justin Chen, Adriana Sejfia, Marcelo Schmitt Laser, Jie Zhang, Federica Sarro, Mark Harman, Nenad Medvidovic
FrUITeR: a framework for evaluating UI test reuse. ESEC/SIGSOFT FSE (2020)
Jie M. Zhang, Mark Harman, Lei Ma, Yang Liu
Machine Learning Testing: Survey, Landscapes and Horizons. CoRR (2019)
Bobby R. Bruce, Justyna Petke, Mark Harman, Earl T. Barr
Approximate Oracles and Synergy in Software Energy Search Spaces. IEEE Trans. Software Eng. 45 (11) (2019)
Matthieu Jimenez, Renaud Rwemalika, Mike Papadakis, Federica Sarro, Yves Le Traon, Mark Harman
The importance of accounting for real-world labelling when predicting software vulnerabilities. ESEC/SIGSOFT FSE (2019)
Alexandru Marginean, Johannes Bader, Satish Chandra, Mark Harman, Yue Jia, Ke Mao, Alexander Mols, Andrew Scott
SapFix: automated end-to-end repair at scale. ICSE (SEIP) (2019)
Jie M. Zhang, Lingming Zhang, Dan Hao, Lu Zhang, Mark Harman
An Empirical Comparison of Mutant Selection Assessment Metrics. ICST Workshops (2019)
Jie Zhang, Lingming Zhang, Mark Harman, Dan Hao, Yue Jia, Lu Zhang
Predictive Mutation Testing. IEEE Trans. Software Eng. 45 (9) (2019)
Nadia Alshahwan, Andrea Ciancone, Mark Harman, Yue Jia, Ke Mao, Alexandru Marginean, Alexander Mols, Hila Peleg, Federica Sarro, Ilya Zorin
Some challenges for software testing research (invited talk paper). ISSTA (2019)
Earl T. Barr, David W. Binkley, Mark Harman, Mohamed Nassim Seghir
Sub-Turing Islands in the Wild. CoRR (2019)
Huayao Wu, Changhai Nie, Justyna Petke, Yue Jia, Mark Harman
A Survey of Constrained Combinatorial Testing. CoRR (2019)
Jie M. Zhang, Earl T. Barr, Benjamin Guedj, Mark Harman, John Shawe-Taylor
Perturbed Model Validation: A New Framework to Validate Model Relevance. CoRR (2019)
Zeyu Sun, Jie M. Zhang, Mark Harman, Mike Papadakis, Lu Zhang
Automatic Testing and Improvement of Machine Translation. CoRR (2019)
Maxime Cordy, Renaud Rwemalika, Mike Papadakis, Mark Harman
FlakiMe: Laboratory-Controlled Test Flakiness Impact Assessment. A Case Study on Mutation Testing and Program Repair. CoRR (2019)
Mike Papadakis, Marinos Kintis, Jie Zhang, Yue Jia, Yves Le Traon, Mark Harman
Chapter Six - Mutation Testing Advances: An Analysis and Survey. Adv. Comput. 112 (2019)
Mark Harman
We Need a Testability Transformation Semantics. SEFM (2018)
Matheus Paixão, Mark Harman, Yuanyuan Zhang, Yijun Yu
An Empirical Study of Cohesion and Coupling: Balancing Optimization and Disruption. IEEE Trans. Evol. Comput. 22 (3) (2018)
Justyna Petke, Saemundur O. Haraldsson, Mark Harman, William B. Langdon, David Robert White, John R. Woodward
Genetic Improvement of Software: A Comprehensive Survey. IEEE Trans. Evol. Comput. 22 (3) (2018)
Federica Sarro, Mark Harman, Yue Jia, Yuanyuan Zhang
Customer Rating Reactions Can Be Predicted Purely using App Features. RE (2018)
Gunel Jahangirova, David Clark, Mark Harman, Paolo Tonella
OASIs: oracle assessment and improvement tool. ISSTA (2018)
Earl T. Barr, David Clark, Mark Harman, Alexandru Marginean
Indexing Operators to Extend the Reach of Symbolic Execution. CoRR (2018)
Matthieu Jimenez, Thierry Titcheu Chekam, Maxime Cordy, Mike Papadakis, Marinos Kintis, Yves Le Traon, Mark Harman
Are mutants really natural?: a study on how "naturalness" helps mutant selection. ESEM (2018)
Nadia Alshahwan, Xinbo Gao, Mark Harman, Yue Jia, Ke Mao, Alexander Mols, Taijin Tei, Ilya Zorin
Deploying Search Based Software Engineering with Sapienz at Facebook. SSBSE (2018)
Mark Harman, Peter W. O'Hearn
From Start-ups to Scale-ups: Opportunities and Open Problems for Static and Dynamic Program Analysis. SCAM (2018)
Marinos Kintis, Mike Papadakis, Yue Jia, Nicos Malevris, Yves Le Traon, Mark Harman
Detecting Trivial Mutant Equivalences via Compiler Optimisations. IEEE Trans. Software Eng. 44 (4) (2018)
Matheus Paixão, Jens Krinke, DongGyun Han, Mark Harman
CROP: linking code reviews to source code changes. MSR (2018)
Yuanyuan Zhang, Mark Harman, Gabriela Ochoa, Guenther Ruhe, Sjaak Brinkkemper
An Empirical Study of Meta- and Hyper-Heuristic Search for Multi-Objective Release Planning. ACM Trans. Softw. Eng. Methodol. 27 (1) (2018)
Justyna Petke, Mark Harman, William B. Langdon, Westley Weimer
Specialising Software for Different Downstream Applications Using Genetic Improvement and Code Transplantation. IEEE Trans. Software Eng. 44 (6) (2018)
Mark Harman
Search Based Software Testing for Android. SBST@ICSE (2017)
William B. Langdon, Brian Yee Hong Lam, Marc Modat, Justyna Petke, Mark Harman
Genetic improvement of GPU software. Genet. Program. Evolvable Mach. 18 (1) (2017)
Ke Mao, Licia Capra, Mark Harman, Yue Jia
A survey of the use of crowdsourcing in software engineering. J. Syst. Softw. 126 (2017)
Anthony Finkelstein, Mark Harman, Yue Jia, William J. Martin, Federica Sarro, Yuanyuan Zhang
Investigating the relationship between price, rating, and popularity in the Blackberry World App Store. Inf. Softw. Technol. 87 (2017)
Federica Sarro, Filomena Ferrucci, Mark Harman, Alessandra Manna, Jian Ren
Adaptive Multi-Objective Evolutionary Algorithms for Overtime Planning in Software Projects. IEEE Trans. Software Eng. 43 (10) (2017)
Fan Wu, Jay Nanavati, Mark Harman, Yue Jia, Jens Krinke
Memory mutation testing. Inf. Softw. Technol. 81 (2017)
Ke Mao, Mark Harman, Yue Jia
Crowd intelligence enhances automated mobile testing. ASE (2017)
He Jiang, Ke Tang, Justyna Petke, Mark Harman
Search Based Software Engineering [Guest Editorial]. IEEE Comput. Intell. Mag. 12 (2) (2017)
Thierry Titcheu Chekam, Mike Papadakis, Yves Le Traon, Mark Harman
An empirical study on mutation, statement and branch coverage fault revelation that avoids the unreliable clean program assumption. ICSE (2017)
Ke Mao, Mark Harman, Yue Jia
Robotic Testing of Mobile Apps for Truly Black-Box Automation. IEEE Softw. 34 (2) (2017)
Shin Yoo, Xiaoyuan Xie, Fei-Ching Kuo, Tsong Yueh Chen, Mark Harman
Human Competitiveness of Genetic Programming in Spectrum-Based Fault Localisation: Theoretical and Empirical Analysis. ACM Trans. Softw. Eng. Methodol. 26 (1) (2017)
Nicolas E. Gold, David W. Binkley, Mark Harman, Syed S. Islam, Jens Krinke, Shin Yoo
Generalized observational slicing for tree-represented modelling languages. ESEC/SIGSOFT FSE (2017)
William B. Langdon, Shin Yoo, Mark Harman
Inferring Automatic Test Oracles. SBST@ICSE (2017)

Mark Harman.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Mark Harman