Reference : On the use of commit-relevant mutants
Scientific journals : Article
Engineering, computing & technology : Computer science
On the use of commit-relevant mutants
Ojdanic, Milos* mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SerVal >]
Ma, Wei* mailto []
Laurent, Thomas mailto []
Titcheu Chekam, Thierry mailto []
Ventresque, Anthony mailto []
Papadakis, Mike mailto [University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS) >]
* These authors have contributed equally to this work.
Empirical Software Engineering
Kluwer Academic Publishers
[en] Mutation testing ; Change-relevant mutants ; Continuous integration ; Regression testing
[en] Applying mutation testing to test subtle program changes, such as program patches or other small-scale code modifications, requires using mutants that capture the delta of the altered behaviours. To address this issue, we introduce the concept of commit-relevant mutants, which are the mutants that interact with the behaviours of the system affected by a particular commit. Therefore, commit-aware mutation testing, is a test assessment metric tailored to a specific commit. By analysing 83 commits from 25 projects involving 2,253,610 mutants in both C and Java, we identify the commit-relevant mutants and explore their relationship with other categories of mutants. Our results show that commit-relevant mutants represent a small subset of all mutants, which differs from the other classes of mutants (subsuming and hard-to-kill), and that the commit-relevant mutation score is weakly correlated with the traditional mutation score (Kendall/Pearson 0.15-0.4). Moreover, commit-aware mutation analysis provides insights about the testing of a commit, which can be more efficient than the classical mutation analysis; in our experiments, by analysing the same number of mutants, commit-aware mutants have better fault-revelation potential (30% higher chances of revealing commit-introducing faults) than traditional mutants. We also illustrate a possible application of commit-aware mutation testing as a metric to evaluate test case prioritisation.
Researchers ; Professionals ; Students
FnR ; FNR11686509 > Michail Papadakis > CODEMATES > Continuous Development With Mutation Analysis And Testing > 01/09/2018 > 31/08/2021 > 2017

File(s) associated to this reference

Fulltext file(s):

Open access
on_the_use_of_commit-relevant_mutants.pdfPublisher postprint3.29 MBView/Open

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.