![]() Ojdanic, Milos ![]() in Empirical Software Engineering (2022), 27 Applying mutation testing to test subtle program changes, such as program patches or other small-scale code modifications, requires using mutants that capture the delta of the altered behaviours. To ... [more ▼] Applying mutation testing to test subtle program changes, such as program patches or other small-scale code modifications, requires using mutants that capture the delta of the altered behaviours. To address this issue, we introduce the concept of commit-relevant mutants, which are the mutants that interact with the behaviours of the system affected by a particular commit. Therefore, commit-aware mutation testing, is a test assessment metric tailored to a specific commit. By analysing 83 commits from 25 projects involving 2,253,610 mutants in both C and Java, we identify the commit-relevant mutants and explore their relationship with other categories of mutants. Our results show that commit-relevant mutants represent a small subset of all mutants, which differs from the other classes of mutants (subsuming and hard-to-kill), and that the commit-relevant mutation score is weakly correlated with the traditional mutation score (Kendall/Pearson 0.15-0.4). Moreover, commit-aware mutation analysis provides insights about the testing of a commit, which can be more efficient than the classical mutation analysis; in our experiments, by analysing the same number of mutants, commit-aware mutants have better fault-revelation potential (30% higher chances of revealing commit-introducing faults) than traditional mutants. We also illustrate a possible application of commit-aware mutation testing as a metric to evaluate test case prioritisation. [less ▲] ![]() Ma, Wei ![]() ![]() in IEEE International Conference on Software Maintenance and Evolution (ICSME) (2020) Detailed reference viewed: 245 (63 UL)![]() ; ; Papadakis, Mike ![]() in IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (2018) Detailed reference viewed: 74 (1 UL)![]() ; Papadakis, Mike ![]() ![]() in 10th IEEE International Conference on Software Testing, Verification and Validation (2017) Detailed reference viewed: 193 (9 UL)![]() ; ; et al in International Symposium on Software Testing and Analysis, ISSTA 2016 (2016) Detailed reference viewed: 72 (2 UL)![]() ; ; Papadakis, Mike ![]() E-print/Working paper (2015) Detailed reference viewed: 165 (3 UL) |
||