| Reference : An Empirical Study on Mutation, Statement and Branch Coverage Fault Revelation that A... |
| Scientific congresses, symposiums and conference proceedings : Paper published in a book | |||
| Engineering, computing & technology : Computer science | |||
| Security, Reliability and Trust | |||
| http://hdl.handle.net/10993/30694 | |||
| An Empirical Study on Mutation, Statement and Branch Coverage Fault Revelation that Avoids the Unreliable Clean Program Assumption | |
| English | |
Titcheu Chekam, Thierry [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >] | |
Papadakis, Mike [University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC) >] | |
Le Traon, Yves [University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC) >] | |
Harman, Mark [University College London - UCL and Facebook, London] | |
| 28-May-2017 | |
| International Conference on Software Engineering (ICSE 2017) | |
| Yes | |
| No | |
| International | |
| 39th International Conference on Software Engineering (ICSE 2017) | |
| May 20-28, 2017 | |
| IEEE ICSE 2017 organizing commitee | |
| Buenos Aires | |
| Argentina | |
| [en] Mutation testing ; real faults ; test adequacy ; code coverage ; test effectiveness | |
| [en] Many studies suggest using coverage concepts, such as branch coverage, as the starting point of testing, while others as the most prominent test quality indicator. Yet the relationship between coverage and fault-revelation remains unknown, yielding uncertainty and controversy. Most previous studies rely on the Clean Program Assumption, that a test suite will obtain similar
coverage for both faulty and fixed (‘clean’) program versions. This assumption may appear intuitive, especially for bugs that denote small semantic deviations. However, we present evidence that the Clean Program Assumption does not always hold, thereby raising a critical threat to the validity of previous results. We then conducted a study using a robust experimental methodology that avoids this threat to validity, from which our primary finding is that strong mutation testing has the highest fault revelation of four widely-used criteria. Our findings also revealed that fault revelation starts to increase significantly only once relatively high levels of coverage are attained. | |
| Fonds National de la Recherche - FnR ; EPSRC Programme Grant DAASE (EP/J017515/1) | |
| Researchers ; Professionals ; Students ; General public ; Others | |
| http://hdl.handle.net/10993/30694 |
| File(s) associated to this reference | ||||||||||||||
|
Fulltext file(s):
| ||||||||||||||
All documents in ORBilu are protected by a user license.