Reference : An Empirical Study on Mutation, Statement and Branch Coverage Fault Revelation that A...
Scientific congresses, symposiums and conference proceedings : Paper published in a book
Engineering, computing & technology : Computer science
Security, Reliability and Trust
http://hdl.handle.net/10993/30694
An Empirical Study on Mutation, Statement and Branch Coverage Fault Revelation that Avoids the Unreliable Clean Program Assumption
English
Titcheu Chekam, Thierry mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >]
Papadakis, Mike mailto [University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC) >]
Le Traon, Yves mailto [University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC) >]
Harman, Mark mailto [University College London - UCL and Facebook, London]
28-May-2017
An Empirical Study on Mutation, Statement and Branch Coverage Fault Revelation that Avoids the Unreliable Clean Program Assumption
Yes
No
International
39th International Conference on Software Engineering (ICSE 2017)
May 20-28, 2017
IEEE ICSE 2017 organizing commitee
Buenos Aires
Argentina
[en] Mutation testing ; real faults ; test adequacy ; code coverage ; test effectiveness
[en] Many studies suggest using coverage concepts, such as branch coverage, as the starting point of testing, while others as the most prominent test quality indicator. Yet the relationship between coverage and fault-revelation remains unknown, yielding uncertainty and controversy. Most previous studies rely on the Clean Program Assumption, that a test suite will obtain similar
coverage for both faulty and fixed (‘clean’) program versions. This assumption may appear intuitive, especially for bugs that denote small semantic deviations. However, we present evidence
that the Clean Program Assumption does not always hold, thereby raising a critical threat to the validity of previous results. We then conducted a study using a robust experimental methodology that avoids this threat to validity, from which our primary finding is that strong mutation testing has the highest fault revelation of four widely-used criteria. Our findings also revealed that fault revelation starts to increase significantly only once relatively high levels of coverage are attained.
Fonds National de la Recherche - FnR ; EPSRC Programme Grant DAASE (EP/J017515/1)
Researchers ; Professionals ; Students ; General public ; Others
http://hdl.handle.net/10993/30694

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Open access
ICSE17.pdfAuthor preprint640.21 kBView/Open

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.