Kintis, Marinos ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
Papadakis, Mike ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)
Papadopoulos, Andreas
Valvis, Evangelos
Malevris, Nicos
External co-authors :
no
Language :
English
Title :
Analysing and Comparing the Effectiveness of Mutation Testing Tools: A Manual Study
Publication date :
2016
Event name :
16th IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM'16)
Event date :
Oct-2016
Main work title :
International Working Conference on Source Code Analysis and Manipulation (SCAM'16)
P. Ammann and J. Offutt, Introduction to Software Testing, 1st ed. New York, NY, USA: Cambridge University Press, 2008
Y. Jia and M. Harman, "An analysis and survey of the development of mutation testing," Software Engineering, IEEE Transactions on, vol. 37, no. 5, pp. 649-678, 2011
M. Papadakis, C. Henard, M. Harman, Y. Jia, and Y. L. Traon, "Threats to the validity of mutation-based test assessment," in Proceedings of the 2016 International Symposium on Software Testing and Analysis, ser. ISSTA 2016. New York, NY, USA: ACM, 2016
M. Delahaye and L. Du Bousquet, "Selecting a software engineering tool: lessons learnt from mutation analysis," Software: Practice and Experience, vol. 45, no. 7, pp. 875-891, 2015
R. Gopinath, I. Ahmed, M. A. Alipour, C. Jensen, and A. Groce, "Does choice of mutation tool matter?" Software Quality Journal, pp. 1-50, 2016
M. Papadakis, Y. Jia, M. Harman, and Y. L. Traon, "Trivial compiler equivalence: A large scale empirical study of a simple, fast and effective equivalent mutant detection technique," in 37th International Conference on Software Engineering, vol. 1, May 2015, pp. 936-946
M. Kintis, "Effective methods to tackle the equivalent mutant problem when testing software with mutation," Ph.D. dissertation, Department of Informatics, Athens University of Economics and Business, 2016
T. A. Budd and D. Angluin, "Two notions of correctness and their relation to testing," Acta Informatica, vol. 18, no. 1, pp. 31-45, 1982
M. Kintis and N. Malevris, "MEDIC: A static analysis framework for equivalent mutant identification," Information and Software Technology, vol. 68, pp. 1-17, 2015
P. Ammann, M. E. Delamaro, and J. Offutt, "Establishing theoretical minimal sets of mutants," in Seventh IEEE International Conference on Software Testing, Verification and Validation, ICST 2014, March 31 2014-April 4, 2014, Cleveland, Ohio, USA, 2014, pp. 21-30
M. Kintis, M. Papadakis, and N. Malevris, "Evaluating mutation testing alternatives: A collateral experiment," in Proceedings of the 17th Asia- Pacific Software Engineering Conference, November 2010, pp. 300-309
Y.-S. Ma, J. Offutt, and Y. R. Kwon, "MuJava: an automated class mutation system," Software Testing, Verification and Reliability, vol. 15, no. 2, pp. 97-133, 2005
R. Just, "The Major mutation framework: Efficient and scalable mutation analysis for Java," in Proceedings of the International Symposium on Software Testing and Analysis, 2014, pp. 433-436
H. Coles. "the PIT mutation testing tool". "Last Accessed June 2016". [Online]. Available: "http://pitest.org/"
A. J. Offutt, A. Lee, G. Rothermel, R. H. Untch, and C. Zapf, "An experimental determination of sufficient mutant operators," ACM Transactions on Software Engineering and Methodology, vol. 5, no. 2, pp. 99-118, Apr. 1996
R. Just and F. Schweiggert, "Higher accuracy and lower run time: efficient mutation analysis using non-redundant mutation operators," Software Testing, Verification and Reliability, vol. 25, no. 5-7, pp. 490-507, 2015
R. Geist, A. Offutt, and J. Harris, F.C., "Estimation and enhancement of real-time software reliability through mutation analysis," Computers, IEEE Transactions on, vol. 41, no. 5, pp. 550-558, May 1992
J. Andrews, L. Briand, Y. Labiche, and A. Namin, "Using mutation analysis for assessing and comparing testing coverage criteria," Software Engineering, IEEE Transactions on, vol. 32, no. 8, pp. 608-624, 2006
X. Yao, M. Harman, and Y. Jia, "A study of equivalent and stubborn mutation operators using human analysis of equivalence," in Procs. of the 36th Inter. Conf. on Software Engineering, 2014, pp. 919-930
R. Baker and I. Habli, "An empirical evaluation of mutation testing for improving the test quality of safety-critical software," Software Engineering, IEEE Transactions on, vol. 39, no. 6, pp. 787-805, 2013
M. Kintis, M. Papadakis, A. Papadopoulos, E. Valvis, and N. Malevris. Supporting site for paper: Analysing and comparing the effectiveness of mutation testing tools: A manual study. [Online]. Available: http://pages.cs.aueb.gr/kintism/papers/scam2016
M. Papadakis and N. Malevris, "Automatic mutation test case generation via dynamic symbolic execution," in Software Reliability Engineering, 21st International Symposium on, 2010, pp. 121-130
G. Kaminski, P. Ammann, and J. Offutt, "Improving logic-based testing," Journal of Systems and Software, vol. 86, no. 8, pp. 2002-2012, 2013
B. Lindstrom and A. Marki, "On strong mutation and subsuming mutants," in Procs. 11th Inter. Workshop on Mutation Analysis, 2016
J. Offutt, "A mutation carol: Past, present and future," Information & Software Technology, vol. 53, no. 10, pp. 1098-1107, 2011
N. Li, U. Praphamontripong, and J. Offutt, "An experimental comparison of four unit test criteria: Mutation, edge-pair, all-uses and prime path coverage," in Software Testing, Verification and Validation Workshops, International Conference on, April 2009, pp. 220-229
L. Deng, J. Offutt, and N. Li, "Empirical evaluation of the statement deletion mutation operator," in Software Testing, Verification and Validation, IEEE Sixth International Conference on, 2013, pp. 84-93
S. Rani, B. Suri, and S. K. Khatri, "Experimental comparison of automated mutation testing tools for Java," in Reliability, Infocom Technologies and Optimization, 4th Inter. Conference on, 2015, pp. 1-6
T. Laurent, A. Ventresque, M. Papadakis, C. Henard, and Y. L. Traon, "Assessing and improving the mutation testing practice of PIT," University of Luxembourg, Tech. Rep., 2016
