Reference : Comparing White-box and Black-box Test Prioritization

	Document type :	Scientific congresses, symposiums and conference proceedings : Paper published in a book
	Discipline(s) :	Engineering, computing & technology : Computer science
	To cite this reference:	http://hdl.handle.net/10993/25175

Title :	Comparing White-box and Black-box Test Prioritization
Language :	English
Author, co-author :	Henard, Christopher [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >]
	Papadakis, Mike [University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC) >]
	Harman, Mark [University College London - UCL]
	Jia, Yue [University College London - UCL]
	Le Traon, Yves [University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC) >]
Publication date :	2016
Main document title :	38th International Conference on Software Engineering (ICSE'16)
Peer reviewed :	Yes
Event name :	38th International Conference on Software Engineering (ICSE'16)
Event date :	14-05-2016 to 22-05-2016
Event place (city) :	Austin, TX
Event country :	USA
Keywords :	[en] Regression Testing ; White-box ; Black-box
Abstract :	[en] Although white-box regression test prioritization has been well-studied, the more recently introduced black-box prioritization approaches have neither been compared against each other nor against more well-established white-box techniques. We present a comprehensive experimental comparison of several test prioritization techniques, including well-established white-box strategies and more recently introduced black-box approaches. We found that Combinatorial Interaction Testing and diversity-based techniques (Input Model Diversity and Input Test Set Diameter) perform best among the black-box approaches. Perhaps surprisingly, we found little difference between black-box and white-box performance (at most 4% fault detection rate difference). We also found the overlap between black- and white-box faults to be high: the first 10% of the prioritized test suites already agree on at least 60% of the faults found. These are positive findings for practicing regression testers who may not have source code available, thereby making white-box techniques inapplicable. We also found evidence that both black-box and white-box prioritization remain robust over multiple system releases.
Permalink :	http://hdl.handle.net/10993/25175

	File(s) associated to this reference
	Fulltext file(s): File Commentary Version Size Access Open access icse16.pdf Author postprint 767.38 kB View/Open

All documents in ORBi^lu are protected by a user license.

 

University of Luxembourg Library |  Feedback |  Legal notices Site Map