![]() Papadakis, Mike ![]() ![]() in Advances in Computers (2019) Detailed reference viewed: 1145 (62 UL)![]() Kintis, Marinos ![]() ![]() in IEEE Transactions on Software Engineering (2017) Detailed reference viewed: 208 (8 UL)![]() Henard, Christopher ![]() ![]() in 38th International Conference on Software Engineering (ICSE'16) (2016) Although white-box regression test prioritization has been well-studied, the more recently introduced black-box prioritization approaches have neither been compared against each other nor against more ... [more ▼] Although white-box regression test prioritization has been well-studied, the more recently introduced black-box prioritization approaches have neither been compared against each other nor against more well-established white-box techniques. We present a comprehensive experimental comparison of several test prioritization techniques, including well-established white-box strategies and more recently introduced black-box approaches. We found that Combinatorial Interaction Testing and diversity-based techniques (Input Model Diversity and Input Test Set Diameter) perform best among the black-box approaches. Perhaps surprisingly, we found little difference between black-box and white-box performance (at most 4% fault detection rate difference). We also found the overlap between black- and white-box faults to be high: the first 10% of the prioritized test suites already agree on at least 60% of the faults found. These are positive findings for practicing regression testers who may not have source code available, thereby making white-box techniques inapplicable. We also found evidence that both black-box and white-box prioritization remain robust over multiple system releases. [less ▲] Detailed reference viewed: 267 (14 UL) |
||