Article (Scientific journals)
Test case selection and prioritization using machine learning: a systematic literature review
Pan, Rongqi; Bagherzadeh, Mojtaba; Ghaleb, Taher et al.
2022In Empirical Software Engineering, 27
Peer Reviewed verified by ORBi


Full Text
Publisher postprint (5.33 MB)

All documents in ORBilu are protected by a user license.

Send to


Keywords :
Software Testing; Machine Learning; Test case Prioritization Test case Selection
Abstract :
Regression testing is an essential activity to assure that software code changes do not adversely a ect existing functionalities. With the wide adoption of Continuous Integration (CI) in software projects, which increases the frequency of running software builds, running all tests can be time-consuming and resource-intensive. To alleviate that problem, Test case Selection and Prioritiza- tion (TSP) techniques have been proposed to improve regression testing by selecting and prioritizing test cases in order to provide early feedback to developers. In recent years, researchers have relied on Machine Learning (ML) techniques to achieve e ective TSP (ML-based TSP). Such techniques help combine information about test cases, from partial and imperfect sources, into accurate prediction models. This work conducts a systematic literature review focused on ML-based TSP techniques, aiming to perform an in-depth analysis of the state of the art, thus gaining insights regarding fu- ture avenues of research. To that end, we analyze 29 primary studies published from 2006 to 2020, which have been identi ed through a systematic and documented process. This paper addresses ve research questions addressing variations in ML-based TSP techniques and feature sets for training and testing ML models, alternative metrics used for evaluating the techniques, the performance of techniques, and the reproducibility of the published studies. We summarize the results related to our research questions in a high-level summary that can be used as a taxonomy for classifying future TSP studies.
Research center :
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > Software Verification and Validation Lab (SVV Lab)
Disciplines :
Computer science
Author, co-author :
Pan, Rongqi;  University of Ottawa
Bagherzadeh, Mojtaba;  University of Ottawa
Ghaleb, Taher;  University of Ottawa
Briand, Lionel ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SVV
External co-authors :
Language :
Title :
Test case selection and prioritization using machine learning: a systematic literature review
Publication date :
Journal title :
Empirical Software Engineering
Publisher :
Springer, United States
Volume :
Peer reviewed :
Peer Reviewed verified by ORBi
Focus Area :
Security, Reliability and Trust
Funders :
NSERC Canada Research Chair and Discovery programs
Available on ORBilu :
since 13 January 2023


Number of views
310 (50 by Unilu)
Number of downloads
731 (17 by Unilu)

Scopus citations®
Scopus citations®
without self-citations
WoS citations


Similar publications

Contact ORBilu