Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA'18)
ACM
Yes
International
978-1-4503-5699-2
New York
USA
ACM SIGSOFT International Symposium on Software Testing and Analysis
from 16-07-2018 to 21-07-2018
Amsterdam
The Netherlands
[en] Acceptance Testing ; Test Case Prioritization ; Search-based Software Engineering ; Multi-objective Optimization ; Cyber Physical Systems
[en] Acceptance testing validates that a system meets its requirements and determines whether it can be sufficiently trusted and put into operation. For cyber physical systems (CPS), acceptance testing is a hardware-in-the-loop process conducted in a (near-)operational environment. Acceptance testing of a CPS often necessitates that the test cases be prioritized, as there are usually too many scenarios to consider given time constraints. CPS acceptance testing is further complicated by the uncertainty in the environment and the impact of testing on hardware. We propose an automated test case prioritization approach for CPS acceptance testing, accounting for time budget constraints, uncertainty, and hardware damage risks. Our approach is based on multi-objective search, combined with a test case minimization algorithm that eliminates redundant operations from an ordered sequence of test cases. We evaluate our approach on a representative case study from the satellite domain. The results indicate that, compared to test cases that are prioritized manually by satellite engineers, our automated approach more than doubles the number of test cases that fit into a given time frame, while reducing to less than one third the number of operations that entail the risk of damage to key hardware components.
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > Software Verification and Validation Lab (SVV Lab)
Researchers ; Professionals ; Students ; General public ; Others
[University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >]
