Article (Scientific journals)
Oracles for Testing Software Timeliness with Uncertainty
WANG, Chunhui; PASTORE, Fabrizio; BRIAND, Lionel
2019In ACM Transactions on Software Engineering and Methodology, 28 (1)
Peer Reviewed verified by ORBi
 

Files


Full Text
Wang-STUIOS-TOSEM-Orbi.lu.pdf
Author postprint (1.62 MB)
Download

All documents in ORBilu are protected by a user license.

Send to



Details



Keywords :
Time Uncertainty; Probabilistic Input Output Sequences; Timing Specifications; Test Oracles
Abstract :
[en] Uncertainty in timing properties (e.g., detection time of external events) is a common occurrence in embedded software systems since these systems interact with complex physical environments. Such time uncertainty leads to non-determinism. For example, time-triggered operations may either generate different valid outputs across different executions, or experience failures (e.g., results not being generated in the expected time window) that occur only occasionally over many executions. For these reasons, time uncertainty makes the generation of effective test oracles for timing requirements a challenging task. To address the above challenge, we propose STUIOS (Stochastic Testing with Unique Input Output Sequences), an approach for the automated generation of stochastic oracles that verify the capability of a software system to fulfill timing constraints in the presence of time uncertainty. Such stochastic oracles entail the statistical analysis of repeated test case executions based on test output probabilities predicted by means of statistical model checking. Results from two industrial case studies in the automotive domain demonstrate that this approach improves the fault detection effectiveness of tests suites derived from timed automata, compared to traditional approaches.
Research center :
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > Software Verification and Validation Lab (SVV Lab)
Disciplines :
Computer science
Author, co-author :
WANG, Chunhui ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
PASTORE, Fabrizio  ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
BRIAND, Lionel ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
External co-authors :
no
Language :
English
Title :
Oracles for Testing Software Timeliness with Uncertainty
Publication date :
2019
Journal title :
ACM Transactions on Software Engineering and Methodology
ISSN :
1049-331X
Publisher :
Association for Computing Machinery (ACM), United States
Volume :
28
Issue :
1
Peer reviewed :
Peer Reviewed verified by ORBi
Focus Area :
Security, Reliability and Trust
European Projects :
H2020 - 694277 - TUNE - Testing the Untestable: Model Testing of Complex Software-Intensive Systems
Funders :
CE - Commission Européenne [BE]
Available on ORBilu :
since 20 October 2018

Statistics


Number of views
345 (74 by Unilu)
Number of downloads
298 (17 by Unilu)

Scopus citations®
 
9
Scopus citations®
without self-citations
9
OpenCitations
 
7
WoS citations
 
9

Bibliography


Similar publications



Contact ORBilu