Effective Test Suites for Mixed Discrete-Continuous Stateflow Controllers

Matinnejad, Reza; Nejati, Shiva; Briand, Lionel; Bruckmann, Thomas

Reference : Effective Test Suites for Mixed Discrete-Continuous Stateflow Controllers


	Document type :	Scientific congresses, symposiums and conference proceedings : Paper published in a book
	Discipline(s) :	Engineering, computing & technology : Computer science
	To cite this reference:	http://hdl.handle.net/10993/21475

Title :	Effective Test Suites for Mixed Discrete-Continuous Stateflow Controllers
Language :	English
Author, co-author :	Matinnejad, Reza [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >]
	Nejati, Shiva [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >]
	Briand, Lionel [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > > ; University of Luxembourg > Faculty of Science, Technology and Communication (FSTC) > Computer Science and Communications Research Unit (CSC)]
	Bruckmann, Thomas [Delphi Automotive Systems, Luxembourg]
Publication date :	2015
Main document title :	Proceedings of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering
Peer reviewed :	Yes
Audience :	International
Event name :	10th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE 2015)
Event date :	30-08-2015 to 04-09-2015
Keywords :	[en] Stateflow testing ; mixed discrete-continuous behaviors ; structural coverage ; failure-based testing ; output diversity
Abstract :	[en] Modeling mixed discrete-continuous controllers using Stateflow is common practice and has a long tradition in the embedded software system industry. Testing Stateflow models is complicated by expensive and manual test oracles that are not amenable to full automation due to the complex continuous behaviors of such models. In this paper, we reduce the cost of manual test oracles by providing test case selection algorithms that help engineers develop small test suites with high fault revealing power for Stateflow models. We present six test selection algorithms for discrete-continuous Stateflows: An adaptive random test selection algorithm that diversifies test inputs, two white-box coverage-based algorithms, a black-box algorithm that diversifies test outputs, and two search-based black-box algorithms that aim to maximize the likelihood of presence of continuous output failure patterns. We evaluate and compare our test selection algorithms, and find that our three output-based algorithms consistently outperform the coverage- and input-based algorithms in revealing faults in discrete-continuous Stateflow models. Further, we show that our output-based algorithms are complementary as the two search-based algorithms perform best in revealing specific failures with small test suites, while the output diversity algorithm is able to identify different failure types better than other algorithms when test suites are above a certain size.
Research centres :	Interdisciplinary Centre for Security, Reliability and Trust (SnT) > Software Verification and Validation Lab (SVV Lab)
Permalink :	http://hdl.handle.net/10993/21475

File(s) associated to this reference

Fulltext file(s):

	File	Commentary	Version	Size	Access
Open access	paper.pdf		Publisher postprint	1.19 MB	View/Open

All documents in ORBi^lu are protected by a user license.

University of Luxembourg Library | Feedback | Legal notices