Paper published in a book (Scientific congresses, symposiums and conference proceedings)
Digital Twins Are Not Monozygotic -- Cross-Replicating ADAS Testing in Two Industry-Grade Automotive Simulators
Borg, Markus; Ben Abdessalem (helali), Raja; Nejati, Shiva et al.
2021In 2021 IEEE 14th International Conference on Software Testing, Validation and Verification (ICST)
Peer reviewed
 

Files


Full Text
ICST21_X_Sim_Repl__IEEE_.pdf
Author postprint (1.22 MB)
Download

All documents in ORBilu are protected by a user license.

Send to



Details



Keywords :
search-based software testing; advanced driver-assistance systems; automotive simulators
Abstract :
[en] The increasing levels of software- and data-intensive driving automation call for an evolution of automotive software testing. As a recommended practice of the Verification and Validation (V&V) process of ISO/PAS 21448, a candidate standard for safety of the intended functionality for road vehicles, simulation-based testing has the potential to reduce both risks and costs. There is a growing body of research on devising test automation techniques using simulators for Advanced Driver-Assistance Systems (ADAS). However, how similar are the results if the same test scenarios are executed in different simulators? We conduct a replication study of applying a Search-Based Software Testing (SBST) solution to a real-world ADAS (PeVi, a pedestrian vision detection system) using two different commercial simulators, namely, TASS/Siemens PreScan and ESI Pro-SiVIC. Based on a minimalistic scene, we compare critical test scenarios generated using our SBST solution in these two simulators. We show that SBST can be used to effectively and efficiently generate critical test scenarios in both simulators, and the test results obtained from the two simulators can reveal several weaknesses of the ADAS under test. However, executing the same test scenarios in the two simulators leads to notable differences in the details of the test outputs, in particular, related to (1) safety violations revealed by tests, and (2) dynamics of cars and pedestrians. Based on our findings, we recommend future V&V plans to include multiple simulators to support robust simulation-based testing and to base test objectives on measures that are less dependant on the internals of the simulators.
Research center :
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > Software Verification and Validation Lab (SVV Lab)
Disciplines :
Computer science
Author, co-author :
Borg, Markus;  RISE Research Institutes of Sweden and Lund University
Ben Abdessalem (helali), Raja ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
Nejati, Shiva ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SVV ; University of Ottawa
François-Xavier, Jegeden;  ESI Group
Shin, Donghwan ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SVV
External co-authors :
yes
Language :
English
Title :
Digital Twins Are Not Monozygotic -- Cross-Replicating ADAS Testing in Two Industry-Grade Automotive Simulators
Publication date :
25 May 2021
Event name :
INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION
Event date :
from 12-04-2021 to 16-04-2021
Audience :
International
Main work title :
2021 IEEE 14th International Conference on Software Testing, Validation and Verification (ICST)
Pages :
383-393
Peer reviewed :
Peer reviewed
Focus Area :
Security, Reliability and Trust
European Projects :
H2020 - 694277 - TUNE - Testing the Untestable: Model Testing of Complex Software-Intensive Systems
Funders :
CE - Commission Européenne [BE]
Available on ORBilu :
since 15 April 2021

Statistics


Number of views
173 (27 by Unilu)
Number of downloads
63 (2 by Unilu)

Scopus citations®
 
14
Scopus citations®
without self-citations
4
WoS citations
 
11

Bibliography


Similar publications



Contact ORBilu