Paper published in a book (Scientific congresses, symposiums and conference proceedings)
Introducing automated GUI testing and observing its benefits: an industrial case study in the context of law-practice management software
Garousi, Vahid; Yıldırım, Erdem
2017In Proceedings of ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)
Peer reviewed
 

Files


Full Text
ESEM 2017-Automated GUI testing of legal SW-Apr 25.pdf
Author preprint (464.79 kB)
Request a copy

All documents in ORBilu are protected by a user license.

Send to



Details



Keywords :
Software testing; test automation; test patterns; test code engineering; experience report; industrial case study
Abstract :
[en] Motivated by a real-world industrial need in the context of a large IT solutions company based in Turkey, the authors and their colleagues developed and introduced automated test suites for GUI testing of two large-scale law-practice management software (comprising of 414 and 105 KLOC). We report in this paper our experience in developing and introducing a set of large automated test suites (more than 50 KLOC in total), using best practices in state-of-the art and –practice, and to report its observed benefits by conducting cost-benefit analysis in the specific industrial context. The project was conducted based on the principles of case-study and “action research” in which the real industrial needs drove the research. Among the best practices that we used are the followings: (1) the page-object test pattern, (2) modularity in test code, (3) creating test-specific libraries, and (4) using systematic guidelines to decide when and what (test cases) to automate. To assess the cost-benefit and Return On Investment (ROI) of test automation, we followed a hybrid measurement approach to assess both the quantitative and qualitative (intangible) benefits of test automation. The empirical findings showed that the automated GUI testing approach has indeed benefitted the test and QA team in the company under study and automation has been highly welcome by the test engineers. By serving as a success story and experience report in development and introduction of automated test suites in an industrial setting, this paper adds to the body of evidence in this area and it aims at sharing both technical (e.g., using automated test patterns) and process aspects (e.g., test process improvement) of our project with other practitioners and researchers with the hope of encouraging more industry-academia collaborations in test automation.
Research center :
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > Software Verification and Validation Lab (SVV Lab)
Disciplines :
Computer science
Author, co-author :
Garousi, Vahid ;  University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
Yıldırım, Erdem
External co-authors :
yes
Language :
English
Title :
Introducing automated GUI testing and observing its benefits: an industrial case study in the context of law-practice management software
Publication date :
2017
Event name :
ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)
Event place :
Toronto, Canada
Event date :
November 2017
Audience :
International
Main work title :
Proceedings of ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)
Peer reviewed :
Peer reviewed
Available on ORBilu :
since 04 August 2017

Statistics


Number of views
120 (7 by Unilu)
Number of downloads
0 (0 by Unilu)

Scopus citations®
 
14
Scopus citations®
without self-citations
11

Bibliography


Similar publications



Contact ORBilu