Reference : Choosing the Right Test Automation Tool: a Grey Literature Review of Practitioner Sources
Scientific congresses, symposiums and conference proceedings : Paper published in a book
Engineering, computing & technology : Computer science
Computational Sciences
http://hdl.handle.net/10993/31352
Choosing the Right Test Automation Tool: a Grey Literature Review of Practitioner Sources
English
Raulamo-Jurvanen, Päivi mailto []
Mäntylä, Mika mailto []
Garousi, Vahid mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >]
15-Jun-2017
Proceedings of International Conference on Evaluation and Assessment in Software Engineering (EASE 2017)
ACM
21-30
Yes
No
International
International Conference on Evaluation and Assessment in Software Engineering (EASE 2017)
15-06-2017 to 16-06-2017
Karlskrona
Sweden
[en] Software testing tools ; Empirical software validation
[en] Background: Choosing the right software test automation tool is not trivial, and recent industrial surveys indicate lack of right tools as the main obstacle to test automation. Aim: In this paper, we study how practitioners tackle the problem of choosing the right test automation tool. Method: We synthesize the “voice” of the practitioners with a grey literature review originating from 53 different companies. The industry experts behind the sources had roles such as “Software Test Automation Architect”, and “Principal Software Engineer”. Results: Common consensus about the important criteria exists but those are not applied systematically. We summarize the scattered steps from individual sources by presenting a comprehensive process for tool evaluation with 12 steps and a total of 14 different criteria for choosing the right tool. Conclusions: The practitioners tend to have general interest in and be influenced by related grey literature as about 78% of our sources had at least 20 backlinks (a reference comparable to a citation) while the variation was between 3 and 759 backlinks. There is a plethora of different software testing tools available, yet the practitioners seem to prefer and adopt the widely known and used tools. The study helps to identify the potential pitfalls of existing processes and opportunities for comprehensive tool evaluation.
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > Software Verification and Validation Lab (SVV Lab)
Fonds National de la Recherche, Luxembourg (FNR/P10/03)
National Research Fund, Luxembourg FNR/P10/03
Researchers ; Professionals
http://hdl.handle.net/10993/31352
10.1145/3084226.3084252
FnR ; FNR3949772 > Lionel Briand > VVLAB > Validation And Verification Laboratory > 01/01/2012 > 31/07/2018 > 2010

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Limited access
ChoosingTheRightTestAutomationTool-a GLR-preprint.pdfAuthor preprint729.78 kBRequest a copy

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.