Reference : Automated Unit Test Generation during Software Development: A Controlled Experiment a...
Scientific congresses, symposiums and conference proceedings : Paper published in a book
Engineering, computing & technology : Computer science
http://hdl.handle.net/10993/21407
Automated Unit Test Generation during Software Development: A Controlled Experiment and Think-Aloud Observations
English
Rojas, José Miguel [University of Sheffield > Department of Computer Science]
Fraser, Gordon [University of Sheffield]
Arcuri, Andrea mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >]
2015
ACM International Symposium on Software Testing and Analysis (ISSTA), 2015
ACM
Yes
International
ACM International Symposium on Software Testing and Analysis (ISSTA), 2015
July 12-17, 2015
[en] Unit testing ; automated test generation
[en] Automated unit test generation tools can produce tests that are
superior to manually written ones in terms of code coverage, but
are these tests helpful to developers while they are writing code? A
developer would first need to know when and how to apply such a
tool, and would then need to understand the resulting tests in order
to provide test oracles and to diagnose and fix any faults that the
tests reveal. Considering all this, does automatically generating unit
tests provide any benefit over simply writing unit tests manually?
We empirically investigated the effects of using an automated unit
test generation tool (EVOSUITE) during development. A controlled
experiment with 41 students shows that using EVOSUITE leads to
an average branch coverage increase of +13%, and 36% less time is
spent on testing compared to writing unit tests manually. However,
there is no clear effect on the quality of the implementations, as
it depends on how the test generation tool and the generated tests
are used. In-depth analysis, using five think-aloud observations
with professional programmers, confirms the necessity to increase
the usability of automated unit test generation tools, to integrate
them better during software development, and to educate software
developers on how to best use those tools.
Interdisciplinary Centre for Security, Reliability and Trust
Fonds National de la Recherche - FnR
Researchers ; Professionals ; Students
http://hdl.handle.net/10993/21407

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Limited access
paper_issta15.pdfPublisher postprint330.84 kBRequest a copy

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.