Evaluating the Effect of Test Case Length on GUI Test Suite Performance

被引：3

作者：

Carino, Santo ^{[1
]}

Andrews, James H. ^{[1
,2
]}

机构：

[1] Univ Western Ontario, Dept Comp Sci, London, ON, Canada

[2] Google Inc, Mountain View, CA USA

来源：

10TH INTERNATIONAL WORKSHOP ON AUTOMATION OF SOFTWARE TEST AST 2015 | 2015年

关键词：

D O I：

10.1109/AST.2015.10

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

In this paper we investigate the effect of test case length on the performance of test suites for automated graphical user interface (GUI) testing. Research has been done on the effect of test length for traditional white-box testing; however, these findings do not necessarily extend to GUI testing. We run experiments on five subject applications using a custom-built dynamic test generator. We measure the effect that test length has on statement, branch, and event-pair coverage, as well as the fault-finding abilities for each test suite. Our findings indicate that longer test suites perform better than shorter test suites in terms of coverage, fault-finding, and cost. However, the effect eventually diminishes with greater increase in length. As well, the results vary depending on the application under test.

引用

页码：13 / 17

页数：5

共 17 条

[1]

Andrews James H., 2008, 2008 23rd IEEE/ACM International Conference on Automated Software Engineering, P19, DOI 10.1109/ASE.2008.12

[2]

Arcuri Andrea, 2010, Proceedings of the Third IEEE International Conference on Software Testing, Verification and Validation (ICST 2010), P469, DOI 10.1109/ICST.2010.16

[3]

Bertolini Cristiano, 2010, Proceedings of the Third IEEE International Conference on Software Testing, Verification and Validation (ICST 2010), P235, DOI 10.1109/ICST.2010.41

[4]

Borjesson E., 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation (ICST 2012), P350, DOI 10.1109/ICST.2012.115

[5]

Brooks P.A., 2007, P IEEEACM INT C AUTO, P333

[6] Introducing a Test Suite Similarity Metric for Event Sequence-based Test Cases [J].

Brooks, Penelope A. ;

Memon, Atif M. .

2009 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE, CONFERENCE PROCEEDINGS, 2009, :243-252

[7] Developing a Single Model and Test Prioritization Strategies for Event-Driven Software [J].

Bryce, Renee C. ;

Sampath, Sreedevi ;

Memon, Atif M. .

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2011, 37 (01) :48-64

[8]

Chang TH, 2010, CHI2010: PROCEEDINGS OF THE 28TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1-4, P1535

[9]

FRASER G, 2009, AUT SOFTW TEST 2009, P18

[10]

Hu C., 2011, P 6 INT WORKSHOP AUT, P77

← 1 2 →