SPECMATE: Automated Creation of Test Cases from Acceptance Criteria

被引：22

作者：

Fischbach, Jannik ^{[1
]}

Vogelsang, Andreas ^{[2
]}

Spies, Dominik ^{[1
]}

Wehrle, Andreas ^{[1
]}

Junker, Maximilian ^{[1
]}

Freudenstein, Dietmar ^{[3
]}

机构：

[1] Qualicen GmbH, Munich, Germany

[2] Tech Univ Berlin, Berlin, Germany

[3] Allianz Deutschland AG, Munich, Germany

来源：

2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VALIDATION AND VERIFICATION (ICST 2020) | 2020年

关键词：

test case creation; natural language processing; model-based testing; user stories; agile software development; SUPPORT;

D O I：

10.1109/ICST46399.2020.00040

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

In the agile domain, test cases are derived from acceptance criteria to verify the expected system behavior. How-ever, the design of test cases is laborious and has to be done manually due to missing tool support. Existing approaches for automatically deriving tests require semi-formal or even formal notations of acceptance criteria, though informal descriptions are mostly employed in practice. In this paper, we make three contributions: (1) a case study of 961 user stories providing an insight into how user stories are formulated and used in practice, (2) an approach for the automatic extraction of test cases from informal acceptance criteria and (3) a study demonstrating the feasibility of our approach in cooperation with our industry partner. In our study, out of 604 manually created test cases, 56 % can be generated automatically and missing negative test cases are added.

引用

页码：321 / 331

页数：11

共 46 条

[31]

Myers G.J., 2011, The Art of Software Testing

[32] MaltParser: A language-independent system for data-driven dependency parsing [J].

Nivre, Joakim ;

Hall, Johan ;

Nilsson, Jens ;

Chanev, Atanas ;

Eryigit, Güls¸en ;

Kübler, Sandra ;

Marinov, Svetoslav ;

Marsi, Erwin .

Natural Language Engineering, 2007, 13 (02) :95-135

[33]

North J, 2006, TLS-TIMES LIT SUPPL, P4

[34]

Nursimulu K., 1995, P 1995 C CTR ADV STU

[35]

Rane P., 2017, THESIS

[36] Coverage based test-case generation using model checkers [J].

Rayadurgam, S ;

Heimdahl, MPE .

EIGHTH ANNUAL IEEE INTERNATIONAL CONFERENCE AND WORKSHOP ON THE ENGINEERING OF COMPUTER BASED SYSTEMS, PROCEEDINGS, 2001, :83-91

[37]

Rose Seb., 2015, The cucumber for Java book: Behaviour-driven development for testers and developers

[38] Guidelines for conducting and reporting case study research in software engineering [J].

Runeson, Per ;

Hoest, Martin .

EMPIRICAL SOFTWARE ENGINEERING, 2009, 14 (02) :131-164

[39]

Sarmiento E, 2014, 2014 IEEE 1ST INTERNATIONAL WORKSHOP ON REQUIREMENTS ENGINEERING AND TESTING (RET), P32, DOI 10.1109/RET.2014.6908677

[40]

Sharma R, 2014, PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON EVALUATION OF NOVEL APPROACHES TO SOFTWARE ENGINEERING (ENASE 2014), P241

← 1 2 3 4 5 →