SPECMATE: Automated Creation of Test Cases from Acceptance Criteria

被引:22
作者
Fischbach, Jannik [1 ]
Vogelsang, Andreas [2 ]
Spies, Dominik [1 ]
Wehrle, Andreas [1 ]
Junker, Maximilian [1 ]
Freudenstein, Dietmar [3 ]
机构
[1] Qualicen GmbH, Munich, Germany
[2] Tech Univ Berlin, Berlin, Germany
[3] Allianz Deutschland AG, Munich, Germany
来源
2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VALIDATION AND VERIFICATION (ICST 2020) | 2020年
关键词
test case creation; natural language processing; model-based testing; user stories; agile software development; SUPPORT;
D O I
10.1109/ICST46399.2020.00040
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In the agile domain, test cases are derived from acceptance criteria to verify the expected system behavior. How-ever, the design of test cases is laborious and has to be done manually due to missing tool support. Existing approaches for automatically deriving tests require semi-formal or even formal notations of acceptance criteria, though informal descriptions are mostly employed in practice. In this paper, we make three contributions: (1) a case study of 961 user stories providing an insight into how user stories are formulated and used in practice, (2) an approach for the automatic extraction of test cases from informal acceptance criteria and (3) a study demonstrating the feasibility of our approach in cooperation with our industry partner. In our study, out of 604 manually created test cases, 56 % can be generated automatically and missing negative test cases are added.
引用
收藏
页码:321 / 331
页数:11
相关论文
共 46 条
[1]  
[Anonymous], 2012, ACM WWW, DOI [DOI 10.1145/2187836.2187958, 10.1145/2187836.2187958]
[2]  
Attardi Giuseppe., 2006, P 10 C COMPUTATIONAL, P166
[3]  
Barros F.A., 2011, SEKE 2011 P 23 INT C, P250
[4]   Recognizing Textual Entailment by Soft Dependency Tree Matching [J].
Basak, Rohini ;
Naskar, Sudip Kumar ;
Pakray, Partha ;
Gelbukh, Alexander .
COMPUTACION Y SISTEMAS, 2015, 19 (04) :685-700
[5]   Agile requirements engineering practices: An emprical study [J].
Cao, Lan ;
Ramesh, Balasubramaniam .
IEEE SOFTWARE, 2008, 25 (01) :60-67
[6]  
Carvalho GA, 2014, TEMA, P15
[7]   A New Method for the Analysis of Bacterial Endotoxins in Ultrapure Paraffin Oil [J].
Chen, Dandan .
JOURNAL OF ANALYTICAL METHODS IN CHEMISTRY, 2014, 2014
[8]  
Choi JD, 2015, PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1, P387
[9]  
Cohn Mike, 2004, User stories applied: For agile software development
[10]  
Covington M. A., 2001, P 39 ANN ACM SE C