First international competition on software testing

被引:1
作者
Dirk Beyer
机构
[1] LMU Munich,
来源
International Journal on Software Tools for Technology Transfer | 2021年 / 23卷
关键词
Software testing; Test generation; Fuzzing; Program analysis; Bounded model checking; Test-suite validation; Competition; Test-Comp;
D O I
暂无
中图分类号
学科分类号
摘要
Tool competitions are a special form of comparative evaluation, where each tool has a team of developers or supporters associated that makes sure the tool is properly configured to show its best possible performance. In several research areas, tool competitions have been a driving force for the development of mature tools that represent the state of the art in their field. This paper describes and reports the results of the 1st\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^{\text {st}}$$\end{document} International Competition on Software Testing (Test-Comp 2019), a comparative evaluation of automatic tools for software test generation. Test-Comp 2019 was presented as part of TOOLympics 2019, a satellite event of the conference TACAS. Nine test generators were evaluated on 2 356 test-generation tasks. There were two test specifications, one for generating a test that covers a particular function call and one for generating a test suite that tries to cover the branches of the program.
引用
收藏
页码:833 / 846
页数:13
相关论文
共 39 条
[1]  
Beyer D(2020)Results of the 1st international competition on software testing (test-comp 2019) Zenodo 21 1-29
[2]  
Beyer D(2020)Test suites from test-comp 2019 test-generation tools Zenodo 19 97-114
[3]  
Beyer D(2019)Reliable benchmarking: requirements and solutions Int. J. Softw. Tools Technol. Transfer 30 3-16
[4]  
Löwe S(2020)Klee symbolic execution engine in 2019 (competition contribution) Int. J. Softw. Tools Technol. Transf. 17 647-657
[5]  
Wendler P(2020)Symbiotic 6: generating test-cases by slicing and symbolic execution (competition contribution) Int. J. Softw. Tools Technol. Transf. 19 385-394
[6]  
Cadar C(2020)Esbmc 6.1: automated test-case generation using bounded model checking (competition contribution) Int. J. Softw. Tools Technol. Transf. 14 76-81
[7]  
Nowack M(2017)Handling loops in bounded model checking of C programs via k-induction Int. J. Softw. Tools Technol. Transf. undefined undefined-undefined
[8]  
Chalupa M(2004)Testability transformation IEEE Trans. Software Eng. undefined undefined-undefined
[9]  
Vitovska M(2015)VerifyThis 2012: a program verification competition STTT undefined undefined-undefined
[10]  
Jašek T(2020)CoVeriTest: interleaving value and predicate analysis for test-case generation (competition contribution) Int. J. Softw. Tools Technol. Transf. undefined undefined-undefined