Status Report on Software Testing: Test-Comp 2021

被引：13
作者：
Beyer, Dirk [1 ]
机构：
[1] Ludwig Maximilians Univ Munchen, Munich, Germany
来源：
FUNDAMENTAL APPROACHES TO SOFTWARE ENGINEERING (FASE 2021) | 2021年 / 12649卷
关键词：
Software Testing; Test-Case Generation; Competition; Program Analysis; Software Validation; Software Bugs; Test Validation; Test-Comp; Benchmarking; Test Coverage; Bug Finding; Test-Suites; BENCHEXEC; TESTCOV; COMPETITION;
D O I：
10.1007/978-3-030-71500-7_17
中图分类号：
TP31 [计算机软件];
学科分类号：
081202 ; 0835 ;
摘要：
This report describes Test-Comp 2021, the 3rd edition of the Competition on Software Testing. The competition is a series of annual comparative evaluations of fully automatic software test generators for C programs. The competition has a strong focus on reproducibility of its results and its main goal is to provide an overview of the current state of the art in the area of automatic test-generation. The competition was based on 3 173 test-generation tasks for C programs. Each test-generation task consisted of a program and a test specification (error coverage, branch coverage). Test-Comp 2021 had 11 participating test generators from 6 countries.
引用
收藏
页码：341 / 357
页数：17
相关论文
共 43 条
[1]   FuSeBMC: A White-Box Fuzzer for Finding Security Vulnerabilities in C Programs (Competition Contribution) [J].
Alshmrany, Kaled M. ;
Menezes, Rafael S. ;
Gadelha, Mikhail R. ;
Cordeiro, Lucas C. .
FUNDAMENTAL APPROACHES TO SOFTWARE ENGINEERING (FASE 2021), 2021, 12649 :363-367
[2]  
[Anonymous], 2016, JSAT
[3]   TOOLympics 2019: An Overview of Competitions in Formal Methods [J].
Bartocci, Ezio ;
Beyer, Dirk ;
Black, Paul E. ;
Fedyukovich, Grigory ;
Garavel, Hubert ;
Hartmanns, Arnd ;
Huisman, Marieke ;
Kordon, Fabrice ;
Nagele, Julian ;
Sighireanu, Mihaela ;
Steffen, Bernhard ;
Suda, Martin ;
Sutcliffe, Geoff ;
Weber, Tjark ;
Yamada, Akihisa .
TOOLS AND ALGORITHMS FOR THE CONSTRUCTION AND ANALYSIS OF SYSTEMS, PT III, 2019, 11429 :3-24
[4]   Generating tests from counterexamples [J].
Beyer, D ;
Chlipala, AJ ;
Henzinger, TA ;
Jhala, R ;
Majumdar, R .
ICSE 2004: 26TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, PROCEEDINGS, 2004, :326-335
[5]  
Beyer Dirk, 2013, Tools and Algorithms for the Construction and Analysis of Systems. 19th International Conference, TACAS 2013 Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2013. Proceedings, P594, DOI 10.1007/978-3-642-36742-7_43
[6]  
Beyer D., 2019, LNCS, V11429, P167, DOI [10.1007/978-3-030-17502-311, DOI 10.1007/978-3-030-17502-311]
[7]  
Beyer D., 2021, RESULTS 3 INT COMPET, DOI [10.5281/zenodo.4459470, DOI 10.5281/ZENODO.4459470]
[8]  
Beyer D., 2021, CoVeriTeam: On-demand composition of cooperative verification systems
[9]  
Beyer D., 2021, SV BENCHMARKS BENCHM, DOI [10.5281/zenodo.4459132, DOI 10.5281/ZENODO.4459132]
[10]  
Beyer D., 2021, Proc. TACAS (2), V12652
12345