RESTest: Automated Black-Box Testing of RESTful Web APIs

被引:34
|
作者
Martin-Lopez, Alberto [1 ]
Segura, Sergio [1 ]
Ruiz-Cortes, Antonio [1 ]
机构
[1] Univ Seville, I3US Inst, SCORE Lab, Seville, Spain
来源
ISSTA '21: PROCEEDINGS OF THE 30TH ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON SOFTWARE TESTING AND ANALYSIS | 2021年
关键词
REST; black-box testing; web APIs;
D O I
10.1145/3460319.3469082
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Testing RESTful APIs thoroughly is critical due to their key role in software integration. Existing tools for the automated generation of test cases in this domain have shown great promise, but their applicability is limited as they mostly rely on random inputs, i.e., fuzzing. In this paper, we present RESTest, an open source blackbox testing framework for RESTful web APIs. Based on the API specification, RESTest supports the generation of test cases using different testing techniques such as fuzzing and constraint-based testing, among others. RESTest is developed as a framework and can be easily extended with new test case generators and test writers for different programming languages. We evaluate the tool in two scenarios: offline and online testing. In the former, we show how RESTest can efficiently generate realistic test cases (test inputs and test oracles) that uncover bugs in real-world APIs. In the latter, we show RESTest's capabilities as a continuous testing and monitoring framework. Demo video: https://youtu.be/1f_tjdkaCKo.
引用
收藏
页码:682 / 685
页数:4
相关论文
共 50 条
  • [21] Evolving a Test Oracle in Black-Box Testing
    Wang, Farn
    Wu, Jung-Hsuan
    Huang, Chung-Hao
    Chang, Kai-Hsiang
    FUNDAMENTAL APPROACHES TO SOFTWARE ENGINEERING, 2011, 6603 : 310 - 325
  • [22] AutoBlackTest: A Tool for Automatic Black-Box Testing
    Mariani, Leonardo
    Pezze, Mauro
    Riganelli, Oliviero
    Santoro, Mauro
    2011 33RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2011, : 1013 - 1015
  • [23] Effective black-box testing with genetic algorithms
    Last, Mark
    Eyal, Shay
    Kandel, Abraham
    HARDWARE AND SOFTWARE VERIFICATION AND TESTING, 2006, 3875 : 134 - 148
  • [24] A Framework for Semantic Description of RESTful Web APIs
    Salvadori, Ivan
    Siqueira, Frank
    2014 IEEE 21ST INTERNATIONAL CONFERENCE ON WEB SERVICES (ICWS 2014), 2014, : 630 - 637
  • [25] Black-box testing based on colorful taint analysis
    CHEN Kai1
    2State Key Laboratory of Information Security
    3National Engineering Research Center of Information Security
    Science China(Information Sciences), 2012, 55 (01) : 171 - 183
  • [26] Using MC/DC as a Black-Box Testing Technique
    Vilkomir, Sergiy
    Baptista, John
    Das, Gourav
    2017 IEEE 28TH ANNUAL SOFTWARE TECHNOLOGY CONFERENCE (STC), 2017,
  • [27] Black-box testing based on colorful taint analysis
    Kai Chen
    DengGuo Feng
    PuRui Su
    YingJun Zhang
    Science China Information Sciences, 2012, 55 : 171 - 183
  • [28] Black-box testing based on colorful taint analysis
    Chen Kai
    Feng DengGuo
    Su PuRui
    Zhang YingJun
    SCIENCE CHINA-INFORMATION SCIENCES, 2012, 55 (01) : 171 - 183
  • [29] Test Coverage Criteria for RESTful Web APIs
    Martin-Lopez, Alberto
    Segura, Sergio
    Ruiz-Cortes, Antonio
    PROCEEDINGS OF THE 10TH ACM SIGSOFT INTERNATIONAL WORKSHOP ON AUTOMATING TEST CASE DESIGN, SELECTION, AND EVALUATION (A-TEST '19), 2019, : 15 - 21
  • [30] CovDroid: A Black-Box Testing Coverage System for Android
    Yeh, Chao-Chun
    Huang, Shih-Kun
    IEEE 39TH ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE WORKSHOPS (COMPSAC 2015), VOL 3, 2015, : 447 - 452