Black-Box Test Generation from Inferred Models

被引:14
|
作者
Papadopoulos, Petros [1 ]
Walkinshaw, Neil [1 ]
机构
[1] Univ Leicester, Dept Comp Sci, Leicester LE1 7RH, Leics, England
来源
2015 IEEE/ACM FOURTH INTERNATIONAL WORKSHOP ON REALIZING ARTIFICIAL INTELLIGENCE SYNERGIES IN SOFTWARE ENGINEERING (RAISE 2015) | 2015年
关键词
D O I
10.1109/RAISE.2015.11
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatically generating test inputs for components without source code (are 'black-box') and specification is challenging. One particularly interesting solution to this problem is to use Machine Learning algorithms to infer testable models from program executions in an iterative cycle. Although the idea has been around for over 30 years, there is little empirical information to inform the choice of suitable learning algorithms, or to show how good the resulting test sets are. This paper presents an openly available framework to facilitate experimentation in this area, and provides a proof-of-concept inference-driven testing framework, along with evidence of the efficacy of its test sets on three programs.
引用
收藏
页码:19 / 24
页数:6
相关论文
共 50 条
  • [31] Adversarial Eigen Attack on Black-Box Models
    Zhou, Linjun
    Cui, Peng
    Zhang, Xingxuan
    Jiang, Yinan
    Yang, Shiqiang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 15233 - 15241
  • [32] Explaining Black-box Classification Models with Arguments
    Amgoud, Leila
    2021 IEEE 33RD INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2021), 2021, : 791 - 795
  • [33] Learning Groupwise Explanations for Black-Box Models
    Gao, Jingyue
    Wang, Xiting
    Wang, Yasha
    Yan, Yulan
    Xie, Xing
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 2396 - 2402
  • [34] BLACK-BOX MODELS FOR LINEAR INTEGRATED CIRCUITS
    MURRAYLA.MA
    IEEE TRANSACTIONS ON EDUCATION, 1969, E 12 (03) : 170 - &
  • [35] Regularizing Black-box Models for Improved Interpretability
    Plumb, Gregory
    Al-Shedivat, Maruan
    Cabrera, Angel Alexander
    Perer, Adam
    Xing, Eric
    Talwalkar, Ameet
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [36] Testing Framework for Black-box AI Models
    Aggarwal, Aniya
    Shaikh, Samiulla
    Hans, Sandeep
    Haldar, Swastik
    Ananthanarayanan, Rema
    Saha, Diptikalyan
    2021 IEEE/ACM 43RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: COMPANION PROCEEDINGS (ICSE-COMPANION 2021), 2021, : 81 - 84
  • [37] THE BLACK-BOX
    WISEMAN, J
    ECONOMIC JOURNAL, 1991, 101 (404) : 149 - 155
  • [38] THE BLACK-BOX
    KYLE, SA
    NEW SCIENTIST, 1986, 110 (1512) : 61 - 61
  • [39] Black-box models for reference voltage monitoring
    Serbec, IN
    Fefer, D
    PROCEEDINGS OF THE IASTED INTERNATIONAL CONFERENCE ON APPLIED SIMULATION AND MODELLING, 2004, : 533 - 539
  • [40] Auditing black-box models for indirect influence
    Philip Adler
    Casey Falk
    Sorelle A. Friedler
    Tionney Nix
    Gabriel Rybeck
    Carlos Scheidegger
    Brandon Smith
    Suresh Venkatasubramanian
    Knowledge and Information Systems, 2018, 54 : 95 - 122