Simulation-Based Testing of Simulink Models With Test Sequence and Test Assessment Blocks

被引:1
作者
Formica, Federico [1 ]
Fan, Tony [1 ]
Rajhans, Akshay [2 ]
Pantelic, Vera [1 ]
Lawford, Mark [1 ]
Menghi, Claudio [1 ,3 ]
机构
[1] McMaster Univ, Hamilton, ON L8S 4L8, Canada
[2] MathWorks, Natick, MA 01760 USA
[3] Univ Bergamo, I-24129 Bergamo, BG, Italy
基金
加拿大自然科学与工程研究理事会;
关键词
Software packages; Sensors; Manuals; Biological system modeling; Industries; Benchmark testing; Pacemakers; Testing; falsification; CPS; TEMPORAL LOGIC; VERIFICATION; SYSTEMS; SPECIFICATION; GENERATION; ROBUSTNESS;
D O I
10.1109/TSE.2023.3343753
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Simulation-based software testing supports engineers in finding faults in Simulink (R) models. It typically relies on search algorithms that iteratively generate test inputs used to exercise models in simulation to detect design errors. While simulation-based software testing techniques are effective in many practical scenarios, they are typically not fully integrated within the Simulink environment and require additional manual effort. Many techniques require engineers to specify requirements using logical languages that are neither intuitive nor fully supported by Simulink, thereby limiting their adoption in industry. This work presents HECATE , a testing approach for Simulink models using Test Sequence and Test Assessment blocks from Simulink (R) Test (TM) . Unlike existing testing techniques, HECATE uses information from Simulink models to guide the search-based exploration. Specifically, HECATE relies on information provided by the Test Sequence and Test Assessment blocks to guide the search procedure. Across a benchmark of 18 Simulink models from different domains and industries, our comparison of HECATE with the state-of-the-art testing tool S-Taliro indicates that HECATE is both more effective (more failure-revealing test cases) and efficient (less iterations and computational time) than S-Taliro for approximate to 94% and approximate to 83% of benchmark models respectively. Furthermore, HECATE successfully generated a failure-revealing test case for a representative case study from the automotive domain demonstrating its practical usefulness.
引用
收藏
页码:239 / 257
页数:19
相关论文
共 114 条
  • [1] Abbas Houssam, 2014, 2014 American Control Conference, P2312, DOI 10.1109/ACC.2014.6859453
  • [2] Abbas H, 2014, IEEE ANN INT CONF CY, P1
  • [3] A Systematic Review of the Application and Empirical Investigation of Search-Based Test Case Generation
    Ali, Shaukat
    Briand, Lionel C.
    Hemmati, Hadi
    Panesar-Walawege, Rajwinder K.
    [J]. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2010, 36 (06) : 742 - 762
  • [4] Annapureddy Y, 2011, LECT NOTES COMPUT SC, V6605, P254, DOI 10.1007/978-3-642-19835-9_21
  • [5] [Anonymous], 2022, Simulate a Simulink model
  • [6] [Anonymous], 2022, Assess a model by using when decomposition
  • [7] [Anonymous], 2022, Test sequence and assessment syntax
  • [8] [Anonymous], 2022, GitHub
  • [9] [Anonymous], 2022, Test traffic light control by using logical and temporal assessments
  • [10] [Anonymous], 2022, Use test sequence scenarios in the test sequence editor and test manager