Verifying and Validating Autonomous Systems: Towards an Integrated Approach

被引:18
|
作者
Ferrando, Angelo [1 ]
Dennis, Louise A. [2 ]
Ancona, Davide [1 ]
Fisher, Michael [2 ]
Mascardi, Viviana [1 ]
机构
[1] Univ Genoa, Genoa, Italy
[2] Univ Liverpool, Liverpool, Merseyside, England
来源
RUNTIME VERIFICATION (RV 2018) | 2018年 / 11237卷
基金
英国工程与自然科学研究理事会;
关键词
Runtime verification; Model checking Autonomous systems; Trace expressions; MCAPL; RUNTIME VERIFICATION; MODEL;
D O I
10.1007/978-3-030-03769-7_15
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
When applying formal verification to a system that interacts with the real world we must use a model of the environment. This model represents an abstraction of the actual environment, but is necessarily incomplete and hence presents an issue for system verification. If the actual environment matches the model, then the verification is correct; however, if the environment falls outside the abstraction captured by the model, then we cannot guarantee that the system is well-behaved. A solution to this problem consists in exploiting the model of the environment for statically verifying the system's behaviour and, if the verification succeeds, using it also for validating the model against the real environment via runtime verification. The paper discusses this approach and demonstrates its feasibility by presenting its implementation on top of a framework integrating the Agent Java PathFinder model checker. Trace expressions are used to model the environment for both static formal verification and runtime verification.
引用
收藏
页码:263 / 281
页数:19
相关论文
共 50 条
  • [1] Validating and Verifying AI Systems
    Hand, David J.
    Khan, Shakeel
    PATTERNS, 2020, 1 (03):
  • [2] Verifying Autonomous Systems
    Dennis, Louise A.
    INTEGRATED FORMAL METHODS, IFM 2022, 2022, 13274 : 3 - 17
  • [3] Verifying Autonomous Systems
    Fisher, Michael
    Dennis, Louise
    Webster, Matt
    COMMUNICATIONS OF THE ACM, 2013, 56 (09) : 84 - 93
  • [4] Towards Hybrid Reasoning for Verifying and Validating Multilevel Models
    Jekjantuk, Nophadol
    Groener, Gerd
    Pan, Jeff Z.
    Thomas, Edward
    KNOWLEDGE ENGINEERING AND MANAGEMENT BY THE MASSES, EKAW 2010, 2010, 6317 : 411 - 420
  • [5] An Integrated Approach to Moral Autonomous Systems
    Svegliato, Justin
    Nashed, Samer
    Zilberstein, Shlomo
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 2941 - 2942
  • [6] An Approach For Verifying And Validating Clustering Based Anomaly Detection Systems Using Metamorphic Testing
    Rehman, Faqeer Ur
    Izurieta, Clemente
    2022 FOURTH IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE TESTING (AITEST 2022), 2022, : 12 - 18
  • [7] Towards Autonomous Creative Systems: A Computational Approach
    Rob Saunders
    Cognitive Computation, 2012, 4 : 216 - 225
  • [8] Towards Autonomous Creative Systems: A Computational Approach
    Saunders, Rob
    COGNITIVE COMPUTATION, 2012, 4 (03) : 216 - 225
  • [9] Verifying and validating specification of knowledge-based systems
    Torres, L
    Frydman, C
    ECAI 1998: 13TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 1998, : 83 - 87
  • [10] Towards an integrated approach to systems design
    Ammar, HH
    Yacoub, SM
    Mili, A
    Gopalakrishnan, B
    INTELLIGENT SYSTEMS IN DESIGN AND MANUFACTURING II, 1999, 3833 : 69 - 76