Assurance Guidance for Machine Learning in a Safety-Critical System

被引:2
作者
Feather, Martin S. [1 ]
Slingerland, Philip C. [2 ]
Guerrini, Steven [1 ]
Spolaor, Max [2 ]
机构
[1] CALTECH, Jet Prop Lab, Pasadena, CA 91125 USA
[2] Aerosp Corp, El Segundo, CA 90245 USA
来源
2022 IEEE INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2022) | 2022年
基金
美国国家航空航天局;
关键词
assurance; guidance; machine learning; safety;
D O I
10.1109/ISSREW55968.2022.00098
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We are developing guidance for space domain assurance personnel on how to assure Artificial intelligence (AI) and Machine Learning (ML) systems. Key to such guidance will be an assurance process for these personnel, who may be unfamiliar with such systems, to follow. We are investigating one such process, the "Assurance of Machine Learning in Autonomous Systems (AMLAS)" from the University of York, UK. To gauge its suitability, we are (retrospectively) applying it to a safety critical AI/ML system in the space domain. We report here on our experience so far in applying this process.
引用
收藏
页码:394 / 401
页数:8
相关论文
共 50 条
  • [21] Segmental Stator Switched Reluctance Machine for Safety-Critical Applications
    Szabo, Lorand
    Ruba, Mircea
    IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2012, 48 (06) : 2223 - 2229
  • [22] A Safe, Secure, and Predictable Software Architecture for Deep Learning in Safety-Critical Systems
    Biondi, Alessandro
    Nesti, Federico
    Cicero, Giorgiomaria
    Casini, Daniel
    Buttazzo, Giorgio
    IEEE EMBEDDED SYSTEMS LETTERS, 2020, 12 (03) : 78 - 82
  • [23] A Safety-Critical Decision-Making and Control Framework Combining Machine-Learning-Based and Rule-Based Algorithms
    Aksjonov, Andrei
    Kyrki, Ville
    SAE INTERNATIONAL JOURNAL OF VEHICLE DYNAMICS STABILITY AND NVH, 2023, 7 (03): : 287 - 299
  • [24] SPECIFYING A SAFETY-CRITICAL CONTROL-SYSTEM IN Z
    JACKY, J
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 1995, 21 (02) : 99 - 106
  • [25] On the Necessity of Explicit Artifact Links in Safety Assurance Cases for Machine Learning
    Gauerhof, Lydia
    Gansch, Roman
    Heinzemann, Christian
    Woehrle, Matthias
    Heyl, Andreas
    2021 IEEE INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2021), 2021, : 239 - 244
  • [26] Safety Assurance of Machine Learning for Chassis Control Functions
    Burton, Simon
    Kurzidem, Iwo
    Schwaiger, Adrian
    Schleiss, Philipp
    Unterreiner, Michael
    Graeber, Torben
    Becker, Philipp
    COMPUTER SAFETY, RELIABILITY, AND SECURITY (SAFECOMP 2021), 2021, 12852 : 149 - 162
  • [27] Uncertain Requirements, Assurance and Machine-Learning
    Chechik, Marsha
    2019 27TH IEEE INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE (RE 2019), 2019, : 2 - 3
  • [28] Towards a More Reliable Interpretation of Machine Learning Outputs for Safety-Critical Systems Using Feature Importance Fusion
    Rengasamy, Divish
    Rothwell, Benjamin C.
    Figueredo, Grazziela P.
    APPLIED SCIENCES-BASEL, 2021, 11 (24):
  • [29] A Framework for Software Reuse in Safety-Critical System-of-Systems
    Warren, Bradley
    Michael, James Bret
    Shing, Man-Tak
    2008 IEEE INTERNATIONAL CONFERENCE ON SYSTEM OF SYSTEMS ENGINEERING (SOSE), 2008, : 402 - +
  • [30] A Newly Developed Safety-Critical Computer System for China Metro
    Chen, Xiangxian
    Zhou, Gongshuang
    Yang, Yi
    Huang, Hai
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2013, 14 (02) : 709 - 719