Assurance Guidance for Machine Learning in a Safety-Critical System

被引：3
作者：
Feather, Martin S. [1 ]
Slingerland, Philip C. [2 ]
Guerrini, Steven [1 ]
Spolaor, Max [2 ]
机构：
[1] CALTECH, Jet Prop Lab, Pasadena, CA 91125 USA
[2] Aerosp Corp, El Segundo, CA 90245 USA
来源：
2022 IEEE INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2022) | 2022年
基金：
美国国家航空航天局;
关键词：
assurance; guidance; machine learning; safety;
D O I：
10.1109/ISSREW55968.2022.00098
中图分类号：
TP31 [计算机软件];
学科分类号：
081202 ; 0835 ;
摘要：
We are developing guidance for space domain assurance personnel on how to assure Artificial intelligence (AI) and Machine Learning (ML) systems. Key to such guidance will be an assurance process for these personnel, who may be unfamiliar with such systems, to follow. We are investigating one such process, the "Assurance of Machine Learning in Autonomous Systems (AMLAS)" from the University of York, UK. To gauge its suitability, we are (retrospectively) applying it to a safety critical AI/ML system in the space domain. We report here on our experience so far in applying this process.
引用
收藏
页码：394 / 401
页数：8
相关论文
共 50 条
[41]   Security Control of Safety-Critical Systems [J].
Dong, Yi ;
Hong, Yiguang ;
Chen, Jie .
IEEE TRANSACTIONS ON CYBERNETICS, 2025, 55 (05) :2474-2485
[42]   checsdm: A Method for Ensuring Consistency in Heterogeneous Safety-Critical System Design [J].
Paz, Andres ;
El Boussaidi, Ghizlane ;
Mili, Hafedh .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2021, 47 (12) :2713-2739
[43]   Statistical model checking for rare-event in safety-critical system [J].
Du, De-Hui ;
Cheng, Bei ;
Liu, Jing .
Ruan Jian Xue Bao/Journal of Software, 2015, 26 (02) :305-320
[44]   Architecture for safety-critical transportation systems [J].
Ahangari, Hamzeh ;
Ozkok, Yusuf Ibrahim ;
Yildirim, Asil ;
Say, Fatih ;
Atik, Funda ;
Ozturk, Ozcan .
MICROPROCESSORS AND MICROSYSTEMS, 2023, 98
[45]   Rethinking healthcare as a safety-critical industry [J].
Wears, Robert L. .
WORK-A JOURNAL OF PREVENTION ASSESSMENT & REHABILITATION, 2012, 41 :4560-4563
[46]   Safety-critical advanced robots: A survey [J].
Guiochet, Jeremie ;
Machin, Mathilde ;
Waeselynck, Helene .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 94 :43-52
[47]   N-version machine learning models for safety critical systems [J].
Machida, Fumio .
2019 49TH ANNUAL IEEE/IFIP INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS WORKSHOPS (DSN-W), 2019, :48-51
[48]   Establishing Verification and Validation Objectives for Safety-Critical Bayesian Networks [J].
Douthwaite, Mark ;
Kelly, Tim .
2017 IEEE 28TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2017), 2017, :302-309
[49]   Adaptive Safety-Critical Control With Uncertainty Estimation for HumanRobot Collaboration [J].
Zhang, Dianhao ;
Van, Mien ;
Mcllvanna, Stephen ;
Sun, Yuzhu ;
McLoone, Sean .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (04) :5983-5996
[50]   Design and Assurance of Safety-Critical Systems with Artificial Intelligence in FPGAs: The Safety ArtISt Method and a Case Study of an FPGA-Based Autonomous Vehicle Braking Control System [J].
Silva Neto, Antonio V. ;
Silva, Henrique L. ;
Camargo Jr, Joao B. ;
Almeida Jr, Jorge R. ;
Cugnasca, Paulo S. .
ELECTRONICS, 2023, 12 (24)
12345