Assurance Guidance for Machine Learning in a Safety-Critical System

被引:2
作者
Feather, Martin S. [1 ]
Slingerland, Philip C. [2 ]
Guerrini, Steven [1 ]
Spolaor, Max [2 ]
机构
[1] CALTECH, Jet Prop Lab, Pasadena, CA 91125 USA
[2] Aerosp Corp, El Segundo, CA 90245 USA
来源
2022 IEEE INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2022) | 2022年
基金
美国国家航空航天局;
关键词
assurance; guidance; machine learning; safety;
D O I
10.1109/ISSREW55968.2022.00098
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We are developing guidance for space domain assurance personnel on how to assure Artificial intelligence (AI) and Machine Learning (ML) systems. Key to such guidance will be an assurance process for these personnel, who may be unfamiliar with such systems, to follow. We are investigating one such process, the "Assurance of Machine Learning in Autonomous Systems (AMLAS)" from the University of York, UK. To gauge its suitability, we are (retrospectively) applying it to a safety critical AI/ML system in the space domain. We report here on our experience so far in applying this process.
引用
收藏
页码:394 / 401
页数:8
相关论文
共 50 条
[31]   A Newly Developed Safety-Critical Computer System for China Metro [J].
Chen, Xiangxian ;
Zhou, Gongshuang ;
Yang, Yi ;
Huang, Hai .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2013, 14 (02) :709-719
[32]   A Multi-layered Collaborative Framework for Evidence-driven Data Requirements Engineering for Machine Learning-based Safety-critical Systems [J].
Dey, Sangeeta ;
Lee, Seok-Won .
38TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2023, 2023, :1404-1413
[33]   A comparison of accident analysis techniques for safety-critical man-machine systems [J].
Kontogiannis, T ;
Leopoulos, V ;
Marmaras, N .
INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS, 2000, 25 (04) :327-347
[34]   Learning from Machine Learning in Accounting and Assurance [J].
Cho, Soohyun ;
Vasarhelyi, Miklos A. ;
Sun, Ting ;
Zhang, Chanyuan .
JOURNAL OF EMERGING TECHNOLOGIES IN ACCOUNTING, 2020, 17 (01) :1-10
[35]   Recent Advances towards the Industrial Application of Model-Driven Engineering for Assurance of Safety-Critical Systems [J].
Luis de la Vara, Jose ;
Ruiz, Alejandra ;
Espinoza, Huascar .
PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON MODEL-DRIVEN ENGINEERING AND SOFTWARE DEVELOPMENT, 2018, :632-641
[36]   Safety-Critical Control With Limited Information [J].
Clouatre, Maison ;
Thitsa, Makhin ;
Kinney, Wesley ;
Conti, Andrea ;
Win, Moe Z. .
IEEE CONTROL SYSTEMS LETTERS, 2024, 8 :2379-2384
[37]   Statistical model checking for rare-event in safety-critical system [J].
Du, De-Hui ;
Cheng, Bei ;
Liu, Jing .
Ruan Jian Xue Bao/Journal of Software, 2015, 26 (02) :305-320
[38]   Can safety-critical software be flexible? [J].
Fraser, SW .
PROCEEDINGS OF THE 2003 IEEE INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION, 2003, :588-593
[39]   Security Control of Safety-Critical Systems [J].
Dong, Yi ;
Hong, Yiguang ;
Chen, Jie .
IEEE TRANSACTIONS ON CYBERNETICS, 2025, 55 (05) :2474-2485
[40]   checsdm: A Method for Ensuring Consistency in Heterogeneous Safety-Critical System Design [J].
Paz, Andres ;
El Boussaidi, Ghizlane ;
Mili, Hafedh .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2021, 47 (12) :2713-2739