Machine learning model cards toward model-based system engineering analysis of resource-limited systems

被引:0
作者
Booth, Thomas M. [1 ]
Ghosh, Sudipto [2 ]
机构
[1] USAF 309th SWEG, Hill AFB, UT 84056 USA
[2] Colorado State Univ, Ft Collins, CO USA
来源
SIGNAL PROCESSING, SENSOR/INFORMATION FUSION, AND TARGET RECOGNITION XXXII | 2023年 / 12547卷
关键词
MBSE; SysML; Machine Learning; Model Card; Sensor Fusion; Resource; datasheets; factsheets;
D O I
10.1117/12.2678355
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sensor fusion combines data from a suite of sensors into an integrated solution that represents the target environment more accurately than that produced by individual sensors. New developments in Machine Learning (ML) algorithms are leading to increased accuracy, precision, and reliability in sensor fusion performance. However, these increases are accompanied by increases in system costs. Aircraft sensor systems have limited computing, storage, and bandwidth resources, which must balance monetary, computational, and throughput costs, sensor fusion performance, aircraft safety, data security, robustness, and modularity system objectives while meeting strict timing requirements. Performing trade studies of these system objectives should come before incorporating new ML models into the sensor fusion software. A scalable and automated solution is needed to quickly analyze the effects on the system's objectives of providing additional resources to the new inference models. Given that model-based systems engineering (MBSE) is a focus of the majority of the aerospace industry for designing aircraft mission systems, it follows that leveraging these system models can provide scalability to the system analyses needed. This paper proposes adding empirically derived sensor fusion RNN performance and cost measurement data to machine-readable Model Cards. Furthermore, this paper proposes a scalable and automated sensor fusion system analysis process for ingesting SysML system model information and RNN Model Cards for system analyses. The value of this process is the integration of data analysis and system design that enables rapid enhancements of sensor system development.
引用
收藏
页数:16
相关论文
共 24 条
[1]   FactSheets: Increasing trust in AI services through supplier's declarations of conformity [J].
Arnold, M. ;
Bellamy, R. K. E. ;
Hind, M. ;
Houde, S. ;
Mehta, S. ;
Mojsilovic, A. ;
Nair, R. ;
Ramamurthy, K. Natesan ;
Olteanu, A. ;
Piorkowski, D. ;
Reimer, D. ;
Richards, J. ;
Tsay, J. ;
Varshney, K. R. .
IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2019, 63 (4-5)
[2]  
Bajaj M., 2022, INCOSE INSIGHT, P19
[3]  
Bender E. M., 2018, Transactions of the Association for Computational Linguistics, V6, P587, DOI DOI 10.1162/TACLA00041
[4]  
Blasch E., 2021, MULTISOURCE SCORECAR
[5]  
Booth T. M, 2023, GITHUB MODEL CARD SC
[6]   A Gradient Descent Multi-Algorithm Grid Search Optimization of Deep Learning for Sensor Fusion [J].
Booth, Thomas M. ;
Ghosh, Sudipto .
2023 IEEE INTERNATIONAL SYSTEMS CONFERENCE, SYSCON, 2023,
[7]  
Bracio BR, 1997, P ANN INT IEEE EMBS, V19, P1387, DOI 10.1109/IEMBS.1997.756639
[8]   Choosing the Best Sensor Fusion Method: A Machine-Learning Approach [J].
Brena, Ramon F. ;
Aguileta, Antonio A. ;
Trejo, Luis A. ;
Molino-Minero-Re, Erik ;
Mayora, Oscar .
SENSORS, 2020, 20 (08)
[9]  
Carroll E., 2016, SYSTEMATIC LIT REV I
[10]  
Chmielinski K. S., 2022, DATASET NUTR LABEL 2