Demonstrating Confidence in RF Machine Learning Systems

被引:0
作者
Judah, Matthew [1 ]
Kuzdeba, Scott [1 ]
机构
[1] BAE Syst FAST Labs TM, Merrimack, NH 03054 USA
来源
ASSURANCE AND SECURITY FOR AI-ENABLED SYSTEMS | 2024年 / 13054卷
关键词
RF; Communications; Deep Learning; Machine Learning RiftNet; AI Assurance; Confidence;
D O I
10.1117/12.3014104
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Significant advancements have been achieved in radio frequency (RF) machine learning (ML), yet much of the existing research remains confined to proof-of-concept demonstrations or narrowly defined scenarios that do not fully encompass real-world operational conditions. As machine learning algorithms increasingly assume decision-making roles in this domain, ensuring the reliability and validity of their outcomes becomes imperative. This paper seeks to expand the discourse on ML assurance within the RF ML domain. Building upon the foundation laid by the RiftNet- deep learning classifier, this study investigates the robustness of this solution in the context of instilling confidence in RFML applications. Specifically, the paper delves into the challenges posed by inaccurately labeled data during artificial intelligence agent development, the quantification of outcome uncertainties, and the implementation of calibration techniques for RF modulation recognition. In essence, this research marks a pivotal shift from the initial successes of RF ML towards the development of techniques that inspire confidence in real-world, edge-system applications.
引用
收藏
页数:9
相关论文
共 23 条
[1]   A survey on artificial intelligence assurance [J].
Batarseh, Feras A. ;
Freeman, Laura ;
Huang, Chih-Hao .
JOURNAL OF BIG DATA, 2021, 8 (01)
[2]  
C. Inc, 2024, Cleanlab open-source
[3]  
Charpentier Bertrand, 2020, ADV NEUR IN, V33
[4]  
Guo CA, 2017, PR MACH LEARN RES, V70
[5]  
Haywood B., 1999, General Document DSTO-GD-0210
[6]   Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods [J].
Huellermeier, Eyke ;
Waegeman, Willem .
MACHINE LEARNING, 2021, 110 (03) :457-506
[7]  
Johansson U, 2021, PR MACH LEARN RES, V152, P111
[8]   Data-Centric Approaches to Radio Frequency Machine Learning [J].
Kuzdeba, Scott ;
Robinson, Josh .
2022 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2022,
[9]  
Malinin A, 2019, ADV NEUR IN, V32
[10]  
Malinin A, 2018, ADV NEUR IN, V31