UAV Target Detection for IoT via Enhancing ERP Component by Brain-Computer Interface System

被引:13
作者
Zhang, Yufeng [1 ]
Zhang, Hongxin [2 ,3 ]
Gao, Xiaorong [4 ]
Zhang, Shangen [5 ]
Yang, Chen [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Cyberspace Secur, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Elect Engn, Beijing 100876, Peoples R China
[3] Beijing Univ Posts & Telecommun, Beijing Key Lab Work Safety Intelligent Monitoring, Beijing 100876, Peoples R China
[4] Tsinghua Univ, Sch Med, Dept Biomed Engn, Beijing 100080, Peoples R China
[5] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2023年 / 10卷 / 19期
基金
中国国家自然科学基金;
关键词
Brain-computer interface (BCI); electroen-cephalography (EEG); event-related potential (ERP); Internet of Things (IoT); real-time system; target detection; unmanned aerial vehicle (UAV); P300;
D O I
10.1109/JIOT.2023.3273163
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The increasing popularity of Internet of Things (IoT) devices provides a huge data source for intelligent identification. Images captured by the unmanned aerial vehicle (UAV) are often exploited in target detection missions for search, rescue and fire prevention. However, without sufficient training samples, the machine learning method is usually difficult to meet application requirements. To solve the problem, a brain-computer interface (BCI) real-time system is applied to UAV target detection. In this study, a novel rapid serial visual presentation (RSVP) paradigm was formulated to present images, enhancing the ability for wide-area target detection. Since there is spatial correlation in captured images, joint decision for identical target can improve the recognition efficiency. To suppress interfering components and improve event-related potential (ERP) detection efficiency, an enhancing ERP component (EEC) algorithm is proposed. Both decision method and EEC algorithm are based on strictly statistical theory. RSVP task was performed by 12 subjects. The interference components and noise correlation were significantly reduced by the EEC algorithm. The target detection rate online was 86.6% while the false alarm rate was less than 5%. Besides, the joint decision strategy raised the area under curve (AUC) value from 0.876 to 0.963. The proposed BCI real-time system realizes the complementarity of human intelligence and IoT, ushering UAV target detection into the era of hybrid intelligence.
引用
收藏
页码:17243 / 17253
页数:11
相关论文
共 35 条
[1]   Gaze-independent BCI-spelling using rapid serial visual presentation (RSVP) [J].
Acqualagna, Laura ;
Blankertz, Benjamin .
CLINICAL NEUROPHYSIOLOGY, 2013, 124 (05) :901-908
[2]   The cost of space independence in P300-BCI spellers [J].
Chennu, Srivas ;
Alsufyani, Abdulmajeed ;
Filetti, Marco ;
Owen, Adrian M. ;
Bowman, Howard .
JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2013, 10
[3]   Interface, interaction, and intelligence in generalized brain-computer interfaces [J].
Gao, Xiaorong ;
Wang, Yijun ;
Chen, Xiaogang ;
Gao, Shangkai .
TRENDS IN COGNITIVE SCIENCES, 2021, 25 (08) :671-684
[4]   Cortically coupled computer vision for rapid image search [J].
Gerson, Adam D. ;
Parra, Lucas C. ;
Sajda, Paul .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2006, 14 (02) :174-179
[5]   Decreased Npas4 expression in patients with post-stroke depression [J].
Gu, Shina ;
Li, Xiaodan ;
Zhao, Lin ;
Ren, Huicong ;
Pei, Chendi ;
Li, Wendiang ;
Mu, Junlin ;
Song, Jinggui ;
Zhang, Zhaohui .
JOURNAL OF NEURORESTORATOLOGY, 2019, 7 (02) :101-108
[6]   An efficient P300-based brain-computer interface for disabled subjects [J].
Hoffmann, Ulrich ;
Vesin, Jean-Marc ;
Ebrahimi, Touradj ;
Diserens, Karin .
JOURNAL OF NEUROSCIENCE METHODS, 2008, 167 (01) :115-125
[7]   High Throughput Screening for Mammography using a Human-Computer Interface with Rapid Serial Visual Presentation (RSVP) [J].
Hope, Chris ;
Sterr, Annette ;
Elangovan, Premkumar ;
Geades, Nicholas ;
Windridge, David ;
Young, Ken ;
Wells, Kevin .
MEDICAL IMAGING 2013: IMAGE PERCEPTION, OBSERVER PERFORMANCE, AND TECHNOLOGY ASSESSMENT, 2013, 8673
[8]   Effects of mental workload and fatigue on the P300, alpha and theta band power during operation of an ERP (P300) brain-computer interface [J].
Kaethner, Ivo ;
Wriessnegger, Selina C. ;
Mueller-Putz, Gernot R. ;
Kuebler, Andrea ;
Halder, Sebastian .
BIOLOGICAL PSYCHOLOGY, 2014, 102 :118-129
[9]   Toward enhanced P300 speller performance [J].
Krusienski, D. J. ;
Sellers, E. W. ;
McFarland, D. J. ;
Vaughan, T. M. ;
Wolpaw, J. R. .
JOURNAL OF NEUROSCIENCE METHODS, 2008, 167 (01) :15-21
[10]   Speed of Rapid Serial Visual Presentation of Pictures, Numbers and Words Affects Event-Related Potential-Based Detection Accuracy [J].
Lees, Stephanie ;
McCullagh, Paul ;
Payne, Phillippa ;
Maguire, Liam ;
Lotte, Fabien ;
Coyle, Damien .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (01) :113-122