Practical Study of Recurrent Neural Networks for Efficient Real-Time Drone Sound Detection: A Review

被引:18
|
作者
Utebayeva, Dana [1 ]
Ilipbayeva, Lyazzat [2 ]
Matson, Eric T. [3 ]
机构
[1] Satbayev Univ, Dept ET & ST, Alma Ata 050013, Kazakhstan
[2] Int IT Univ, Dept RET, Alma Ata 050040, Kazakhstan
[3] Purdue Univ, Dept CIT, W Lafayette, IN 47907 USA
关键词
RNN; simpleRNN; LSTM; BiLSTM; bidirectional LSTM; gated recurrent networks; GRU; Kapre method; Mel-spectrogram; deep learning; UAV sound; sound detection; loaded UAV; unloaded UAV; drone detection; real-time UAV detection;
D O I
10.3390/drones7010026
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The detection and classification of engine-based moving objects in restricted scenes from acoustic signals allow better Unmanned Aerial System (UAS)-specific intelligent systems and audio-based surveillance systems. Recurrent Neural Networks (RNNs) provide wide coverage in the field of acoustic analysis due to their effectiveness in widespread practical applications. In this work, we propose to study SimpleRNN, LSTM, BiLSTM, and GRU recurrent network models for real-time UAV sound recognition systems based on Mel-spectrogram using Kapre layers. The main goal of the work is to study the types of RNN networks in a practical sense for a reliable drone sound recognition system. According to the results of an experimental study, the GRU (Gated Recurrent Units) network model demonstrated a higher prediction ability than other RNN architectures for detecting differences and the state of objects from acoustic signals. That is, RNNs gave higher recognition than CNNs for loaded and unloaded audio states of various UAV models, while the GRU model showed about 98% accuracy for determining the UAV load states and 99% accuracy for background noise, which consisted of more other data.
引用
收藏
页数:25
相关论文
共 50 条
  • [21] SPHERICAL CONVOLUTIONAL RECURRENT NEURAL NETWORK FOR REAL-TIME SOUND SOURCE TRACKING
    Zhong, Tianle
    Mendoza Velazquez, Israel
    Ren, Yi
    Perez Meana, Hector Manuel
    Haneda, Yoichi
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5063 - 5067
  • [22] Efficient Neural Networks for Real-time Motion Style Transfer
    Smith, Harrison Jesse
    Cao, Chen
    Nef, Michael
    Wang, Yingying
    PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2019, 2 (02)
  • [23] Abnormal Gait Recognition in Real-Time using Recurrent Neural Networks
    Jinnovart, Thanaporn
    C, Xiongcai
    Thonglek, Kundjanasith
    2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 972 - 977
  • [24] Real-Time Prediction of Taxi Demand Using Recurrent Neural Networks
    Xu, Jun
    Rahmatizadeh, Rouhollah
    Boloni, Ladislau
    Turgut, Damla
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2018, 19 (08) : 2572 - 2581
  • [25] Recurrent neural networks for real-time prediction of TBM operating parameters
    Gao, Xianjie
    Shi, Maolin
    Song, Xueguan
    Zhang, Chao
    Zhang, Hongwei
    AUTOMATION IN CONSTRUCTION, 2019, 98 : 225 - 235
  • [26] Multilayer recurrent neural networks for real-time robust pole assignment
    Hu, SQ
    Wang, J
    ICONIP'02: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING: COMPUTATIONAL INTELLIGENCE FOR THE E-AGE, 2002, : 1104 - 1108
  • [27] On the Adaptability of Recurrent Neural Networks for Real-Time Jazz Improvisation Accompaniment
    Kritsis, Kosmas
    Kylafi, Theatina
    Kaliakatsos-Papakostas, Maximos
    Pikrakis, Aggelos
    Katsouros, Vassilis
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2021, 3
  • [28] Improving real-time drone detection for counter-drone systems
    Cetin, E.
    Barrado, C.
    Pastor, E.
    AERONAUTICAL JOURNAL, 2021, 125 (1292): : 1871 - 1896
  • [29] BRIGHT - Graph Neural Networks in Real-Time Fraud Detection
    Lu, Mingxuan
    Han, Zhichao
    Rao, Susie Xi
    Zhang, Zitao
    Zhao, Yang
    Shan, Yinan
    Raghunathan, Ramesh
    Zhang, Ce
    Jiang, Jiawei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 3342 - 3351
  • [30] Sampling Frequency Evaluation on Recurrent Neural Networks Architectures for IoT Real-time Fall Detection Devices
    Luna-Perejon, F.
    Civit-Masot, J.
    Munoz-Saavedra, L.
    Duran-Lopez, L.
    Amaya-Rodriguez, I
    Dominguez-Morales, J.
    Vicente-Diaz, S.
    Linares-Barranco, A.
    Civit-Balcells, A.
    Dominguez-Morales, M.
    IJCCI: PROCEEDINGS OF THE 11TH INTERNATIONAL JOINT CONFERENCE ON COMPUTATIONAL INTELLIGENCE, 2019, : 536 - 541