Practical Study of Recurrent Neural Networks for Efficient Real-Time Drone Sound Detection: A Review

被引:18
|
作者
Utebayeva, Dana [1 ]
Ilipbayeva, Lyazzat [2 ]
Matson, Eric T. [3 ]
机构
[1] Satbayev Univ, Dept ET & ST, Alma Ata 050013, Kazakhstan
[2] Int IT Univ, Dept RET, Alma Ata 050040, Kazakhstan
[3] Purdue Univ, Dept CIT, W Lafayette, IN 47907 USA
关键词
RNN; simpleRNN; LSTM; BiLSTM; bidirectional LSTM; gated recurrent networks; GRU; Kapre method; Mel-spectrogram; deep learning; UAV sound; sound detection; loaded UAV; unloaded UAV; drone detection; real-time UAV detection;
D O I
10.3390/drones7010026
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The detection and classification of engine-based moving objects in restricted scenes from acoustic signals allow better Unmanned Aerial System (UAS)-specific intelligent systems and audio-based surveillance systems. Recurrent Neural Networks (RNNs) provide wide coverage in the field of acoustic analysis due to their effectiveness in widespread practical applications. In this work, we propose to study SimpleRNN, LSTM, BiLSTM, and GRU recurrent network models for real-time UAV sound recognition systems based on Mel-spectrogram using Kapre layers. The main goal of the work is to study the types of RNN networks in a practical sense for a reliable drone sound recognition system. According to the results of an experimental study, the GRU (Gated Recurrent Units) network model demonstrated a higher prediction ability than other RNN architectures for detecting differences and the state of objects from acoustic signals. That is, RNNs gave higher recognition than CNNs for loaded and unloaded audio states of various UAV models, while the GRU model showed about 98% accuracy for determining the UAV load states and 99% accuracy for background noise, which consisted of more other data.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] Towards Real-Time Drone Detection Using Deep Neural Networks
    Pulido, Cristhiam
    Ceron, Alexander
    DEVELOPMENTS AND ADVANCES IN DEFENSE AND SECURITY, MICRADS 2021, 2022, 255 : 149 - 159
  • [2] Real-Time Detection of Gait Events by Recurrent Neural Networks
    Wang, Fu-Cheng
    Li, You-Chi
    Kuo, Tien-Yun
    Chen, Szu-Fu
    Lin, Chin-Hsien
    IEEE ACCESS, 2021, 9 : 134849 - 134857
  • [3] Intelligent Real-Time Earthquake Detection by Recurrent Neural Networks
    Chin, Tai-Lin
    Chen, Kuan-Yu
    Chen, Da-Yi
    Lin, De-En
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (08): : 5440 - 5449
  • [4] Exploiting Structures in Weight Matrices for Efficient Real-Time Drone Control with Neural Networks
    Kissel, Matthias
    Gronauer, Sven
    Korte, Mathias
    Sacchetto, Luca
    Diepold, Klaus
    PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2022, 2022, 13566 : 525 - 536
  • [5] Efficient Gated Convolutional Recurrent Neural Networks for Real-Time Speech Enhancement
    Fazal-E-Wahab
    Ye, Zhongfu
    Saleem, Nasir
    Ali, Hamza
    Ali, Imad
    INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2024, 9 (01):
  • [6] Empirical Study of Drone Sound Detection in Real-Life Environment with Deep Neural Networks
    Jeon, Sungho
    Shin, Jong-Woo
    Lee, Young-Jun
    Kim, Woong-Hee
    Kwon, YoungHyoun
    Yang, Hae-Yong
    2017 25TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2017, : 1858 - 1862
  • [7] Embedding Recurrent Neural Networks in Wearable Systems for Real-Time Fall Detection
    Torti, Emanuele
    Fontanella, Alessandro
    Musci, Mirto
    Blago, Nicola
    Pau, Danilo
    Leporati, Francesco
    Piastra, Marco
    MICROPROCESSORS AND MICROSYSTEMS, 2019, 71
  • [8] Road surface real-time detection based on Raspberry Pi and recurrent neural networks
    Wang, Junyi
    Meng, Qinggang
    Shang, Peng
    Saada, Mohamad
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2021, 43 (11) : 2540 - 2550
  • [9] Hardware Acceleration for Real-Time Wildfire Detection Onboard Drone Networks
    Briley, Austin Alexander
    Afghah, Fatemeh
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS, INFOCOM WKSHPS 2024, 2024,
  • [10] Drone Detection and Tracking using Deep Convolutional Neural Networks from Real-time CCTV Footage
    Allmamun, Md
    Akter, Fahima
    Talukdar, Muhammad Borhan Uddin
    Chakraborty, Sovon
    Uddin, Jia
    IEIE Transactions on Smart Processing and Computing, 2024, 13 (04): : 313 - 321