Fast aircraft detection method in optical remote sensing images based on deep learning

被引:7
|
作者
Xu, Zhi-Feng [1 ]
Jia, Rui-Sheng [1 ,2 ]
Yu, Jin-Tao [1 ]
Yu, Jian-Zhi [1 ,2 ]
Sun, Hong-Mei [1 ,2 ]
机构
[1] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao, Peoples R China
[2] Shandong Univ Sci & Technol, Shandong Prov Key Lab Wisdom Mine Informat Techno, Qingdao, Peoples R China
关键词
remote sensing image; aircraft detection; lightweight detection network; feature fusion; GEOSPATIAL OBJECT DETECTION; NETWORKS;
D O I
10.1117/1.JRS.15.014502
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In optical remote sensing images, the aircraft to be detected is very small; external environmental factors such as cloud occlusion, aircraft, and the site background are easily fused; and the interference of objects to aircraft has a great impact on the aircraft characteristics in remote sensing images. In response to the above problems, we designed a remote sensing aircraft detection method based on deep learning. First, to ensure the feature extraction capability and limit the number of calculations of the network, the LightNet v2 network unit is designed, and it constitutes an efficient backbone network. In addition, spatial pyramid pooling of residual ideas (Res-SPP) is performed on the output results of the backbone network. Res-SPP is used to separate more important contextual features while using almost no computing space. A multi-scale fusion prediction network (MFPN) is proposed to perform feature fusion from multiple angles to achieve a rich combination of gradients. The MFPN enhances the network's ability to detect extremely small objects and can improve accuracy while ensuring that the method is lightweight. Finally, according to the judgment of the threshold, the dark channel defogging method, which enhances the ability to detect aircraft in cloudy and foggy scenes, is used for remote sensing images full of clouds and fog. The experimental results show that the proposed method can detect airplanes, especially very small airplanes, in various scenarios. The amount of calculation of the method is 23.56 BN, the model volume is 56 MB, the speed on a GTX 1080 platform reaches 157 frames per second (FPS), and the F1% on the remote sensing aircraft data set reaches 99.2. In particular, this method can be embedded in an ordinary field programmable gate array platform due to its lightweight characteristics, and the calculation speed can reach 32 FPS. (C) 2021 Society of Photo-Optical Instrumentation Engineers (SPIE)
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Research on Fast Detection Method of Aircraft in Remote sensing image Based on Deep Learning
    Zhang, Yu
    Liu, Xiangyu
    Yang, Haitao
    PROCEEDINGS OF 2018 IEEE 4TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2018), 2018, : 1398 - 1401
  • [2] Airplane Detection of Optical Remote Sensing Images Based on Deep Learning
    Dong Yongfeng
    Zhang Changtao
    Wang Peng
    Feng Zhe
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (04)
  • [3] Aircraft recognition in remote sensing images based on deep learning
    Lin, Jiaxi
    Li, Xinde
    Pan, Hong
    PROCEEDINGS 2018 33RD YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), 2018, : 895 - 899
  • [4] Aircraft Detection Method Based on Deep Convolutional Neural Network for Remote Sensing Images
    Guo Zhi
    Song Ping
    Zhang Yi
    Yan Menglong
    Sun Xian
    Sun Hao
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (11) : 2684 - 2690
  • [5] Aircraft-Bunker Detection Method Based on Deep Learning in High-Resolution Remote-Sensing Images
    Shi Shushu
    Chen Yongqiang
    Wang Yingjie
    Wang Chunle
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (04)
  • [6] Deep Learning-Based Cloud Detection for Optical Remote Sensing Images: A Survey
    Wang, Zhengxin
    Zhao, Longlong
    Meng, Jintao
    Han, Yu
    Li, Xiaoli
    Jiang, Ruixia
    Chen, Jinsong
    Li, Hongzhong
    REMOTE SENSING, 2024, 16 (23)
  • [7] Remote Sensing Images Target Detection Based on Deep Learning
    Zhang, Yuan
    Zhao, Lingran
    Jia, Linjing
    Zhang, Yuhao
    Qu, Hongquan
    2021 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, INFORMATION AND COMMUNICATION ENGINEERING, 2021, 11933
  • [8] An Effective Method Based on ACF for Aircraft Detection in Remote Sensing Images
    Zhao, An
    Fu, Kun
    Sun, Hao
    Sun, Xian
    Li, Feng
    Zhang, Daobing
    Wang, Hongqi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (05) : 744 - 748
  • [9] Remote sensing image aircraft detection technology based on deep learning
    Wei, Wanjun
    Zhang, Jiuwen
    2019 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC 2019), VOL 1, 2019, : 173 - 177
  • [10] A Change Detection Method for Remote Sensing Images Based on Coupled Dictionary and Deep Learning
    Yang, Weiwei
    Song, Haifeng
    Du, Lei
    Dai, Songsong
    Xu, Yingying
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022