Multi-Class Objects Detection Method in Remote Sensing Image Based on Direct Feedback Control for Convolutional Neural Network

被引:5
作者
Cheng, Bei [1 ]
Li, Zhengzhou [1 ,2 ,3 ]
Wu, Qingqing [1 ]
Li, Bo [1 ]
Yang, Huihui [1 ]
Qing, Lin [1 ]
Qi, Bo [3 ]
机构
[1] Chongqing Univ, Coll Microelect & Commun Engn, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Minist Educ, Key Lab Dependable Serv Comp Cyber Phys Soc, Chongqing 400044, Peoples R China
[3] Chinese Acad Sci, Inst Opt & Elect, Key Lab Opt Engn, Chengdu 610209, Sichuan, Peoples R China
来源
IEEE ACCESS | 2019年 / 7卷
基金
中国国家自然科学基金;
关键词
Object detection; convolutional neural network; direct feedback loop; feedback control layer; remote sensing image; BUILDING DETECTION; VEHICLE DETECTION; TARGET DETECTION; SPARSE REPRESENTATION; AUTOMATED DETECTION; NEAREST-NEIGHBOR; SHIP DETECTION; CLASSIFICATION; MODEL; FOREST;
D O I
10.1109/ACCESS.2019.2943346
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Object detection in high-resolution remote sensing images has been attracted increasing attention in recent years owing to the successful applications of civil and military. However, there are many critical challenges deciding the performance of object detection in large-scale complex remote sensing image. One of these challenges is how extract and enhance the discriminative features without the top-down feedback mechanism for the existing convolutional neural network (CNN). To cope with this problem, a novel object detection algorithm based on direct feedback control for CNN (DFCCNN) is proposed in this paper. The DFCCNN combines a region proposal network with an object detection network to generate the proposals and to detect the object separately. Initially, a candidate region proposal network (CRPN) is implemented to extract candidate regions within the remote sensing image. Then multi-class objects detection feedback network (MODFN) propose a new top-down feedback mechanism based on the traditional feedforward network to detect the objects. A direct feedback loop (DFL) and a feedback control layer (FCL) are contained in the feedback network. The DFL propagates the posterior information directly from the top layer without depending on the rest of the network and the FCL make full use of top-down information to inhibit object-irrelevant neurons and emphasize object-relevant neurons. Through the addition of direct feedback control mechanism, these object-relevant neurons can be emphasized by taking feedback information of top layer into feature extraction, whereas these object-irrelevant neurons can be inhibited effectively by pruning the neural pathway. The proposed DFCCNN model is able to extract more discriminative low-level features under the guidance of the high-level information. Some experiments on NWPU VHR-10 data set and aircraft data set are induced, and the experimental results show that the proposed method can achieve a higher accuracy of object detection in remote sensing image with various complex background clutter.
引用
收藏
页码:144691 / 144709
页数:19
相关论文
共 73 条
  • [11] Multilayer Markov Random Field models for change detection in optical remote sensing images
    Benedek, Csaba
    Shadaydeh, Mafia
    Kato, Zoltan
    Sziranyi, Tamas
    Zerubia, Josiane
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2015, 107 : 22 - 37
  • [12] A Visual Search Inspired Computational Model for Ship Detection in Optical Satellite Images
    Bi, Fukun
    Zhu, Bocheng
    Gao, Lining
    Bian, Mingming
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2012, 9 (04) : 749 - 753
  • [13] Nearest neighbor classification of remote sensing images with the maximal margin principle
    Blanzieri, Enrico
    Melgani, Farid
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2008, 46 (06): : 1804 - 1811
  • [14] Geographic Object-Based Image Analysis - Towards a new paradigm
    Blaschke, Thomas
    Hay, Geoffrey J.
    Kelly, Maggi
    Lang, Stefan
    Hofmann, Peter
    Addink, Elisabeth
    Feitosa, Raul Queiroz
    van der Meer, Freek
    van der Werff, Harald
    van Coillie, Frieke
    Tiede, Dirk
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 87 : 180 - 191
  • [15] A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection
    Cai, Zhaowei
    Fan, Quanfu
    Feris, Rogerio S.
    Vasconcelos, Nuno
    [J]. COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 : 354 - 370
  • [16] Look and Think Twice: Capturing Top-Down Visual Attention with Feedback Convolutional Neural Networks
    Cao, Chunshui
    Liu, Xianming
    Yang, Yi
    Yu, Yinan
    Wang, Jiang
    Wang, Zilei
    Huang, Yongzhen
    Wang, Liang
    Huang, Chang
    Xu, Wei
    Ramanan, Deva
    Huang, Thomas S.
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 2956 - 2964
  • [17] Semi-Automated Road Detection From High Resolution Satellite Images by Directional Morphological Enhancement and Segmentation Techniques
    Chaudhuri, D.
    Kushwaha, N. K.
    Samal, A.
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2012, 5 (05) : 1538 - 1544
  • [18] DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
    Chen, Liang-Chieh
    Papandreou, George
    Kokkinos, Iasonas
    Murphy, Kevin
    Yuille, Alan L.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 834 - 848
  • [19] Hyperspectral Image Classification via Kernel Sparse Representation
    Chen, Yi
    Nasrabadi, Nasser M.
    Tran, Trac D.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2013, 51 (01): : 217 - 231
  • [20] Sparse Representation for Target Detection in Hyperspectral Imagery
    Chen, Yi
    Nasrabadi, Nasser M.
    Tran, Trac D.
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2011, 5 (03) : 629 - 640