Region-Enhanced Convolutional Neural Network for Object Detection in Remote Sensing Images

被引:52
作者
Lei, Jianjun [1 ]
Luo, Xiaowei [1 ]
Fang, Leyuan [2 ]
Wang, Mengyuan [1 ]
Gu, Yanfeng [3 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
[3] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2020年 / 58卷 / 08期
基金
中国国家自然科学基金;
关键词
Multilayer fusion strategy; object detection; region-enhanced convolutional neural network (RECNN); remote sensing images; saliency constraint; TARGET DETECTION;
D O I
10.1109/TGRS.2020.2968802
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The convolutional neural networks (CNNs) have recently demonstrated to be a powerful tool for object detection. However, with the complex scenes in remote sensing images, feature extraction of the object in the CNN will be seriously affected by background information. To address this issue, in this article, a region-enhanced CNN (RECNN) is proposed for the object detection of remote sensing images. The RECNN introduces the saliency constraint and multilayer fusion strategy into the CNN model, which can effectively enhance the object regions for better detection. Specifically, the saliency map is extracted and utilized to guide the training of the proposed model to strengthen saliency regions in feature maps. In addition, since different layers can reflect the object regions in varied resolutions, a multilayer fusion strategy is introduced to connect different convolutional layers and explore the context, where the feature maps of object regions are further enhanced. Experimental results on a publicly available ten-class object detection data set demonstrate the superiority of the RECNN over several competitive object detection methods.
引用
收藏
页码:5693 / 5702
页数:10
相关论文
共 45 条
[1]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[2]   Weakly supervised vehicle detection in satellite images via multi-instance discriminative learning [J].
Cao, Liujuan ;
Luo, Feng ;
Chen, Li ;
Sheng, Yihan ;
Wang, Haibin ;
Wang, Cheng ;
Ji, Rongrong .
PATTERN RECOGNITION, 2017, 64 :417-424
[3]   Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7405-7415
[4]   A survey on object detection in optical remote sensing images [J].
Cheng, Gong ;
Han, Junwei .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2016, 117 :11-28
[5]   Multi-class geospatial object detection and geographic image classification based on collection of part detectors [J].
Cheng, Gong ;
Han, Junwei ;
Zhou, Peicheng ;
Guo, Lei .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 98 :119-132
[6]   Fast and Accurate Online Video Object Segmentation via Tracking Parts [J].
Cheng, Jingchun ;
Tsai, Yi-Hsuan ;
Hung, Wei-Chih ;
Wang, Shengjin ;
Yang, Ming-Hsuan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7415-7424
[7]  
Dan Z., 2014, P INT C FUZZ SYST KN, P930
[8]   Use of Salient Features for the Design of a Multistage Framework to Extract Roads From High-Resolution Multispectral Satellite Images [J].
Das, Sukhendu ;
Mirnalinee, T. T. ;
Varghese, Koshy .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (10) :3906-3931
[9]  
Deng ZP, 2017, 2017 INTERNATIONAL WORKSHOP ON REMOTE SENSING WITH INTELLIGENT PROCESSING (RSIP 2017)
[10]   Efficient Saliency-Based Object Detection in Remote Sensing Images Using Deep Belief Networks [J].
Diao, Wenhui ;
Sun, Xian ;
Zheng, Xinwei ;
Dou, Fangzheng ;
Wang, Hongqi ;
Fu, Kun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (02) :137-141