Small Manhole Cover Detection in Remote Sensing Imagery with Deep Convolutional Neural Networks

被引:24
作者
Liu, Wei [1 ,2 ]
Cheng, Dayu [2 ,3 ]
Yin, Pengcheng [4 ]
Yang, Mengyuan [1 ]
Li, Erzhu [1 ]
Xie, Meng [1 ]
Zhang, Lianpeng [1 ]
机构
[1] Jiangsu Normal Univ, Sch Geog Geomat & Planning, Xuzhou 221116, Jiangsu, Peoples R China
[2] State Key Lab Resources & Environm Informat Syst, Beijing 100101, Peoples R China
[3] Hebei Univ Engn, Sch Min & Geomat, Handan 056038, Hebei, Peoples R China
[4] Bur Land & Resources Xuzhou, Xuzhou 221006, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
manhole cover; remote sensing images; object detection; deep convolutional neural networks;
D O I
10.3390/ijgi8010049
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of remote sensing technology and the advent of high-resolution images, obtaining data has become increasingly convenient. However, the acquisition of small manhole cover information still has shortcomings including low efficiency of manual surveying and high leakage rate. Recently, deep learning models, especially deep convolutional neural networks (DCNNs), have proven to be effective at object detection. However, several challenges limit the applications of DCNN in manhole cover object detection using remote sensing imagery: (1) Manhole cover objects often appear at different scales in remotely sensed images and DCNNs' fixed receptive field cannot match the scale variability of such objects; (2) Manhole cover objects in large-scale remotely-sensed images are relatively small in size and densely packed, while DCNNs have poor localization performance when applied to such objects. To address these problems, we propose an effective method for detecting manhole cover objects in remotely-sensed images. First, we redesign the feature extractor by adopting the visual geometry group (VGG), which can increase the variety of receptive field size. Then, detection is performed using two sub-networks: a multi-scale output network (MON) for manhole cover object-like edge generation from several intermediate layers whose receptive fields match different object scales and a multi-level convolution matching network (M-CMN) for object detection based on fused feature maps, which combines several feature maps that enable small and densely packed manhole cover objects to produce a stronger response. The results show that our method is more accurate than existing methods at detecting manhole covers in remotely-sensed images.
引用
收藏
页数:12
相关论文
共 26 条
[1]   Learning Rotation-Invariant and Fisher Discriminative Convolutional Neural Networks for Object Detection [J].
Cheng, Gong ;
Han, Junwei ;
Zhou, Peicheng ;
Xu, Dong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) :265-278
[2]   Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7405-7415
[3]   Multi-scale object detection in remote sensing imagery with convolutional neural networks [J].
Deng, Zhipeng ;
Sun, Hao ;
Zhou, Shilin ;
Zhao, Juanping ;
Lei, Lin ;
Zou, Huanxin .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 145 :3-22
[4]   A light and faster regional convolutional neural network for object detection in optical remote sensing images [J].
Ding, Peng ;
Zhang, Ye ;
Deng, Wei-Jian ;
Jia, Ping ;
Kuijper, Arjan .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 141 :208-218
[5]  
Dollar P, 2006, P IEEE COMP SOC C CO, P1964, DOI DOI 10.1109/CVPR.2006.298
[6]   Multi-Resolution Feature Fusion for Image Classification of Building Damages with Convolutional Neural Networks [J].
Duarte, Diogo ;
Nex, Francesco ;
Kerle, Norman ;
Vosselman, George .
REMOTE SENSING, 2018, 10 (10)
[7]  
Fu C., 2017, ARXIV, P1
[8]  
Girshick R., 2015, P IEEE INT C COMPUTE, DOI [DOI 10.1109/ICCV.2015.169, 10.1109/ICCV.2015.169]
[9]  
Girshick R., 2014, ARXIV13112524V4
[10]   Region-Based Convolutional Networks for Accurate Object Detection and Segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (01) :142-158