Deep Learning Approach for Car Detection in UAV Imagery

被引:219
作者
Ammour, Nassim [1 ]
Alhichri, Haikel [1 ]
Bazi, Yakoub [1 ]
Benjdira, Bilel [1 ]
Alajlan, Naif [1 ]
Zuair, Mansour [1 ]
机构
[1] King Saud Univ, Comp Engn Dept, Coll Comp & Informat Sci, Riyadh 11543, Saudi Arabia
关键词
UAV imagery; car counting; deep learning; convolutional neural networks (CNNs); support vector machines (SVM); mean-shift segmentation; VEHICLE DETECTION; MEAN SHIFT; AERIAL; ALGORITHM; NETWORKS; SVM;
D O I
10.3390/rs9040312
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
This paper presents an automatic solution to the problem of detecting and counting cars in unmanned aerial vehicle (UAV) images. This is a challenging task given the very high spatial resolution of UAV images (on the order of a few centimetres) and the extremely high level of detail, which require suitable automatic analysis methods. Our proposed method begins by segmenting the input image into small homogeneous regions, which can be used as candidate locations for car detection. Next, a window is extracted around each region, and deep learning is used to mine highly descriptive features from these windows. We use a deep convolutional neural network (CNN) system that is already pre-trained on huge auxiliary data as a feature extraction tool, combined with a linear support vector machine (SVM) classifier to classify regions into "car" and "no-car" classes. The final step is devoted to a fine-tuning procedure which performs morphological dilation to smooth the detected regions and fill any holes. In addition, small isolated regions are analysed further using a few sliding rectangular windows to locate cars more accurately and remove false positives. To evaluate our method, experiments were conducted on a challenging set of real UAV images acquired over an urban area. The experimental results have proven that the proposed method outperforms the state-of-the-art methods, both in terms of accuracy and computational time.
引用
收藏
页数:15
相关论文
共 38 条
[1]  
[Anonymous], 2001, P 8 IEEE INT C COMP
[2]  
[Anonymous], PROC CVPR IEEE
[3]  
[Anonymous], 2015, PROC 3 INT C LEARNIN
[4]   Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle [J].
Berni, Jose A. J. ;
Zarco-Tejada, Pablo J. ;
Suarez, Lola ;
Fereres, Elias .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2009, 47 (03) :722-738
[5]   Graph cuts and efficient N-D image segmentation [J].
Boykov, Yuri ;
Funka-Lea, Gareth .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2006, 70 (02) :109-131
[6]   Efficient Training of Convolutional Deep Belief Networks in the Frequency Domain for Application to High-Resolution 2D and 3D Images [J].
Brosch, Tom ;
Tam, Roger .
NEURAL COMPUTATION, 2015, 27 (01) :211-227
[7]   Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks [J].
Chen, Xueyun ;
Xiang, Shiming ;
Liu, Cheng-Lin ;
Pan, Chun-Hong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2014, 11 (10) :1797-1801
[8]   MEAN SHIFT, MODE SEEKING, AND CLUSTERING [J].
CHENG, YZ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1995, 17 (08) :790-799
[9]   Unmanned aerial systems for photogrammetry and remote sensing: A review [J].
Colomina, I. ;
Molina, P. .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 92 :79-97
[10]   Mean shift: A robust approach toward feature space analysis [J].
Comaniciu, D ;
Meer, P .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (05) :603-619