Semantic Segmentation of Aerial Images With Shuffling Convolutional Neural Networks

被引:79
作者
Chen, Kaiqiang [1 ,2 ]
Fu, Kun [1 ]
Yan, Menglong [1 ]
Gao, Xin [1 ]
Sun, Xian [1 ]
Wei, Xin [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Elect, Key Lab Technol Geospatial Informat Proc & Applic, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Aerial images; convolutional neural networks (CNNs); deep learning; remote sensing; semantic segmentation;
D O I
10.1109/LGRS.2017.2778181
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Semantic segmentation of aerial images refers to assigning one land cover category to each pixel. This is a challenging task due to the great differences in the appearances of ground objects. Many attempts have been made during the past decades. In recent years, convolutional neural networks (CNNs) have been introduced in the remote sensing field, and various solutions have been proposed to realize dense semantic labeling with CNNs. In this letter, we propose shuffling CNNs to realize semantic segmentation of aerial images in a periodic shuffling manner. This approach is a supplement to current methods for semantic segmentation of aerial images. We propose a naive version and a deeper version of this method, and both are adept at detecting small objects. Additionally, we propose a method called field-of-view (FoV) enhancement that can enhance the predictions. This method can be applied to various networks, and our experiments verify its effectiveness. The final results are further improved through an ensemble method that averages the score maps generated by the models at different checkpoints of the same network. We evaluate our models using the ISPRS Vaihingen and Potsdam data sets, and we acquire promising results using these two data sets.
引用
收藏
页码:173 / 177
页数:5
相关论文
共 18 条
[1]  
[Anonymous], 2015, INT C MACH LEARN PML
[2]  
[Anonymous], FULLY CONVOLUT UNPUB
[3]  
Chen L.-C., 2014, PROC INT C LEARN REP
[4]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[5]  
Chen T., 2015, MXNET FLEXIBLE UNPUB
[6]   Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks [J].
Chen, Xueyun ;
Xiang, Shiming ;
Liu, Cheng-Lin ;
Pan, Chun-Hong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2014, 11 (10) :1797-1801
[7]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[8]   Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7405-7415
[9]  
Gerke M., 2014, "Use of the stair vision library within the ISPRS 2D semantic labeling benchmark (Vaihingen), DOI 10.13140/2.1.5015.9683
[10]   BUILDING EXTRACTION FROM MULTI-SOURCE REMOTE SENSING IMAGES VIA DEEP DECONVOLUTION NEURAL NETWORKS [J].
Huang, Zuming ;
Cheng, Guangliang ;
Wang, Hongzhen ;
Li, Haichang ;
Shi, Limin ;
Pan, Chunhong .
2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, :1835-1838