A semi-supervised generative framework with deep learning features for high-resolution remote sensing image scene classification

被引:178
作者
Han, Wei
Feng, Ruyi
Wang, Lizhe [1 ]
Cheng, Yafan
机构
[1] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Scene classification; Deep learning; Self-label; High resolution remote sensing images; OBJECT DETECTION; REPRESENTATION; BENCHMARK; SET;
D O I
10.1016/j.isprsjprs.2017.11.004
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
High resolution remote sensing (HRRS) image scene classification plays a crucial role in a wide range of applications and has been receiving significant attention. Recently, remarkable efforts have been made to develop a variety of approaches for HRRS scene classification, wherein deep-learning-based methods have achieved considerable performance in comparison with state-of-the-art methods. However, the deep-learning-based methods have faced a severe limitation that a great number of manually annotated HRRS samples are needed to obtain a reliable model. However, there are still not sufficient annotation datasets in the field of remote sensing. In addition, it is a challenge to get a large scale HRRS image dataset due to the abundant diversities and variations in HRRS images. In order to address the problem, we propose a semi-supervised generative framework (SSGF), which combines the deep learning features, a self-label technique, and a discriminative evaluation method to complete the task of scene classification and annotating datasets. On this basis, we further develop an extended algorithm (SSGA-E) and evaluate it by exclusive experiments. The experimental results show that the SSGA-E outperforms most of the fully-supervised methods and semi-supervised methods. It has achieved the third best accuracy on the UCM dataset, the second best accuracy on the WHU-RS, the NWPU-RESISC45, and the AID datasets. The impressive results demonstrate that the proposed SSGF and the extended method is effective to solve the problem of lacking an annotated HRRS dataset, which can learn valuable information from unlabeled samples to improve classification ability and obtain a reliable annotation dataset for supervised learning. (C) 2017 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS). Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:23 / 43
页数:21
相关论文
共 59 条
[21]   Semisupervised Self-Learning for Hyperspectral Image Classification [J].
Dopido, Inmaculada ;
Li, Jun ;
Marpu, Prashanth Reddy ;
Plaza, Antonio ;
Bioucas Dias, Jose M. ;
Benediktsson, Jon Atli .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2013, 51 (07) :4032-4044
[22]   Modeling and simulation for natural disaster contingency planning driven by high-resolution remote sensing images [J].
Dou, Minggang ;
Chen, Jingying ;
Chen, Dan ;
Chen, Xiaodao ;
Deng, Ze ;
Zhang, Xuguang ;
Xu, Kai ;
Wang, Jian .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2014, 37 :367-377
[23]  
Fu M, 2015, 2015 IEEE CHINA SUMMIT & INTERNATIONAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING, P206, DOI 10.1109/ChinaSIP.2015.7230392
[24]   Human Settlements: A Global Challenge for EO Data Processing and Interpretation [J].
Gamba, Paolo .
PROCEEDINGS OF THE IEEE, 2013, 101 (03) :570-581
[25]   Multimodal Classification of Remote Sensing Images: A Review and Future Directions [J].
Gomez-Chova, Luis ;
Tuia, Devis ;
Moser, Gabriele ;
Camps-Valls, Gustau .
PROCEEDINGS OF THE IEEE, 2015, 103 (09) :1560-1584
[26]   Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning [J].
Han, Junwei ;
Zhang, Dingwen ;
Cheng, Gong ;
Guo, Lei ;
Ren, Jinchang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (06) :3325-3337
[27]   A fast learning algorithm for deep belief nets [J].
Hinton, Geoffrey E. ;
Osindero, Simon ;
Teh, Yee-Whye .
NEURAL COMPUTATION, 2006, 18 (07) :1527-1554
[28]   Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery [J].
Hu, Fan ;
Xia, Gui-Song ;
Hu, Jingwen ;
Zhang, Liangpei .
REMOTE SENSING, 2015, 7 (11) :14680-14707
[29]   KNOWLEDGE-BASED CROP CLASSIFICATION OF A LANDSAT THEMATIC MAPPER IMAGE [J].
JANSSEN, LLF ;
MIDDELKOOP, H .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 1992, 13 (15) :2827-2837
[30]   Caffe: Convolutional Architecture for Fast Feature Embedding [J].
Jia, Yangqing ;
Shelhamer, Evan ;
Donahue, Jeff ;
Karayev, Sergey ;
Long, Jonathan ;
Girshick, Ross ;
Guadarrama, Sergio ;
Darrell, Trevor .
PROCEEDINGS OF THE 2014 ACM CONFERENCE ON MULTIMEDIA (MM'14), 2014, :675-678