ECGAN: An Improved Conditional Generative Adversarial Network With Edge Detection to Augment Limited Training Data for the Classification of Remote Sensing Images With High Spatial Resolution

被引:9
作者
Sui, Baikai [1 ]
Jiang, Tao [1 ]
Zhang, Zhen [1 ]
Pan, Xinliang [1 ]
机构
[1] Shandong Univ Sci & Technol, Coll Geodesy & Geomat, Qingdao 266590, Peoples R China
关键词
Image edge detection; Remote sensing; Spatial resolution; Generative adversarial networks; Training; Generators; Linear programming; Conditional generative adversarial network (CGAN); edge feature extraction; high spatial resolution remote sensing image; image generation; sample augment; SEGMENTATION;
D O I
10.1109/JSTARS.2020.3033529
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The classification of remote sensing images with high spatial resolution requires considerable training samples, but the process of sample making is slow and laborious. How to guarantee the accuracy of supervised classification under the condition of limited samples is an urgent problem to be solved in the field of supervised classification. For addressing this problem, we propose an improved conditional generative adversarial network with edge feature (ECGAN) to augment limited training data for the classification of remote sensing images with high spatial resolution in this article. On the basis of conditional generative adversarial network, feature factors of interclass boundaries and intraclass edges are added to networks, and an objective function with multiscale and multilevel features is constructed. The ISPRS potsdam and Vaihingen remote sensing datasets are regarded as examples. Results indicate that the high-resolution remote sensing images generated by using the network proposed in this article have abundant texture, accurate edges, and are highly similar to real images. The generated images are used to augment training samples, and an experiment for classifying high-resolution remote sensing images is conducted. The classification results of the proposed augmentation method perform better than that of the traditional sample augmentation method. We prove that ECGAN as a means of sample augmentation can effectively solves the problem that the classification effect is unideal when the supervised classification sample is insufficient.
引用
收藏
页码:1311 / 1325
页数:15
相关论文
共 41 条
[1]  
[Anonymous], 2016, P 30 C NEUR INF PROC
[2]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[3]  
Barratt S., 2019, P INT C COMP VIS
[4]  
Berthelot D., 2017, arXiv, DOI DOI 10.48550/ARXIV.1703.10717
[5]   Edge-Guided Multiscale Segmentation of Satellite Multispectral Imagery [J].
Chen, Jianyu ;
Li, Jonathan ;
Pan, Delu ;
Zhu, Qiankun ;
Mao, Zhihua .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2012, 50 (11) :4513-4520
[6]   PolSAR Image Classification Using Polarimetric-Feature-Driven Deep Convolutional Neural Network [J].
Chen, Si-Wei ;
Tao, Chen-Song .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (04) :627-631
[7]   Towards Diverse and Natural Image Descriptions via a Conditional GAN [J].
Dai, Bo ;
Fidler, Sanja ;
Urtasun, Raquel ;
Lin, Dahua .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2989-2998
[8]   Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets [J].
Enomoto, Kenji ;
Sakurada, Ken ;
Wang, Weimin ;
Fukui, Hiroshi ;
Matsuoka, Masashi ;
Nakamura, Ryosuke ;
Kawaguchi, Nobuo .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1533-1541
[9]  
Gao WS, 2010, INT CONF COMP SCI, P67, DOI 10.1109/ICCSIT.2010.5563693
[10]   Dual Adversarial Autoencoders for Clustering [J].
Ge, Pengfei ;
Ren, Chuan-Xian ;
Dai, Dao-Qing ;
Feng, Jiashi ;
Yan, Shuicheng .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (04) :1417-1424