DML-GANR: Deep Metric Learning With Generative Adversarial Network Regularization for High Spatial Resolution Remote Sensing Image Retrieval

被引:23
作者
Cao, Yun [1 ,2 ]
Wang, Yuebin [1 ,3 ]
Peng, Junhuan [1 ,2 ]
Zhang, Liqiang [4 ]
Xu, Linlin [1 ,2 ]
Yan, Kai [1 ,2 ]
Li, Lihua [1 ,2 ]
机构
[1] China Univ Geosci, Sch Land Sci & Technol, Beijing 100083, Peoples R China
[2] Shanxi Prov Key Lab Resources Environm & Disaster, Jinzhong 030600, Peoples R China
[3] Beijing Normal Univ, State Key Lab Remote Sensing Sci, Beijing 100875, Peoples R China
[4] Beijing Normal Univ, Fac Geog Sci, State Key Lab Remote Sensing Sci, Beijing 100875, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2020年 / 58卷 / 12期
基金
中国国家自然科学基金;
关键词
Feature extraction; Measurement; Generative adversarial networks; Gallium nitride; Image retrieval; Generators; Training; Convolutional neural network (CNN); generative adversarial network (GAN); deep metric learning (DML); image retrieval; deep learning; CONVOLUTIONAL NEURAL-NETWORKS; DISTANCE; CLASSIFICATION;
D O I
10.1109/TGRS.2020.2991545
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With a small number of labeled samples for training, it can save considerable manpower and material resources, especially when the amount of high spatial resolution remote sensing images (HSR-RSIs) increases considerably. However, many deep models face the problem of overfitting when using a small number of labeled samples. This might degrade HSR-RSI retrieval accuracy. Aiming at obtaining more accurate HSR-RSI retrieval performance with small training samples, we develop a deep metric learning approach with generative adversarial network regularization (DML-GANR) for HSR-RSI retrieval. The DML-GANR starts from a high-level feature extraction (HFE) to extract high-level features, which includes convolutional layers and fully connected (FC) layers. Each of the FC layers is constructed by deep metric learning (DML) to maximize the interclass variations and minimize the intraclass variations. The generative adversarial network (GAN) is adopted to mitigate the overfitting problem and validate the qualities of extracted high-level features. DML-GANR is optimized through a customized approach, and the optimal parameters are obtained. The experimental results on the three data sets demonstrate the superior performance of DML-GANR over state-of-the-art techniques in HSR-RSI retrieval.
引用
收藏
页码:8888 / 8904
页数:17
相关论文
共 59 条
[1]  
[Anonymous], 2012, P 20 ACM INT C MULT
[2]  
[Anonymous], ICML
[3]  
[Anonymous], 2010, PROC ACM INT S ADV G
[4]  
[Anonymous], 2015, arXiv
[5]   Remote Sensing Image Retrieval With Global Morphological Texture Descriptors [J].
Aptoula, Erchan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (05) :3023-3034
[6]   Object based image analysis for remote sensing [J].
Blaschke, T. .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2010, 65 (01) :2-16
[7]   Exploring Hierarchical Convolutional Features for Hyperspectral Image Classification [J].
Cheng, Gong ;
Li, Zhenpeng ;
Han, Junwei ;
Yao, Xiwen ;
Guo, Lei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (11) :6712-6722
[8]   Learning Rotation-Invariant and Fisher Discriminative Convolutional Neural Networks for Object Detection [J].
Cheng, Gong ;
Han, Junwei ;
Zhou, Peicheng ;
Xu, Dong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) :265-278
[9]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821
[10]   Duplex Metric Learning for Image Set Classification [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :281-292