DML-GANR: Deep Metric Learning With Generative Adversarial Network Regularization for High Spatial Resolution Remote Sensing Image Retrieval

被引:23
作者
Cao, Yun [1 ,2 ]
Wang, Yuebin [1 ,3 ]
Peng, Junhuan [1 ,2 ]
Zhang, Liqiang [4 ]
Xu, Linlin [1 ,2 ]
Yan, Kai [1 ,2 ]
Li, Lihua [1 ,2 ]
机构
[1] China Univ Geosci, Sch Land Sci & Technol, Beijing 100083, Peoples R China
[2] Shanxi Prov Key Lab Resources Environm & Disaster, Jinzhong 030600, Peoples R China
[3] Beijing Normal Univ, State Key Lab Remote Sensing Sci, Beijing 100875, Peoples R China
[4] Beijing Normal Univ, Fac Geog Sci, State Key Lab Remote Sensing Sci, Beijing 100875, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2020年 / 58卷 / 12期
基金
中国国家自然科学基金;
关键词
Feature extraction; Measurement; Generative adversarial networks; Gallium nitride; Image retrieval; Generators; Training; Convolutional neural network (CNN); generative adversarial network (GAN); deep metric learning (DML); image retrieval; deep learning; CONVOLUTIONAL NEURAL-NETWORKS; DISTANCE; CLASSIFICATION;
D O I
10.1109/TGRS.2020.2991545
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With a small number of labeled samples for training, it can save considerable manpower and material resources, especially when the amount of high spatial resolution remote sensing images (HSR-RSIs) increases considerably. However, many deep models face the problem of overfitting when using a small number of labeled samples. This might degrade HSR-RSI retrieval accuracy. Aiming at obtaining more accurate HSR-RSI retrieval performance with small training samples, we develop a deep metric learning approach with generative adversarial network regularization (DML-GANR) for HSR-RSI retrieval. The DML-GANR starts from a high-level feature extraction (HFE) to extract high-level features, which includes convolutional layers and fully connected (FC) layers. Each of the FC layers is constructed by deep metric learning (DML) to maximize the interclass variations and minimize the intraclass variations. The generative adversarial network (GAN) is adopted to mitigate the overfitting problem and validate the qualities of extracted high-level features. DML-GANR is optimized through a customized approach, and the optimal parameters are obtained. The experimental results on the three data sets demonstrate the superior performance of DML-GANR over state-of-the-art techniques in HSR-RSI retrieval.
引用
收藏
页码:8888 / 8904
页数:17
相关论文
共 59 条
[41]   Climate change, 2007 [J].
Saier, M. H., Jr. .
WATER AIR AND SOIL POLLUTION, 2007, 181 (1-4) :1-2
[42]  
Sermanet P, 2013, OVERFEAT INTEGRATED
[43]   Road Detection From Remote Sensing Images by Generative Adversarial Networks [J].
Shi, Qian ;
Liu, Xiaoping ;
Li, Xia .
IEEE ACCESS, 2018, 6 :25486-25494
[44]   Collaborative image retrieval via regularized metric learning [J].
Si, Luo ;
Jin, Rong ;
Hoi, Steven C. H. ;
Lyu, Michael R. .
MULTIMEDIA SYSTEMS, 2006, 12 (01) :34-44
[45]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
[46]  
Sohn K, 2016, ADV NEUR IN, V29
[47]  
Song JK, 2018, AAAI CONF ARTIF INTE, P394
[48]  
Szegedy C, 2015, PROC CVPR IEEE, P1, DOI 10.1109/CVPR.2015.7298594
[49]   Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on remote sensing physics [J].
Thomas, Claire ;
Ranchin, Thierry ;
Wald, Lucien ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2008, 46 (05) :1301-1312
[50]   STCT: Sequentially Training Convolutional Networks for Visual Tracking [J].
Wang, Lijun ;
Ouyang, Wanli ;
Wang, Xiaogang ;
Lu, Huchuan .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1373-1381