Contrastive Learning-Based Dual Dynamic GCN for SAR Image Scene Classification

被引:23
作者
Liu, Fang [1 ,2 ]
Qian, Xiaoxue [1 ,2 ]
Jiao, Licheng [1 ,2 ]
Zhang, Xiangrong [1 ,2 ]
Li, Lingling [1 ,2 ]
Cui, Yuanhao [1 ,2 ]
机构
[1] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Int Res Ctr Intelligent Percept & Computat, Minist Educ,Sch Artificial Intelligence, Xian 710071, Shaanxi, Peoples R China
[2] Xidian Univ, Joint Int Res Lab Intelligent Percept & Computat, Xian 710071, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Radar polarimetry; Synthetic aperture radar; Image edge detection; Heuristic algorithms; Radar imaging; Task analysis; Semisupervised learning; Graph convolutional network (GCN); patch-level image classification; self-supervised learning; synthetic aperture radar (SAR); RICE PADDIES; REGULARIZATION; REPRESENTATION; REDUCTION; NETWORKS;
D O I
10.1109/TNNLS.2022.3174873
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a typical label-limited task, it is significant and valuable to explore networks that enable to utilize labeled and unlabeled samples simultaneously for synthetic aperture radar (SAR) image scene classification. Graph convolutional network (GCN) is a powerful semisupervised learning paradigm that helps to capture the topological relationships of scenes in SAR images. While the performance is not satisfactory when existing GCNs are directly used for SAR image scene classification with limited labels, because few methods to characterize the nodes and edges for SAR images. To tackle these issues, we propose a contrastive learning-based dual dynamic GCN (DDGCN) for SAR image scene classification. Specifically, we design a novel contrastive loss to capture the structures of views and scenes, and develop a clustering-based contrastive self-supervised learning model for mapping SAR images from pixel space to high-level embedding space, which facilitates the subsequent node representation and message passing in GCNs. Afterward, we propose a multiple features and parameter sharing dual network framework called DDGCN. One network is a dynamic GCN to keep the local consistency and nonlocal dependency of the same scene with the help of a node attention module and a dynamic correlation matrix learning algorithm. The other is a multiscale and multidirectional fully connected network (FCN) to enlarge the discrepancies between different scenes. Finally, the features obtained by the two branches are fused for classification. A series of experiments on synthetic and real SAR images demonstrate that the proposed method achieves consistently better classification performance than the existing methods.
引用
收藏
页码:390 / 404
页数:15
相关论文
共 63 条
[1]  
[Anonymous], 2015, arXiv, DOI [DOI 10.1109/CVPR.2016.90, 10.1109/CVPR.2016.90]
[2]   Characterization of L-Band MIMP SAR Data From Rice Paddies at Late Vegetative Stage [J].
Arii, Motofumi ;
Yamada, Hiroyoshi ;
Ohki, Masato .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (07) :3852-3860
[3]   Theoretical Characterization of X-Band Multiincidence Angle and Multipolarimetric SAR Data From Rice Paddies at Late Vegetative Stage [J].
Arii, Motofumi ;
Yamada, Hiroyoshi ;
Kobayashi, Tatsuharu ;
Kojima, Shoichiro ;
Umehara, Toshihiko ;
Komatsu, Tomomi ;
Nishimura, Takeshi .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (05) :2706-2715
[4]   Local Primitive Pattern for the Classification of SAR Images [J].
Aytekin, Orsan ;
Koc, Mehmet ;
Ulusoy, Ilkay .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2013, 51 (04) :2431-2441
[5]  
Bamler R., 2020, ARXIV200610027
[6]  
Chen T, 2020, PR MACH LEARN RES, V119
[7]   Learning Graph Convolutional Networks for Multi-Label Recognition and Applications [J].
Chen, Zhao-Min ;
Wei, Xiu-Shen ;
Wang, Peng ;
Guo, Yanwen .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) :6969-6983
[8]   SAR Image segmentation based on convolutional-wavelet neural network and markov random field [J].
Duan, Yiping ;
Liu, Fang ;
Jiao, Licheng ;
Zhao, Peng ;
Zhang, Lu .
PATTERN RECOGNITION, 2017, 64 :255-267
[9]  
Fu Zhong-liang, 2012, Journal of Applied Sciences, V30, P498, DOI 10.3969/j.issn.0255-8297.2012.05.010
[10]   Deformed Graph Laplacian for Semisupervised Learning [J].
Gong, Chen ;
Liu, Tongliang ;
Tao, Dacheng ;
Fu, Keren ;
Tu, Enmei ;
Yang, Jie .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (10) :2261-2274