From Trained to Untrained: A Novel Change Detection Framework Using Randomly Initialized Models With Spatial-Channel Augmentation for Hyperspectral Images

被引:41
作者
Yang, Bin [1 ,2 ]
Mao, Yin [1 ,2 ]
Liu, Licheng [1 ,2 ]
Liu, Xinxin [1 ,2 ]
Ma, Yuzhong [3 ]
Li, Jing [4 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
[2] Key Lab Visual Percept & Artificial Intelligence H, Changsha 410082, Peoples R China
[3] Shandong Prov Inst Land Surveying & Mapping, Jinan 250102, Peoples R China
[4] Cent Univ Finance & Econ, Sch Informat, Beijing 100081, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Feature extraction; Spatial resolution; Data mining; Hyperspectral imaging; Training; Task analysis; Land surface; Change detection; deformable network; hyperspectral images; spatial-channel augmentation; untrained model; SLOW FEATURE ANALYSIS;
D O I
10.1109/TGRS.2023.3262928
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep learning (DL) approaches have been extensively applied to change detection in hyperspectral images (HSIs). However, the majority of them encounter scarcity of training samples or rely on complex structures and learning strategies. Although untrained change detection models have been proved to be effective in relieving the above problems, they were constructed using regular convolutions and treated spatial locations and channels equally, which are insufficient to extract discriminative features and lead to limited accuracy. Given this, a novel untrained framework using randomly initialized models with spatial-channel augmentation (RICD) is proposed for HSI change detection in this article. It consists of two major modules: 1) an enhanced feature extraction network using successive dilation-deformable feature extraction blocks, which can extract multiscale spatial-spectral features over unfixed sampling locations. It enlarges the field of view of convolutions and takes arbitrary neighborhood into consideration, which helps to increase the discriminativeness of the extracted features. And 2) a change-sensitive feature augmentation and comparison module integrating feature selection and spatial-channel augmentation strategies, which can exploit spatial context and channel importance. It magnifies difference between changed pixels and unchanged ones and emphasizes contribution of significant channels of the selected change-sensitive features. Despite that convolution operations are included in RICD, all the weights are untrained and fixed once they are randomly initialized, indicating that the RICD can work in an unsupervised manner. Its performance is tested over three widely used hyperspectral datasets. Quantitative and qualitative comparisons with several state-of-the-art unsupervised methods reveal the effectiveness of the RICD method.
引用
收藏
页数:14
相关论文
共 66 条
[41]   Unsupervised Deep Change Vector Analysis for Multiple-Change Detection in VHR Images [J].
Saha, Sudipan ;
Bovolo, Francesca ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (06) :3677-3693
[42]   Learning Multiscale Temporal-Spatial-Spectral Features via a Multipath Convolutional LSTM Neural Network for Change Detection With Hyperspectral Images [J].
Shi, Changjiang ;
Zhang, Zhijie ;
Zhang, Wanchang ;
Zhang, Chuanrong ;
Xu, Qiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[43]   Collaborative Self-Perception Network Architecture for Hyperspectral Image Change Detection [J].
Shi, Jiao ;
Zhang, Zeping ;
Wu, Tiancheng ;
Zhang, Xi ;
Lei, Yu .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[44]   Change Detection Based on Artificial Intelligence: State-of-the-Art and Challenges [J].
Shi, Wenzhong ;
Zhang, Min ;
Zhang, Rui ;
Chen, Shanxiong ;
Zhan, Zhao .
REMOTE SENSING, 2020, 12 (10)
[46]   Transfer Change Rules from Recurrent Fully Convolutional Networks for Hyperspectral Unmanned Aerial Vehicle Images without Ground Truth Data [J].
Song, Ahram ;
Kim, Yongil .
REMOTE SENSING, 2020, 12 (07)
[47]   Change Detection in Hyperspectral Images Using Recurrent 3D Fully Convolutional Networks [J].
Song, Ahram ;
Choi, Jaewan ;
Han, Youkyung ;
Kim, Yongil .
REMOTE SENSING, 2018, 10 (11)
[48]   A Label Similarity Probability Filter for Hyperspectral Image Postclassification [J].
Sun, Weiwei ;
Yang, Gang ;
Ren, Kai ;
Peng, Jiangtao ;
Ge, Chiru ;
Meng, Xiangchao ;
Du, Qian .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :6897-6905
[49]  
Tong ZQ, 2018, INT C PATT RECOG, P1289, DOI 10.1109/ICPR.2018.8545471
[50]   Local Semantic Feature Aggregation-Based Transformer for Hyperspectral Image Classification [J].
Tu, Bing ;
Liao, Xiaolong ;
Li, Qianming ;
Peng, Yishu ;
Plaza, Antonio .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60