RSCNet: A Residual Self-Calibrated Network for Hyperspectral Image Change Detection

被引:34
作者
Wang, Liguo [1 ]
Wang, Lifeng [1 ]
Wang, Qunming [2 ]
Bruzzone, Lorenzo [3 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150000, Peoples R China
[2] Tongji Univ, Coll Surveying & Geoinformat, Shanghai 200092, Peoples R China
[3] Univ Trento, Dept Informat Engn & Comp Sci, I-38123 Trento, Italy
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Task analysis; Convolution; Convolutional neural networks; Residual neural networks; Hyperspectral imaging; Tensors; Change detection (CD); deep learning; hyperspectral images (HSIs); remote sensing; residual network (ResNet); self-calibrated convolution (SCConv); CLASSIFICATION; ARCHITECTURE;
D O I
10.1109/TGRS.2022.3177478
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep learning-based methods (e.g., convolutional neural network (CNN)-based methods) have shown increasing potential in hyperspectral image (HSI) change detection (CD). However, the recent advances in CNN-based methods in HSI CD tasks are mostly devoted to designing more complex architectures or adding additional hand-designed blocks. This increases the number of parameters making model training difficult. In this article, we propose an end-to-end residual self-calibrated network (RSCNet) to increase the accuracy of HSI CD. To fully exploit the spatial information, the proposed RSCNet method adaptively builds interspatial and interspectral dependencies around each spatial location with fewer extra parameters and reduced complexity. Moreover, the introduced self-calibrated convolution (SCConv) helps to generate more discriminative representations by heterogeneously exploiting convolutional filters nested in the convolutional layer. The designed RSC module can explicitly incorporate richer information by introducing response calibration operation. The experiments on four bitemporal HSI datasets demonstrated that the proposed RSCNet method is more accurate than ten widely used benchmark methods.
引用
收藏
页数:17
相关论文
共 56 条
[1]   Hyperspectral Imaging: A Review on UAV-Based Sensors, Data Processing and Applications for Agriculture and Forestry [J].
Adao, Telmo ;
Hruska, Jonas ;
Padua, Luis ;
Bessa, Jose ;
Peres, Emanuel ;
Morais, Raul ;
Sousa, Joaquim Joao .
REMOTE SENSING, 2017, 9 (11)
[2]   Deep Learning for Classification of Hyperspectral Data [J].
Audebert, Nicolas ;
Le Saux, Bertrand ;
Lefevre, Sebastien .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2019, 7 (02) :159-173
[3]   A split-based approach to unsupervised change detection in large-size multitemporal images: Application to tsunami-damage assessment [J].
Bovolo, Francesca ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (06) :1658-1670
[4]   GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond [J].
Cao, Yue ;
Xu, Jiarui ;
Lin, Stephen ;
Wei, Fangyun ;
Hu, Han .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :1971-1980
[5]   Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks [J].
Chen, Yushi ;
Jiang, Hanlu ;
Li, Chunyang ;
Jia, Xiuping ;
Ghamisi, Pedram .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (10) :6232-6251
[6]   Digital change detection methods in ecosystem monitoring: a review [J].
Coppin, P ;
Jonckheere, I ;
Nackaerts, K ;
Muys, B ;
Lambin, E .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2004, 25 (09) :1565-1596
[7]   When CNNs Meet Vision Transformer: A Joint Framework for Remote Sensing Scene Classification [J].
Deng, Peifang ;
Xu, Kejie ;
Huang, Hong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[8]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[9]   Res2Net: A New Multi-Scale Backbone Architecture [J].
Gao, Shang-Hua ;
Cheng, Ming-Ming ;
Zhao, Kai ;
Zhang, Xin-Yu ;
Yang, Ming-Hsuan ;
Torr, Philip .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) :652-662
[10]  
Glorot X., 2011, P 14 INT C ART INT S, V15, P315, DOI DOI 10.1177/1753193410395357