A Multi-Stage Progressive Pansharpening Network Based on Detail Injection with Redundancy Reduction

被引:2
作者
Wen, Xincan [1 ,2 ]
Ma, Hongbing [1 ,2 ,3 ]
Li, Liangliang [4 ]
机构
[1] Xinjiang Univ, Sch Comp Sci & Technol, Urumqi 830046, Peoples R China
[2] Xinjiang Univ, Key Lab Signal Detect & Proc, Urumqi 830046, Peoples R China
[3] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[4] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
关键词
deep learning; pansharpening; feature extraction; image reconstruction; multi-stage; FUSION; IMAGES;
D O I
10.3390/s24186039
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In the field of remote sensing image processing, pansharpening technology stands as a critical advancement. This technology aims to enhance multispectral images that possess low resolution by integrating them with high-spatial-resolution panchromatic images, ultimately producing multispectral images with high resolution that are abundant in both spatial and spectral details. Thus, there remains potential for improving the quality of both the spectral and spatial domains of the fused images based on deep-learning-based pansharpening methods. This work proposes a new method for the task of pansharpening: the Multi-Stage Progressive Pansharpening Network with Detail Injection with Redundancy Reduction Mechanism (MSPPN-DIRRM). This network is divided into three levels, each of which is optimized for the extraction of spectral and spatial data at different scales. Particular spectral feature and spatial detail extraction modules are used at each stage. Moreover, a new image reconstruction module named the DRRM is introduced in this work; it eliminates both spatial and channel redundancy and improves the fusion quality. The effectiveness of the proposed model is further supported by experimental results using both simulated data and real data from the QuickBird, GaoFen1, and WorldView2 satellites; these results show that the proposed model outperforms deep-learning-based methods in both visual and quantitative assessments. Among various evaluation metrics, performance improves by 0.92-18.7% compared to the latest methods.
引用
收藏
页数:24
相关论文
共 63 条
[21]   Pansharpening via Detail Injection Based Convolutional Neural Networks [J].
He, Lin ;
Rao, Yizhou ;
Li, Jun ;
Chanussot, Jocelyn ;
Plaza, Antonio ;
Zhu, Jiawei ;
Li, Bo .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (04) :1188-1204
[22]   Squeeze-and-Excitation Networks [J].
Hu, Jie ;
Shen, Li ;
Albanie, Samuel ;
Sun, Gang ;
Wu, Enhua .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (08) :2011-2023
[23]  
Jin ZR, 2022, AAAI CONF ARTIF INTE, P1113
[24]   Remote Sensing Pansharpening by Full-Depth Feature Fusion [J].
Jin, Zi-Rong ;
Zhuo, Yu-Wei ;
Zhang, Tian-Jing ;
Jin, Xiao-Xu ;
Jing, Shuaiqi ;
Deng, Liang-Jian .
REMOTE SENSING, 2022, 14 (03)
[25]   Indusion: Fusion of multispectral and panchromatic images using the induction scaling technique [J].
Khan, Muhammad Murtaza ;
Chanussot, Jocelyn ;
Condat, Laurent ;
Montanvert, Annick .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2008, 5 (01) :98-102
[26]   Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networks [J].
Lai, Wei-Sheng ;
Huang, Jia-Bin ;
Ahuja, Narendra ;
Yang, Ming-Hsuan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (11) :2599-2613
[27]   MHANet: A Multiscale Hierarchical Pansharpening Method With Adaptive Optimization [J].
Lei, Dajiang ;
Huang, Jin ;
Zhang, Liping ;
Li, Weisheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[28]   MPEFNet: Multilevel Progressive Enhancement Fusion Network for Pansharpening [J].
Li, He ;
Nie, Rencan ;
Cao, Jinde ;
Jin, Biaojian ;
Han, Yao .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 :9573-9583
[29]   SCConv: Spatial and Channel Reconstruction Convolution for Feature Redundancy [J].
Li, Jiafeng ;
Wen, Ying ;
He, Lianghua .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :6153-6162
[30]   Change Detection from SAR Images Based on Convolutional Neural Networks Guided by Saliency Enhancement [J].
Li, Liangliang ;
Ma, Hongbing ;
Jia, Zhenhong .
REMOTE SENSING, 2021, 13 (18)