CDFAN: Cross-Domain Fusion Attention Network for Pansharpening

被引:0
作者
Ding, Jinting [1 ]
Xu, Honghui [2 ]
Zhou, Shengjun [3 ]
机构
[1] Hangzhou City Univ, Sch Informat & Elect Engn, Hangzhou 310015, Peoples R China
[2] Zhejiang Univ Technol, Sch Comp Sci & Technol, Hangzhou 310023, Peoples R China
[3] Zhejiang Acad Agr Sci, Hangzhou 310021, Peoples R China
关键词
remote sensing; pansharpening; discrete wavelet transform; attention; information theory; mutual information; IMAGE FUSION; TRANSFORMER;
D O I
10.3390/e27060567
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Pansharpening provides a computational solution to the resolution limitations of imaging hardware by enhancing the spatial quality of low-resolution hyperspectral (LRMS) images using high-resolution panchromatic (PAN) guidance. From an information-theoretic perspective, the task involves maximizing the mutual information between PAN and LRMS inputs while minimizing spectral distortion and redundancy in the fused output. However, traditional spatial-domain methods often fail to preserve high-frequency texture details, leading to entropy degradation in the resulting images. On the other hand, frequency-based approaches struggle to effectively integrate spatial and spectral cues, often neglecting the underlying information content distributions across domains. To address these shortcomings, we introduce a novel architecture, termed the Cross-Domain Fusion Attention Network (CDFAN), specifically designed for the pansharpening task. CDFAN is composed of two core modules: the Multi-Domain Interactive Attention (MDIA) module and the Spatial Multi-Scale Enhancement (SMCE) module. The MDIA module utilizes discrete wavelet transform (DWT) to decompose the PAN image into frequency sub-bands, which are then employed to construct attention mechanisms across both wavelet and spatial domains. Specifically, wavelet-domain features are used to formulate query vectors, while key features are derived from the spatial domain, allowing attention weights to be computed over multi-domain representations. This design facilitates more effective fusion of spectral and spatial cues, contributing to superior reconstruction of high-resolution multispectral (HRMS) images. Complementing this, the SMCE module integrates multi-scale convolutional pathways to reinforce spatial detail extraction at varying receptive fields. Additionally, an Expert Feature Compensator is introduced to adaptively balance contributions from different scales, thereby optimizing the trade-off between local detail preservation and global contextual understanding. Comprehensive experiments conducted on standard benchmark datasets demonstrate that CDFAN achieves notable improvements over existing state-of-the-art pansharpening methods, delivering enhanced spectral-spatial fidelity and producing images with higher perceptual quality.
引用
收藏
页数:24
相关论文
共 65 条
[1]   Full scale assessment of pansharpening methods and data products [J].
Aiazzi, B. ;
Alparone, L. ;
Baronti, S. ;
Carla, R. ;
Garzelli, A. ;
Santurri, L. .
IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XX, 2014, 9244
[2]   Improving component substitution pansharpening through multivariate regression of MS plus Pan data [J].
Aiazzi, Bruno ;
Baronti, Stefano ;
Selva, Massimo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (10) :3230-3239
[3]   Lossless and Near-Lossless Compression Algorithms for Remotely Sensed Hyperspectral Images [J].
Altamimi, Amal ;
Ben Youssef, Belgacem .
ENTROPY, 2024, 26 (04)
[4]   HyperTransformer: A Textural and Spectral Feature Fusion Transformer for Pansharpening [J].
Bandara, Wele Gedara Chaminda ;
Patel, Vishal M. .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :1757-1767
[5]  
Chen ZX, 2022, PROCEEDINGS OF THE THIRTY-FIRST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2022, P841
[6]   A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement [J].
Choi, Jaewan ;
Yu, Kiyun ;
Kim, Yongil .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (01) :295-309
[7]   SDRCNN: A Single-Scale Dense Residual Connected Convolutional Neural Network for Pansharpening [J].
Fang, Yuan ;
Cai, Yuanzhi ;
Fan, Lei .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 :6325-6338
[8]   Change Detection on Remote Sensing Images Using Dual-Branch Multilevel Intertemporal Network [J].
Feng, Yuchao ;
Jiang, Jiawei ;
Xu, Honghui ;
Zheng, Jianwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[9]   Multispectral Image Pan-Sharpening Guided by Component Substitution Model [J].
Gao, Huiling ;
Li, Shutao ;
Li, Jun ;
Dian, Renwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[10]   Hypercomplex Quality Assessment of Multi/Hyperspectral Images [J].
Garzelli, Andrea ;
Nencini, Filippo .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) :662-665