PAN-Guided Band-Aware Multi-Spectral Feature Enhancement for Pan-Sharpening

被引:18
作者
Zhou, Man [1 ]
Yan, Keyu [1 ]
Fu, Xueyang [3 ]
Liu, Aiping [3 ]
Xie, Chengjun [2 ]
机构
[1] Univ Sci & Technol China, Hefei 230026, Peoples R China
[2] Chinese Acad Sci, Inst Intelligent Machines, Hefei Inst Phys Sci, Intelligent Agr Engn Lab Anhui Prov, Hefei 230031, Peoples R China
[3] Univ Sci & Technol China, Dept Automatic, Hefei 230026, Peoples R China
基金
中国国家自然科学基金;
关键词
Band-aware multi-spectral feature modulation; multi-focus feature fusion; pan-sharpening; IMAGE FUSION;
D O I
10.1109/TCI.2023.3248956
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the physical hardware limits, multi-spectral (MS) images often suffer from low-spatial resolution, challenging their practical utility in real applications. Therefore, pan-sharpening technology has been widely explored as a popular tool to generate images with both high-spatial and high-spectral resolutions by integrating PAN and MS images. In this paper, we propose an effective pan-sharpening network, which consists of two core designs: a PAN-guided band-aware multi-spectral feature enhancement module and a multi-focus feature fusion module. To be specific, the former exploits the PAN features to perform band-aware multi-spectral feature modulation and selectively enhance the information of each spectral band while the latter covers various convolution kernels to extract multi-scale features, benefiting the fusion performance of the remote sensing scene. Equipped with the above core modules, our proposed framework is capable of achieving the best performance when compared with existing state-of-the-art Pan-sharpening methods over multiple satellite datasets. Extensive ablation studies are additionally conducted to verify the effectiveness of our key components both visually and quantitatively.
引用
收藏
页码:238 / 249
页数:12
相关论文
共 36 条
[1]   Improving component substitution pansharpening through multivariate regression of MS plus Pan data [J].
Aiazzi, Bruno ;
Baronti, Stefano ;
Selva, Massimo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (10) :3230-3239
[2]   A variational model for P+XS image fusion [J].
Ballester, Coloma ;
Caselles, Vicent ;
Igual, Laura ;
Verdera, Joan ;
Rougé, Bernard .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2006, 69 (01) :43-58
[3]   Analysis of the Effects of Pansharpening in Change Detection on VHR Images [J].
Bovolo, Francesca ;
Bruzzone, Lorenzo ;
Capobianco, Luca ;
Garzelli, Andrea ;
Marchesi, Silvia ;
Nencini, Filippo .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2010, 7 (01) :53-57
[4]   Super-Resolution-Guided Progressive Pansharpening Based on a Deep Convolutional Neural Network [J].
Cai, Jiajun ;
Huang, Bo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (06) :5206-5220
[5]  
CARPER WJ, 1990, PHOTOGRAMM ENG REM S, V56, P459
[6]  
CHAVEZ PS, 1989, PHOTOGRAMM ENG REM S, V55, P339
[7]   SIRF: Simultaneous Satellite Image Registration and Fusion in a Unified Framework [J].
Chen, Chen ;
Li, Yeqing ;
Liu, Wei ;
Huang, Junzhou .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (11) :4213-4224
[8]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[9]   MULTISENSOR IMAGE FUSION TECHNIQUES IN REMOTE-SENSING [J].
EHLERS, M .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 1991, 46 (01) :19-30
[10]   A Variational Pan-Sharpening with Local Gradient Constraints [J].
Fu, Xueyang ;
Lin, Zihuang ;
Huang, Yue ;
Ding, Xinghao .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :10257-10266