ADAPTIVE DETAIL INJECTION-BASED FEATURE PYRAMID NETWORK FOR PAN-SHARPENING

被引:2
作者
Sun, Yi [1 ,2 ]
Zhang, Yuanlin [1 ]
Yuan, Yuan [1 ]
机构
[1] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Shaanxi, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Shaanxi, Peoples R China
来源
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2022年
关键词
Pan-sharpening; image fusion; detail injection; feature pyramid; detail perception; QUALITY;
D O I
10.1109/ICIP46576.2022.9897212
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many remarkable works have been proposed to deal with distortions problems in image fusion to date. However, the spectral distortion and the spatial distortion cannot always be well addressed at the same time. To deal with this, we propose an Adaptive Feature Pyramid Network (AFPN) to efficiently embed an Adaptive Detail Injection (ADI) module at different scales. Feature-domain injection gains are proposed in the ADI module to adaptively modulate spatial information and guide a refined detail injection. Furthermore, we propose a texture loss function to further guide our model to learn detail perception in each band. Experiments on QuickBird and GaoFen-1 datasets show that our method achieves superior performance and produces visually pleasing fusion images. Our code is available at https://github.com/yisun98/AFPN.
引用
收藏
页码:1646 / 1650
页数:5
相关论文
共 20 条
[1]   Improving component substitution pansharpening through multivariate regression of MS plus Pan data [J].
Aiazzi, Bruno ;
Baronti, Stefano ;
Selva, Massimo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (10) :3230-3239
[2]   An Efficient Pan Sharpening via Texture Based Dictionary Learning and Sparse Representation [J].
Ayas, Selen ;
Gormus, Esra Tunc ;
Ekinci, Murat .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (07) :2448-2460
[3]   Two Stages Pan-Sharpening Details Injection Approach Based on Very Deep Residual Networks [J].
Benzenati, Tayeb ;
Kallel, Abdelaziz ;
Kessentini, Yousri .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (06) :4984-4992
[4]   Super-Resolution-Guided Progressive Pansharpening Based on a Deep Convolutional Neural Network [J].
Cai, Jiajun ;
Huang, Bo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (06) :5206-5220
[5]   Detail Injection-Based Deep Convolutional Neural Networks for Pansharpening [J].
Deng, Liang-Jian ;
Vivone, Gemine ;
Jin, Cheng ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (08) :6995-7010
[6]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[7]  
Fang S, 2020, IEEE IMAGE PROC, P453, DOI [10.1109/icip40778.2020.9191153, 10.1109/ICIP40778.2020.9191153]
[8]   PSGAN: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening [J].
Liu, Qingjie ;
Zhou, Huanyu ;
Xu, Qizhi ;
Liu, Xiangyu ;
Wang, Yunhong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (12) :10227-10242
[9]   Pansharpening by Convolutional Neural Networks [J].
Masi, Giuseppe ;
Cozzolino, Davide ;
Verdoliva, Luisa ;
Scarpa, Giuseppe .
REMOTE SENSING, 2016, 8 (07)
[10]   A Large-Scale Benchmark Data Set for Evaluating Pansharpening Performance: Overview and Implementation [J].
Meng, Xiangchao ;
Xiong, Yiming ;
Shao, Feng ;
Shen, Huanfeng ;
Sun, Weiwei ;
Yang, Gang ;
Yuan, Qiangqiang ;
Fu, Randi ;
Zhang, Hongyan .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2021, 9 (01) :18-52