A generative model method for unsupervised multispectral image fusion in remote sensing

被引:12
作者
Azarang, Arian [1 ]
Kehtarnavaz, Nasser [1 ]
机构
[1] Univ Texas Dallas, Dept Elect & Comp Engn, Richardson, TX 75083 USA
关键词
Generative model; Image fusion in remote sensing; Deep learning; PAN-SHARPENING METHOD; COMPONENT SUBSTITUTION; PCA;
D O I
10.1007/s11760-021-01950-1
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents a generative model method for multispectral image fusion in remote sensing which involves training without supervision. This method eases the supervision of learning and also uses a multi-objective loss function to achieve image fusion. The loss function used incorporates both spectral and spatial distortions. Two discriminators are designed to minimize the spectral and spatial distortions of the generative output. Extensive experimentations are conducted using three public domain datasets. The comparison results across four reduced-resolution and three full-resolution objective metrics show the superiority of the developed method over several recently developed methods.
引用
收藏
页码:63 / 71
页数:9
相关论文
共 37 条
[1]   Improving component substitution pansharpening through multivariate regression of MS plus Pan data [J].
Aiazzi, Bruno ;
Baronti, Stefano ;
Selva, Massimo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (10) :3230-3239
[2]   A Regularized Model-Based Optimization Framework for Pan-Sharpening [J].
Aly, Hussein A. ;
Sharma, Gaurav .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (06) :2596-2608
[3]   Image fusion in remote sensing by multi-objective deep learning [J].
Azarang, Arian ;
Kehtarnavaz, Nasser .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2020, 41 (24) :9507-9524
[4]   Multispectral image fusion based on map estimation with improved detail [J].
Azarang, Arian ;
Kehtarnavaz, Nasser .
REMOTE SENSING LETTERS, 2020, 11 (08) :797-806
[5]   Convolutional Autoencoder-Based Multispectral Image Fusion [J].
Azarang, Arian ;
Manoochehri, Hafez E. ;
Kehtarnavaz, Nasser .
IEEE ACCESS, 2019, 7 :35673-35683
[6]   Application of fractional-order differentiation in multispectral image fusion [J].
Azarang, Arian ;
Ghassemian, Hassan .
REMOTE SENSING LETTERS, 2018, 9 (01) :91-100
[7]  
Azarang A, 2017, 2017 3RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND IMAGE ANALYSIS (IPRIA), P1, DOI 10.1109/PRIA.2017.7983017
[8]  
Azarang A, 2017, IRAN CONF ELECTR ENG, P1708, DOI 10.1109/IranianCEE.2017.7985325
[9]  
Bello JLG, 2020, IEEE IMAGE PROC, P908, DOI 10.1109/ICIP40778.2020.9190785
[10]   S3: A Spectral-Spatial Structure Loss for Pan-Sharpening Networks [J].
Choi, Jae-Seok ;
Kim, Yongwoo ;
Kim, Munchurl .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (05) :829-833