Multispectral and hyperspectral image fusion in remote sensing: A survey

被引:144
作者
Vivone, Gemine [1 ]
机构
[1] CNR, Inst Methodol Environm Anal, I-85050 Tito, Italy
关键词
Multispectral imaging; Hyperspectral imaging; Pansharpening; Machine learning; Sparse representation; Low-rank; Tensors; Super-resolution; Image fusion; Remote sensing; SOIL ORGANIC-CARBON; TENSOR FACTORIZATION; VEGETATION INDEXES; MULTISCALE FUSION; ENMAP DATA; SUPERRESOLUTION; RESOLUTION; HYPERION; NETWORK; QUALITY;
D O I
10.1016/j.inffus.2022.08.032
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The fusion of multispectral (MS) and hyperspectral (HS) images has recently been put in the spotlight. The combination of high spatial resolution MS images with HS data showing a lower spatial resolution but a more accurate spectral resolution is the aim of these techniques. This survey presents a deep review of the literature designed for students and professionals who want to know more about the topic. The basis aspects of the MS and HS image fusion are presented and the related approaches are classified into three different classes (pansharpening-based, decomposition-based, and machine learning-based). The ending part of this survey is devoted to the description of widely used datasets for this task and the performance assessment problem, even describing open issues and drawing guidelines for future research.
引用
收藏
页码:405 / 417
页数:13
相关论文
共 115 条
[31]   Self-Similarity Constrained Sparse Representation for Hyperspectral Image Super-Resolution [J].
Han, Xian-Hua ;
Shi, Boxin ;
Zheng, Yinqiang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (11) :5625-5637
[32]   Hyperspectral and Multispectral Image Fusion Using Cluster-Based Multi-Branch BP Neural Networks [J].
Han, Xiaolin ;
Yu, Jing ;
Luo, Jiqiang ;
Sun, Weidong .
REMOTE SENSING, 2019, 11 (10)
[33]   Determination of robust spectral features for identification of urban surface materials in hyperspectral remote sensing data [J].
Heiden, Uta ;
Segl, Karl ;
Roessner, Sigrid ;
Kaufmann, Hermann .
REMOTE SENSING OF ENVIRONMENT, 2007, 111 (04) :537-552
[34]   Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks [J].
Hu, Jin-Fan ;
Huang, Ting-Zhu ;
Deng, Liang-Jian ;
Jiang, Tai-Xiang ;
Vivone, Gemine ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (12) :7251-7265
[35]   Spatial and Spectral Image Fusion Using Sparse Matrix Factorization [J].
Huang, Bo ;
Song, Huihui ;
Cui, Hengbin ;
Peng, Jigen ;
Xu, Zongben .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (03) :1693-1704
[36]   Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery [J].
Jiang, Junjun ;
Sun, He ;
Liu, Xianming ;
Ma, Jiayi .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 :1082-1096
[37]   Hyperspectral Super-Resolution: A Coupled Tensor Factorization Approach [J].
Kanatsoulis, Charilaos, I ;
Fu, Xiao ;
Sidiropoulos, Nicholas D. ;
Ma, Wing-Kin .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2018, 66 (24) :6503-6517
[38]  
Kawakami R, 2011, PROC CVPR IEEE
[39]   Pansharpening Quality Assessment Using the Modulation Transfer Functions of Instruments [J].
Khan, Muhammad Murtaza ;
Alparone, Luciano ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2009, 47 (11) :3880-3891
[40]   THIRD-ORDER TENSORS AS OPERATORS ON MATRICES: A THEORETICAL AND COMPUTATIONAL FRAMEWORK WITH APPLICATIONS IN IMAGING [J].
Kilmer, Misha E. ;
Braman, Karen ;
Hao, Ning ;
Hoover, Randy C. .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2013, 34 (01) :148-172