Single hyperspectral image super-resolution using a progressive upsampling deep prior network

被引:0
作者
Wang, Haijun [1 ]
Zheng, Wenli [1 ]
Wang, Yaowei [1 ]
Yang, Tengfei [2 ]
Zhang, Kaibing [3 ]
Shang, Youlin [1 ]
机构
[1] Henan Univ Sci & Technol, Sch Math & Stat, Luoyang 471000, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[3] Xian Polytech Univ, Sch Comp Sci, Xian 710048, Peoples R China
来源
ELECTRONIC RESEARCH ARCHIVE | 2024年 / 32卷 / 07期
基金
中国国家自然科学基金;
关键词
deep prior network; hyperspectral image super-resolution; progressive upsampling; deep; learning; spatial-spectral attention; FUSION;
D O I
10.3934/era.2024205
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Hyperspectral image super-resolution (SR) aims to enhance the spectral and spatial resolution of remote sensing images, enabling more accurate and detailed analysis of ground objects. However, hyperspectral images have high dimensional characteristics and complex spectral patterns. As a result, it is critical to effectively leverage the spatial non-local self-similarity and spectral correlation within hyperspectral images. To address this, we have proposed a novel single hyperspectral image SR method based on a progressive upsampling deep prior network. Specifically, we introduced the spatial-spectral attention fusion unit (S2AF) based on residual connections, in order to extract spatial and spectral information from hyperspectral images. Then we developed the group convolutional upsampling (GCU) to efficiently utilize the spatial and spectral prior information inherent in hyperspectral images. To address the challenges posed by the high dimensionality of hyperspectral images and limited training dataset, we implemented a parameter-sharing grouped convolutional upsampling framework within the GCU to ensure model stability and enhance performance. The experimental results on three benchmark datasets demonstrated that the proposed single hyperspectral image SR using a progressive upsampling deep prior network (PUDPN) method effectively improves the reconstruction quality of hyperspectral images and achieves promising performance.
引用
收藏
页码:4517 / 4542
页数:26
相关论文
共 47 条
[1]   Sparse Spatio-spectral Representation for Hyperspectral Image Super-resolution [J].
Akhtar, Naveed ;
Shafait, Faisal ;
Mian, Ajmal .
COMPUTER VISION - ECCV 2014, PT VII, 2014, 8695 :63-78
[2]   UAV-hyperspectral imaging of spectrally complex environments [J].
Banerjee, Bikram Pratap ;
Raval, Simit ;
Cullen, P. J. .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2020, 41 (11) :4136-4159
[3]   Hyperspectral Remote Sensing Data Analysis and Future Challenges [J].
Bioucas-Dias, Jose M. ;
Plaza, Antonio ;
Camps-Valls, Gustavo ;
Scheunders, Paul ;
Nasrabadi, Nasser M. ;
Chanussot, Jocelyn .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2013, 1 (02) :6-36
[4]  
Chen S., arXiv
[5]   Hyperspectral Image Super-Resolution via Subspace-Based Low Tensor Multi-Rank Regularization [J].
Dian, Renwei ;
Li, Shutao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (10) :5135-5146
[6]   Hyperspectral image super-resolution via non-local sparse tensor factorization [J].
Dian, Renwei ;
Fang, Leyuan ;
Li, Shutao .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3862-3871
[7]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[8]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[9]   Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation [J].
Dong, Weisheng ;
Fu, Fazuo ;
Shi, Guangming ;
Cao, Xun ;
Wu, Jinjian ;
Li, Guangyu ;
Li, Xin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (05) :2337-2352
[10]   Self-Similarity Constrained Sparse Representation for Hyperspectral Image Super-Resolution [J].
Han, Xian-Hua ;
Shi, Boxin ;
Zheng, Yinqiang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (11) :5625-5637