Exploring the Spectral Prior for Hyperspectral Image Super-Resolution

被引:6
作者
Hu, Qian [1 ]
Wang, Xinya [1 ]
Jiang, Junjun [2 ]
Zhang, Xiao-Ping [3 ]
Ma, Jiayi [1 ]
机构
[1] Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China
[2] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
[3] Tsinghua Univ, Tsinghua Berkeley Shenzhen Inst, Tsinghua Shenzhen Int Grad Sch, Shenzhen Ubiquitous Data Enabling Key Lab, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
Superresolution; Hyperspectral imaging; Spatial resolution; Image reconstruction; Three-dimensional displays; Convolution; Correlation; Hyperspectral image; super-resolution; non-local; spectral unmixing;
D O I
10.1109/TIP.2024.3460470
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, many single hyperspectral image super-resolution methods have emerged to enhance the spatial resolution of hyperspectral images without hardware modification. However, existing methods typically face two significant challenges. First, they struggle to handle the high-dimensional nature of hyperspectral data, which often results in high computational complexity and inefficient information utilization. Second, they have not fully leveraged the abundant spectral information in hyperspectral images. To address these challenges, we propose a novel hyperspectral super-resolution network named SNLSR, which transfers the super-resolution problem into the abundance domain. Our SNLSR leverages a spatial preserve decomposition network to estimate the abundance representations of the input hyperspectral image. Notably, the network acknowledges and utilizes the commonly overlooked spatial correlations of hyperspectral images, leading to better reconstruction performance. Then, the estimated low-resolution abundance is super-resolved through a spatial spectral attention network, where the informative features from both spatial and spectral domains are fully exploited. Considering that the hyperspectral image is highly spectrally correlated, we customize a spectral-wise non-local attention module to mine similar pixels along spectral dimension for high-frequency detail recovery. Extensive experiments demonstrate the superiority of our method over other state-of-the-art methods both visually and metrically. Our code is publicly available at https://github.com/HuQ1an/SNLSR.
引用
收藏
页码:5260 / 5272
页数:13
相关论文
共 54 条
[1]   Super-resolution reconstruction of hyperspectral images [J].
Akgun, T ;
Altunbasak, Y ;
Mersereau, RM .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2005, 14 (11) :1860-1875
[2]   Learning A Cascaded Non-Local Residual Network for Super-resolving Blurry Images [J].
Bai, Haoran ;
Cheng, Songsheng ;
Tang, Jinhui ;
Pan, Jinshan .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :223-232
[3]   MST plus plus : Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstruction [J].
Cai, Yuanhao ;
Lin, Jing ;
Lin, Zudi ;
Wang, Haoqian ;
Zhang, Yulun ;
Pfister, Hanspeter ;
Timofte, Radu ;
Van Gool, Luc .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, :744-754
[4]   GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond [J].
Cao, Yue ;
Xu, Jiarui ;
Lin, Stephen ;
Wei, Fangyun ;
Hu, Han .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :1971-1980
[5]   Model-Guided Deep Hyperspectral Image Super-Resolution [J].
Dong, Weisheng ;
Zhou, Chen ;
Wu, Fangfang ;
Wu, Jinjian ;
Shi, Guangming ;
Li, Xin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 (30) :5754-5768
[6]   Learning Deep Resonant Prior for Hyperspectral Image Super-Resolution [J].
Gong, Zhaori ;
Wang, Nannan ;
Cheng, De ;
Jiang, Xinrui ;
Xin, Jingwei ;
Yang, Xi ;
Gao, Xinbo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[7]  
Guo J. Xin, 2023, IEEE Trans. Geosci. Remote Sens., V61
[8]  
Guo J. Xin, 2022, IEEE Trans. Geosci. RemoteSens., V60
[9]   Hyperspectral Image Super-Resolution by Spectral Difference Learning and Spatial Error Correction [J].
Hu, Jing ;
Li, Yunsong ;
Xie, Weiying .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (10) :1825-1829
[10]   A comparative study of spatial approaches for urban mapping using hyperspectral ROSIS images over Pavia City, northern Italy [J].
Huang, Xin ;
Zhang, Liangpei .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2009, 30 (12) :3205-3221