Spectral-Cascaded Diffusion Model for Remote Sensing Image Spectral Super-Resolution

被引:2
|
作者
Chen, Bowen [1 ,2 ,3 ]
Liu, Liqin [1 ,3 ,4 ,6 ]
Liu, Chenyang [1 ,3 ,4 ,6 ]
Zou, Zhengxia [3 ,5 ]
Shi, Zhenwei [1 ,2 ,3 ]
机构
[1] Beihang Univ, Image Proc Ctr, Sch Astronaut, Beijing 100191, Peoples R China
[2] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[3] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
[4] Beihang Univ, Image Proc Ctr, Sch Astronaut, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[5] Beihang Univ, Sch Astronaut, Dept Guidance Nav & Control, Beijing 100191, Peoples R China
[6] Beihang Univ, Shen Yuan Honors Coll, Beijing 100191, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Cascade-based methods; diffusion model; remote sensing; spectral super-resolution; NETWORK;
D O I
10.1109/TGRS.2024.3450874
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral remote sensing images (HSIs) have unique advantages in urban planning, precision agriculture, and ecology monitoring since they provide rich spectral information. However, hyperspectral imaging usually suffers from low spatial resolution and high cost, which limits the wide application of hyperspectral data. Spectral super-resolution provides a promising solution to acquire hyperspectral images with high spatial resolution and low cost, taking RGB images as input. Existing spectral super-resolution methods utilize neural networks following a single-shot framework, i.e., final results are obtained by one-stage spectral super-resolution, which struggles to capture and model the complex relationships between spectral bands. In this article, we propose a spectral-cascaded diffusion model (SCDM), a coarse-to-fine spectral super-resolution method based on the diffusion model. The diffusion model fits the real data distribution through stepwise denoising, which is naturally suitable for modeling rich spectral information. We cascade the diffusion model in the spectral dimension to gradually refine the spectral trends and enrich spectral information of the pixels. The cascade solves the highly ill-posed problem of spectral super-resolution step-by-step, mitigating the inaccuracies of previous single-shot approaches. To better utilize the potential of the diffusion model for spectral super-resolution, we design image condition mixture guidance (ICMG) to enhance the guidance of image conditions and progressive dynamic truncation (PDT) to limit cumulative errors in the sampling process. Experimental results demonstrate that our method achieves state-of-the-art performance in spectral super-resolution. Codes can be found at https://github.com/Mr-Bamboo/SCDM.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] A spectral and spatial transformer for hyperspectral remote sensing image super-resolution
    Wang, Bingqian
    Chen, Jianhua
    Wang, Huajun
    Tang, Yipeng
    Chen, Jiongling
    Jiang, Ye
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2024, 17 (01)
  • [2] Multifiltering MLP for Spectral Super-Resolution With Remote Sensing Image Verification
    Li, Gong
    Leng, Yihong
    Zhang, Zhiyuan
    Wan, Gang
    Li, Jiaojiao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 16646 - 16658
  • [3] DsTer: A dense spectral transformer for remote sensing spectral super-resolution
    He, Jiang
    Yuan, Qiangqiang
    Li, Jie
    Xiao, Yi
    Liu, Xinxin
    Zou, Yun
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 109
  • [4] SPECTRAL AND SPATIAL SUPER-RESOLUTION METHOD FOR EARTH REMOTE SENSING IMAGE FUSION
    Belov, A. M.
    Denisova, A. Y.
    COMPUTER OPTICS, 2018, 42 (05) : 855 - 863
  • [5] CNN based spectral super-resolution of remote sensing images
    Arun, P., V
    Buddhiraju, K. M.
    Porwal, A.
    Chanussot, J.
    SIGNAL PROCESSING, 2020, 169
  • [6] EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution
    Xiao, Yi
    Yuan, Qiangqiang
    Jiang, Kui
    He, Jiang
    Jin, Xianyu
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [7] A Spectral Diffusion Prior for Unsupervised Hyperspectral Image Super-Resolution
    Liu, Jianjun
    Wu, Zebin
    Xiao, Liang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [8] Neural Operator for Planetary Remote Sensing Super-Resolution with Spectral Learning
    Zhao, Hui-Jia
    Lu, Jie
    Guo, Wen-Xiu
    Lu, Xiao-Ping
    MATHEMATICS, 2024, 12 (22)
  • [9] A Conditional Diffusion Model With Fast Sampling Strategy for Remote Sensing Image Super-Resolution
    Meng, Fanen
    Chen, Yijun
    Jing, Haoyu
    Zhang, Laifu
    Yan, Yiming
    Ren, Yingchao
    Wu, Sensen
    Feng, Tian
    Liu, Renyi
    Du, Zhenhong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [10] Enhancing Remote Sensing Image Super-Resolution with Efficient Hybrid Conditional Diffusion Model
    Han, Lintao
    Zhao, Yuchen
    Lv, Hengyi
    Zhang, Yisa
    Liu, Hailong
    Bi, Guoling
    Han, Qing
    REMOTE SENSING, 2023, 15 (13)