Spectral-Cascaded Diffusion Model for Remote Sensing Image Spectral Super-Resolution

被引:2
|
作者
Chen, Bowen [1 ,2 ,3 ]
Liu, Liqin [1 ,3 ,4 ,6 ]
Liu, Chenyang [1 ,3 ,4 ,6 ]
Zou, Zhengxia [3 ,5 ]
Shi, Zhenwei [1 ,2 ,3 ]
机构
[1] Beihang Univ, Image Proc Ctr, Sch Astronaut, Beijing 100191, Peoples R China
[2] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[3] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
[4] Beihang Univ, Image Proc Ctr, Sch Astronaut, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[5] Beihang Univ, Sch Astronaut, Dept Guidance Nav & Control, Beijing 100191, Peoples R China
[6] Beihang Univ, Shen Yuan Honors Coll, Beijing 100191, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Cascade-based methods; diffusion model; remote sensing; spectral super-resolution; NETWORK;
D O I
10.1109/TGRS.2024.3450874
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral remote sensing images (HSIs) have unique advantages in urban planning, precision agriculture, and ecology monitoring since they provide rich spectral information. However, hyperspectral imaging usually suffers from low spatial resolution and high cost, which limits the wide application of hyperspectral data. Spectral super-resolution provides a promising solution to acquire hyperspectral images with high spatial resolution and low cost, taking RGB images as input. Existing spectral super-resolution methods utilize neural networks following a single-shot framework, i.e., final results are obtained by one-stage spectral super-resolution, which struggles to capture and model the complex relationships between spectral bands. In this article, we propose a spectral-cascaded diffusion model (SCDM), a coarse-to-fine spectral super-resolution method based on the diffusion model. The diffusion model fits the real data distribution through stepwise denoising, which is naturally suitable for modeling rich spectral information. We cascade the diffusion model in the spectral dimension to gradually refine the spectral trends and enrich spectral information of the pixels. The cascade solves the highly ill-posed problem of spectral super-resolution step-by-step, mitigating the inaccuracies of previous single-shot approaches. To better utilize the potential of the diffusion model for spectral super-resolution, we design image condition mixture guidance (ICMG) to enhance the guidance of image conditions and progressive dynamic truncation (PDT) to limit cumulative errors in the sampling process. Experimental results demonstrate that our method achieves state-of-the-art performance in spectral super-resolution. Codes can be found at https://github.com/Mr-Bamboo/SCDM.
引用
收藏
页数:14
相关论文
共 50 条
  • [11] Diffusion Model with Detail Complement for Super-Resolution of Remote Sensing
    Liu, Jinzhe
    Yuan, Zhiqiang
    Pan, Zhaoying
    Fu, Yiqun
    Liu, Li
    Lu, Bin
    REMOTE SENSING, 2022, 14 (19)
  • [12] Algorithm for Spectral-Spatial Remote Sensing Image Super-Resolution: Multi-Sensor Case
    Belov, A. M.
    Denisova, A. Y.
    TENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2018), 2019, 11069
  • [13] STANet: A Hybrid Spectral and Texture Attention Pyramid Network for Spectral Super-Resolution of Remote Sensing Images
    Sun, Weiwei
    Wang, Yao
    Liu, Weiwei
    Shao, Shuyao
    Yang, Songling
    Yang, Gang
    Ren, Kai
    Chen, Binjie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [14] Spectral Bayesian Uncertainty for Image Super-resolution
    Liu, Tao
    Cheng, Jun
    Tan, Shan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18166 - 18175
  • [15] RSSRDiff: An Effective Diffusion Probability Model with Attention for Single Remote Sensing Image Super-Resolution
    Wei, Tian
    Zhang, Hanyi
    Xu, Jin
    Zhao, Jing
    Shen, Fei
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT X, ICIC 2024, 2024, 14871 : 392 - 403
  • [16] Remote Sensing Image Super-Resolution Algorithm Based on LR Coding Network and Diffusion Model
    Xu, Xiaoyang
    Zhang, Mengfei
    Computer Engineering and Applications, 2024, 60 (22) : 271 - 281
  • [17] A Diffusion Model-Assisted Multiscale Spectral Attention Network for Hyperspectral Image Super-Resolution
    He, Kaiqi
    Cai, Yiheng
    Peng, Shengjun
    Tan, Meiling
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 8612 - 8625
  • [18] SPECTRAL SUPER-RESOLUTION FOR MULTISPECTRAL IMAGE BASED ON SPECTRAL AND SPATIAL STRATEGIES
    Yi, Chen
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 851 - 854
  • [19] Efficient Remote Sensing Image Super-Resolution via Lightweight Diffusion Models
    An, Tai
    Xue, Bin
    Huo, Chunlei
    Xiang, Shiming
    Pan, Chunhong
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [20] MambaFormerSR: A Lightweight Model for Remote-Sensing Image Super-Resolution
    Zhi, Ruicong
    Fan, Xiaopei
    Shi, Jingye
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21