Spectral-Cascaded Diffusion Model for Remote Sensing Image Spectral Super-Resolution

被引:2
|
作者
Chen, Bowen [1 ,2 ,3 ]
Liu, Liqin [1 ,3 ,4 ,6 ]
Liu, Chenyang [1 ,3 ,4 ,6 ]
Zou, Zhengxia [3 ,5 ]
Shi, Zhenwei [1 ,2 ,3 ]
机构
[1] Beihang Univ, Image Proc Ctr, Sch Astronaut, Beijing 100191, Peoples R China
[2] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[3] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
[4] Beihang Univ, Image Proc Ctr, Sch Astronaut, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[5] Beihang Univ, Sch Astronaut, Dept Guidance Nav & Control, Beijing 100191, Peoples R China
[6] Beihang Univ, Shen Yuan Honors Coll, Beijing 100191, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Cascade-based methods; diffusion model; remote sensing; spectral super-resolution; NETWORK;
D O I
10.1109/TGRS.2024.3450874
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral remote sensing images (HSIs) have unique advantages in urban planning, precision agriculture, and ecology monitoring since they provide rich spectral information. However, hyperspectral imaging usually suffers from low spatial resolution and high cost, which limits the wide application of hyperspectral data. Spectral super-resolution provides a promising solution to acquire hyperspectral images with high spatial resolution and low cost, taking RGB images as input. Existing spectral super-resolution methods utilize neural networks following a single-shot framework, i.e., final results are obtained by one-stage spectral super-resolution, which struggles to capture and model the complex relationships between spectral bands. In this article, we propose a spectral-cascaded diffusion model (SCDM), a coarse-to-fine spectral super-resolution method based on the diffusion model. The diffusion model fits the real data distribution through stepwise denoising, which is naturally suitable for modeling rich spectral information. We cascade the diffusion model in the spectral dimension to gradually refine the spectral trends and enrich spectral information of the pixels. The cascade solves the highly ill-posed problem of spectral super-resolution step-by-step, mitigating the inaccuracies of previous single-shot approaches. To better utilize the potential of the diffusion model for spectral super-resolution, we design image condition mixture guidance (ICMG) to enhance the guidance of image conditions and progressive dynamic truncation (PDT) to limit cumulative errors in the sampling process. Experimental results demonstrate that our method achieves state-of-the-art performance in spectral super-resolution. Codes can be found at https://github.com/Mr-Bamboo/SCDM.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion
    Chen, Chi
    Wang, Yongcheng
    Zhang, Yuxi
    Zhao, Zhikang
    Feng, Hao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [22] HSACT: A hierarchical semantic-aware CNN-Transformer for remote sensing image spectral super-resolution
    Zhou, Chengle
    He, Zhi
    Zou, Liwei
    Li, Yunfei
    Plaza, Antonio
    NEUROCOMPUTING, 2025, 636
  • [23] Improving Super-Resolution Flood Inundation Mapping for Multispectral Remote Sensing Image by Supplying More Spectral Information
    Wang, Peng
    Zhang, Gong
    Leung, Henry
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (05) : 771 - 775
  • [24] Spectral-Learning-Based Transformer Network for the Spectral Super-Resolution of Remote-Sensing Degraded Images
    Li, Zengyi
    Li, Ligang
    Liu, Bo
    Cao, Yuan
    Zhou, Wenbo
    Ni, Wei
    Yang, Zhen
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [25] Deep Learning for Remote Sensing Image Super-Resolution
    Ul Hoque, Md Reshad
    Burks, Roland, III
    Kwan, Chiman
    Li, Jiang
    2019 IEEE 10TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2019, : 286 - 292
  • [26] Adaptive Semantic-Enhanced Denoising Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution
    Sui, Jialu
    Ma, Xianping
    Zhang, Xiaokang
    Pun, Man-On
    Wu, Hao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 892 - 906
  • [27] TRANSCYCLEGAN: AN APPROACH FOR REMOTE SENSING IMAGE SUPER-RESOLUTION
    Zhai, Lujun
    Wang, Yonghui
    Cui, Suxia
    Zhou, Yu
    2024 IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION, SSIAI, 2024, : 61 - 64
  • [28] Remote Sensing Image Super-resolution: Challenges and Approaches
    Yang, Daiqin
    Li, Zimeng
    Xia, Yatong
    Chen, Zhenzhong
    2015 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2015, : 196 - 200
  • [29] TRANSFORMATION CONSISTENCY FOR REMOTE SENSING IMAGE SUPER-RESOLUTION
    Deng, Kai
    Yao, Ping
    Cheng, Siyuan
    Bi, Junyu
    Zhang, Kun
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 201 - 205
  • [30] MAP super-resolution reconstruction of remote sensing image
    Liu Tao
    Qian Feng
    Zhang Bao
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2018, 33 (10) : 884 - 892