Advancing Realistic Precipitation Nowcasting With a Spatiotemporal Transformer-Based Denoising Diffusion Model

被引:19
|
作者
Zhao, Zewei [1 ,2 ]
Dong, Xichao [1 ,2 ,3 ]
Wang, Yupei [1 ,2 ]
Hu, Cheng [1 ,2 ]
机构
[1] Beijing Inst Technol, Sch Informat & Elect, Minist Educ, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Minist Educ, Key Lab Elect & Informat Technol Satellite Nav, Beijing 100081, Peoples R China
[3] Beijing Inst Technol Chongqing Innovat Ctr, Chongqing Key Lab Novel Civilian Radar, Chongqing 401120, Peoples R China
关键词
Precipitation; Noise reduction; Predictive models; Spatiotemporal phenomena; Radar; Radar imaging; Measurement; Backbone design for diffusion models; conditional denoising diffusion model; generative learning; nowcasting; PREDICTABILITY; PREDICTION;
D O I
10.1109/TGRS.2024.3355755
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Recent advances in deep learning (DL) have significantly improved the quality of precipitation nowcasting. Current approaches are either based on deterministic or generative models. Deterministic models perceive nowcasting as a spatiotemporal prediction task, relying on distance functions like $L2$ -norm loss for training. While improving meteorological evaluation metrics, they inevitably produce blurry predictions with no reference value. In contrast, generative models aim to capture realistic precipitation distributions and generate nowcasting products by sampling within these distributions. However, designing a generative model that produces realistic samples satisfying meteorological evaluation indexes in real-time remains challenging, given the triple dilemma of generative learning: achieving high sample quality, mode coverage, and fast sampling simultaneously. Recently, diffusion models exhibit impressive sample quality but suffer from time-consuming sampling, severely hindering their application in nowcasting. Moreover, samples generated by the U-Net denoiser of the current denoising diffusion model are prone to yield poor meteorological evaluation metrics such as CSI. To this end, we propose a spatiotemporal transformer-based conditional diffusion model with a rapid diffusion strategy. Concretely, we incorporate an adversarial mapping-based rapid diffusion strategy to overcome the time-consuming sampling process for standard diffusion models, enabling timely nowcasting. In addition, a meticulously designed spatiotemporal transformer-based denoiser is incorporated into diffusion models, remedying the defects in U-Net denoisers by estimating diffusion scores and improving nowcasting skill scores. Case studies of typical weather events such as thunderstorms, as well as quantitative indicators, demonstrate the effectiveness of the proposed method in generating sharper and more precise precipitation forecasts while maintaining satisfied meteorological evaluation metrics.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [41] Transformer-based 3D Instance Segmentation With Auxiliary Denoising Learning
    Song S.-H.
    Kim I.
    Journal of Institute of Control, Robotics and Systems, 2023, 29 (12) : 954 - 965
  • [42] Memorizing Swin-Transformer Denoising Network for Diffusion Model
    Chen, Jindou
    Shen, Yiqing
    ELECTRONICS, 2024, 13 (20)
  • [43] Transformer-Based Approaches for Purépecha Translation: Advancing Indigenous Language Preservation
    Gonzalez-Servin, Cecilia
    Sidorov, Grigori
    Maldonado-Sifuentes, Christian Efrain
    Nunez-Prado, Cesar Jesus
    INTERNATIONAL JOURNAL OF COMBINATORIAL OPTIMIZATION PROBLEMS AND INFORMATICS, 2025, 16 (01): : 64 - 74
  • [44] TransC-GD-CD: Transformer-Based Conditional Generative Diffusion Change Detection Model
    Wen, Yihan
    Zhang, Zhuo
    Cao, Qi
    Niu, Guanchong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 7144 - 7158
  • [45] UTDM: a universal transformer-based diffusion model for multi-weather-degraded images restoration
    Yu, Yongbo
    Li, Weidong
    Bai, Linyan
    Duan, Jinlong
    Zhang, Xuehai
    VISUAL COMPUTER, 2024, : 4269 - 4285
  • [46] RM-Transformer: A Transformer-based Model for Mandarin Speech Recognition
    Lu, Xingyu
    Hu, Jianguo
    Li, Shenhao
    Ding, Yanyu
    2022 IEEE 2ND INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND ARTIFICIAL INTELLIGENCE (CCAI 2022), 2022, : 194 - 198
  • [47] A Transformer-Based Diffusion Model for All-in-One Weather-Degraded Image Restoration
    Qin, Jing
    Wen, Yuanbo
    Gao, Tao
    Liu, Yao
    Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2024, 58 (10): : 1606 - 1617
  • [48] DiffSurf: A Transformer-Based Diffusion Model for Generating and Reconstructing 3D Surfaces in Pose
    Yoshiyasu, Yusuke
    Sun, Leyuan
    COMPUTER VISION-ECCV 2024, PT LXXXII, 2025, 15140 : 246 - 264
  • [49] Advancing Retinal Image Segmentation: A Denoising Diffusion Probabilistic Model Perspective
    Alimanov, Alnur
    Islam, Md Baharul
    2024 IEEE 7TH INTERNATIONAL CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL, MIPR 2024, 2024, : 572 - 578
  • [50] Spacetime Separable Latent Diffusion Model With Intensity Structure Information for Precipitation Nowcasting
    Ling, Xudong
    Li, Chaorong
    Zhu, Lihong
    Qin, Fengqing
    Zhu, Ping
    Huang, Yuanyuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62