Advancing Realistic Precipitation Nowcasting With a Spatiotemporal Transformer-Based Denoising Diffusion Model

被引:19
|
作者
Zhao, Zewei [1 ,2 ]
Dong, Xichao [1 ,2 ,3 ]
Wang, Yupei [1 ,2 ]
Hu, Cheng [1 ,2 ]
机构
[1] Beijing Inst Technol, Sch Informat & Elect, Minist Educ, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Minist Educ, Key Lab Elect & Informat Technol Satellite Nav, Beijing 100081, Peoples R China
[3] Beijing Inst Technol Chongqing Innovat Ctr, Chongqing Key Lab Novel Civilian Radar, Chongqing 401120, Peoples R China
关键词
Precipitation; Noise reduction; Predictive models; Spatiotemporal phenomena; Radar; Radar imaging; Measurement; Backbone design for diffusion models; conditional denoising diffusion model; generative learning; nowcasting; PREDICTABILITY; PREDICTION;
D O I
10.1109/TGRS.2024.3355755
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Recent advances in deep learning (DL) have significantly improved the quality of precipitation nowcasting. Current approaches are either based on deterministic or generative models. Deterministic models perceive nowcasting as a spatiotemporal prediction task, relying on distance functions like $L2$ -norm loss for training. While improving meteorological evaluation metrics, they inevitably produce blurry predictions with no reference value. In contrast, generative models aim to capture realistic precipitation distributions and generate nowcasting products by sampling within these distributions. However, designing a generative model that produces realistic samples satisfying meteorological evaluation indexes in real-time remains challenging, given the triple dilemma of generative learning: achieving high sample quality, mode coverage, and fast sampling simultaneously. Recently, diffusion models exhibit impressive sample quality but suffer from time-consuming sampling, severely hindering their application in nowcasting. Moreover, samples generated by the U-Net denoiser of the current denoising diffusion model are prone to yield poor meteorological evaluation metrics such as CSI. To this end, we propose a spatiotemporal transformer-based conditional diffusion model with a rapid diffusion strategy. Concretely, we incorporate an adversarial mapping-based rapid diffusion strategy to overcome the time-consuming sampling process for standard diffusion models, enabling timely nowcasting. In addition, a meticulously designed spatiotemporal transformer-based denoiser is incorporated into diffusion models, remedying the defects in U-Net denoisers by estimating diffusion scores and improving nowcasting skill scores. Case studies of typical weather events such as thunderstorms, as well as quantitative indicators, demonstrate the effectiveness of the proposed method in generating sharper and more precise precipitation forecasts while maintaining satisfied meteorological evaluation metrics.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [21] Spatiotemporal Predictive Learning for Radar-Based Precipitation Nowcasting
    Wang, Xiaoying
    Zhao, Haixiang
    Zhang, Guojing
    Guan, Qin
    Zhu, Yu
    ATMOSPHERE, 2024, 15 (08)
  • [22] Transformer-based Learned Image Compression for Joint Decoding and Denoising
    Chen, Yi-Hsin
    Ho, Kuan-Wei
    Tsai, Shiau-Rung
    Lin, Guan-Hsun
    Gnutti, Alessandro
    Peng, Wen-Hsiao
    Leonardi, Riccardo
    2024 PICTURE CODING SYMPOSIUM, PCS 2024, 2024,
  • [23] RelFormer: Advancing contextual relations for transformer-based dense captioning
    Jin, Weiqi
    Qu, Mengxue
    Shi, Caijuan
    Zhao, Yao
    Wei, Yunchao
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2025, 252
  • [24] Precipitation nowcasting based on ConvLSTM-UNet deep spatiotemporal network
    Zheng, Xiangming
    Qin, Huawang
    Chen, Haoran
    Wang, Weixi
    Shi, Piao
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (04)
  • [25] Towards the Vehicular Metaverse: Exploring Distributed Inference With Transformer-Based Diffusion Model
    Xie, Gaochang
    Xiong, Zehui
    Zhang, Xinyuan
    Xie, Renchao
    Liu, Yunjie
    Shen, Xuemin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (12) : 19931 - 19936
  • [26] Hierarchical Transformer With Lightweight Attention for Radar-Based Precipitation Nowcasting
    Li, Wenhui
    Zhou, Ying
    Li, Yue
    Song, Dan
    Wei, Zhiqiang
    Liu, An-An
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [27] SAR Image Despeckling Based on Denoising Diffusion Probabilistic Model and Swin Transformer
    Pan, Yucheng
    Zhong, Liheng
    Chen, Jingdong
    Li, Heping
    Zhang, Xianlong
    Pan, Bin
    REMOTE SENSING, 2024, 16 (17)
  • [28] A Transformer-Based Signal Denoising Network for AoA Estimation in NLoS Environments
    Liu, Junchen
    Wang, Tianyu
    Li, Yuxiao
    Li, Cheng
    Wang, Yi
    Shen, Yuan
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (10) : 2336 - 2339
  • [29] WaveFormer: transformer-based denoising method for gravitational-wave data
    Wang, He
    Zhou, Yue
    Cao, Zhoujian
    Guo, Zongkuan
    Ren, Zhixiang
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2024, 5 (01):
  • [30] Doc-Former: A transformer-based document shadow denoising network
    Pei, Shengchang
    Liu, Jun
    Yi, Niannian
    Zhang, Yun
    Liu, Zhengtao
    Chen, Zengyan
    2023 THE 6TH INTERNATIONAL CONFERENCE ON ROBOT SYSTEMS AND APPLICATIONS, ICRSA 2023, 2023, : 139 - 143