EFFICIENT SUBSEASONAL WEATHER FORECAST USING TELECONNECTION-INFORMED TRANSFORMERS

被引:1
作者
Zhao, Shan [1 ]
Xiong, Zhitong [1 ]
Zhu, Xiao Xiang [1 ]
机构
[1] Tech Univ Munich TUM, Data Sci Earth Observat, Ottobrunn, Germany
来源
IGARSS 2024-2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, IGARSS 2024 | 2024年
关键词
Subseaonal forecast; Transformer; Fine-tuning; Teleconnections; Foundation model;
D O I
10.1109/IGARSS53475.2024.10641568
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Subseasonal forecasting, which is pivotal for agriculture, water resource management, and early warning of disasters, faces challenges due to the chaotic nature of the atmosphere. Recent advances in machine learning (ML) have revolutionized weather forecasting by achieving competitive predictive skills to numerical models. However, training such foundation models requires thousands of GPU days, which causes substantial carbon emissions and limits their broader applicability. Moreover, ML models tend to fool the pixel-wise error scores by producing smoothed results which lack physical consistency and meteorological meaning. To deal with the aforementioned problems, we propose a teleconnection-informed transformer. Our architecture leverages the pretrained Pangu model to achieve good initial weights and integrates a teleconnection-informed temporal module to improve predictability in an extended temporal range. Remarkably, by adjusting 1.1% of the Pangu model's parameters, our method enhances predictability on four surface and five upper-level atmospheric variables at a two-week lead time. Furthermore, the teleconnection-filtered features improve the spatial granularity of outputs significantly, indicating their potential physical consistency. Our research underscores the importance of atmospheric and oceanic teleconnections in driving future weather conditions. Besides, it presents a resource-efficient pathway for researchers to leverage existing foundation models on versatile downstream tasks.
引用
收藏
页码:2847 / 2852
页数:6
相关论文
共 21 条
[1]   21st century California drought risk linked to model fidelity of the El Nino teleconnection [J].
Allen, Robert J. ;
Anderson, Ray G. .
NPJ CLIMATE AND ATMOSPHERIC SCIENCE, 2018, 1
[2]  
[Anonymous], 2023, PANG WEATH
[3]   The quiet revolution of numerical weather prediction [J].
Bauer, Peter ;
Thorpe, Alan ;
Brunet, Gilbert .
NATURE, 2015, 525 (7567) :47-55
[4]   Accurate medium-range global weather forecasting with 3D neural networks [J].
Bi, Kaifeng ;
Xie, Lingxi ;
Zhang, Hengheng ;
Chen, Xin ;
Gu, Xiaotao ;
Tian, Qi .
NATURE, 2023, 619 (7970) :533-+
[5]  
Chand SS, 2017, NAT CLIM CHANGE, V7, P123, DOI [10.1038/nclimate3181, 10.1038/NCLIMATE3181]
[6]   Multiresolution analysis of precipitation teleconnections with large-scale climate signals: A case study in South Australia [J].
He, Xinguang ;
Guan, Huade .
WATER RESOURCES RESEARCH, 2013, 49 (10) :6995-7008
[7]  
Hu Edward J, 2021, arXiv
[8]   Influence of variations in extratropical wintertime teleconnections on Northern Hemisphere temperature [J].
Hurrell, JW .
GEOPHYSICAL RESEARCH LETTERS, 1996, 23 (06) :665-668
[9]  
Kingsbury D, 2015, P1, DOI [DOI 10.1021/bk-2015-1214.ch001, DOI 10.48550/ARXIV.1412.6980]
[10]   Overcoming catastrophic forgetting in neural networks [J].
Kirkpatricka, James ;
Pascanu, Razvan ;
Rabinowitz, Neil ;
Veness, Joel ;
Desjardins, Guillaume ;
Rusu, Andrei A. ;
Milan, Kieran ;
Quan, John ;
Ramalho, Tiago ;
Grabska-Barwinska, Agnieszka ;
Hassabis, Demis ;
Clopath, Claudia ;
Kumaran, Dharshan ;
Hadsell, Raia .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2017, 114 (13) :3521-3526