MGSFformer: A Multi-Granularity Spatiotemporal Fusion Transformer for air quality prediction

被引:16
作者
Yu, Chengqing [1 ,2 ]
Wang, Fei [1 ,2 ]
Wang, Yilun [3 ]
Shao, Zezhi [1 ,2 ]
Sun, Tao [1 ]
Yao, Di [1 ]
Xu, Yongjun [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] China North Ind Grp Corp, Inst Nav & Control Technol, Beijing, Peoples R China
关键词
Air quality prediction; Multi-Granularity Spatiotemporal Fusion; Transformer; Spatiotemporal correlation; Multi-source information fusion; MODEL;
D O I
10.1016/j.inffus.2024.102607
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Air quality spatiotemporal prediction can provide technical support for environmental governance and sustainable city development. As a classic multi-source spatiotemporal data, effective multi-source information fusion is key to achieving accurate air quality predictions. However, due to not fully fusing two pieces of information, classical deep learning models struggle to achieve satisfactory prediction results: (1) Multi- granularity: each air monitoring station collects air quality data at different sampling intervals, which show distinct time series patterns. (2) Spatiotemporal correlation: due to human activities and atmospheric diffusion, there exist correlations between air quality data from different air monitoring stations, necessitating the consideration of other air monitoring stations' influences when modeling each air quality time series. In this study, to achieve satisfactory prediction results, we propose the Multi-Granularity Spatiotemporal Fusion Transformer, comprised of the residual de-redundant block, spatiotemporal attention block, and dynamic fusion block. Specifically, the residual de-redundant block eliminates information redundancy between data with different granularities and prevents the model from being misled by redundant information. The spatiotemporal attention block captures the spatiotemporal correlation of air quality data and facilitates prediction modeling. The dynamic fusion block evaluates the importance of data with different granularities and integrates the prediction results. Experimental results demonstrate that the proposed model surpasses 11 baselines by 5% in performance on three real-world datasets.
引用
收藏
页数:15
相关论文
共 75 条
[51]   M2FNet: Multi-granularity Feature Fusion Network for Medical Visual Question Answering [J].
Wang, He ;
Pan, Haiwei ;
Zhang, Kejia ;
He, Shuning ;
Chen, Chunling .
PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT II, 2022, 13630 :141-154
[52]  
Wang SY, 2024, Arxiv, DOI [arXiv:2405.14616, DOI 10.48550/ARXIV.2405.14616]
[53]   Clustering-property Matters: A Cluster-aware Network for Large Scale Multivariate Time Series Forecasting [J].
Wang, Yuan ;
Shao, Zezhi ;
Sun, Tao ;
Yu, Chengqing ;
Xu, Yongjun ;
Wang, Fei .
PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, :4340-4344
[54]  
Wu H, 2022, Temporal 2D-Variation Modeling for General Time Series
[55]   TWC-EL: A multivariate prediction model by the fusion of three-way clustering and ensemble learning [J].
Wu, Xunjin ;
Zhan, Jianming ;
Ding, Weiping .
INFORMATION FUSION, 2023, 100
[56]   Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks [J].
Wu, Zonghan ;
Pan, Shirui ;
Long, Guodong ;
Jiang, Jing ;
Chang, Xiaojun ;
Zhang, Chengqi .
KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, :753-763
[57]   Vision Transformer with Deformable Attention [J].
Xia, Zhuofan ;
Pan, Xuran ;
Song, Shiji ;
Li, Li Erran ;
Huang, Gao .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :4784-4793
[58]   PM2.5 concentration modeling and prediction by using temperature-based deep belief network [J].
Xing, Haixia ;
Wang, Gongming ;
Liu, Caixia ;
Suo, Minghe .
NEURAL NETWORKS, 2021, 133 :157-165
[59]   Generic Dynamic Graph Convolutional Network for traffic flow forecasting [J].
Xu, Yi ;
Han, Liangzhe ;
Zhu, Tongyu ;
Sun, Leilei ;
Du, Bowen ;
Lv, Weifeng .
INFORMATION FUSION, 2023, 100
[60]   Artificial intelligence for science-bridging data to wisdom [J].
Xu, Yongjun ;
Wang, Fei ;
An, Zhulin ;
Wang, Qi ;
Zhang, Zhao .
INNOVATION, 2023, 4 (06)