MGSFformer: A Multi-Granularity Spatiotemporal Fusion Transformer for air quality prediction

被引:12
作者
Yu, Chengqing [1 ,2 ]
Wang, Fei [1 ,2 ]
Wang, Yilun [3 ]
Shao, Zezhi [1 ,2 ]
Sun, Tao [1 ]
Yao, Di [1 ]
Xu, Yongjun [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] China North Ind Grp Corp, Inst Nav & Control Technol, Beijing, Peoples R China
关键词
Air quality prediction; Multi-Granularity Spatiotemporal Fusion; Transformer; Spatiotemporal correlation; Multi-source information fusion; MODEL;
D O I
10.1016/j.inffus.2024.102607
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Air quality spatiotemporal prediction can provide technical support for environmental governance and sustainable city development. As a classic multi-source spatiotemporal data, effective multi-source information fusion is key to achieving accurate air quality predictions. However, due to not fully fusing two pieces of information, classical deep learning models struggle to achieve satisfactory prediction results: (1) Multi- granularity: each air monitoring station collects air quality data at different sampling intervals, which show distinct time series patterns. (2) Spatiotemporal correlation: due to human activities and atmospheric diffusion, there exist correlations between air quality data from different air monitoring stations, necessitating the consideration of other air monitoring stations' influences when modeling each air quality time series. In this study, to achieve satisfactory prediction results, we propose the Multi-Granularity Spatiotemporal Fusion Transformer, comprised of the residual de-redundant block, spatiotemporal attention block, and dynamic fusion block. Specifically, the residual de-redundant block eliminates information redundancy between data with different granularities and prevents the model from being misled by redundant information. The spatiotemporal attention block captures the spatiotemporal correlation of air quality data and facilitates prediction modeling. The dynamic fusion block evaluates the importance of data with different granularities and integrates the prediction results. Experimental results demonstrate that the proposed model surpasses 11 baselines by 5% in performance on three real-world datasets.
引用
收藏
页数:15
相关论文
共 75 条
[1]  
Ahmed S.F., 2024, Inf. Fusion, V110
[2]  
Bai L, 2020, ADV NEUR IN, V33
[3]   Syntactic and Semantic Aware Graph Convolutional Network for Aspect-Based Sentiment Analysis [J].
Chen, Junjie ;
Fan, Hao ;
Wang, Wencong .
IEEE ACCESS, 2024, 12 :22500-22509
[4]  
Chen P, 2024, Arxiv, DOI arXiv:2402.05956
[5]   Multi-granularity relabeled under-sampling algorithm for imbalanced data [J].
Dai, Qi ;
Liu, Jian-wei ;
Liu, Yang .
APPLIED SOFT COMPUTING, 2022, 124
[6]   Disentangling Structured Components: Towards Adaptive, Interpretable and Scalable Time Series Forecasting [J].
Deng, Jinliang ;
Chen, Xiusi ;
Jiang, Renhe ;
Yin, Du ;
Yang, Yi ;
Song, Xuan ;
Tsang, Ivor W. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (08) :3783-3800
[7]   Comprehensive systematic review of information fusion methods in smart cities and urban environments [J].
Fadhel, Mohammed A. ;
Duhaim, Ali M. ;
Saihood, Ahmed ;
Sewify, Ahmed ;
Al-Hamadani, Mokhaled N. A. ;
Albahri, A. S. ;
Alzubaidi, Laith ;
Gupta, Ashish ;
Mirjalili, Sayedali ;
Gu, Yuantong .
INFORMATION FUSION, 2024, 107
[8]   Deep Reinforcement Learning for UAV Routing in the Presence of Multiple Charging Stations [J].
Fan, Mingfeng ;
Wu, Yaoxin ;
Liao, Tianjun ;
Cao, Zhiguang ;
Guo, Hongliang ;
Sartoretti, Guillaume ;
Wu, Guohua .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (05) :5732-5746
[9]   Online dynamic ensemble deep random vector functional link neural network for forecasting [J].
Gao, Ruobin ;
Li, Ruilin ;
Hu, Minghui ;
Suganthan, P. N. ;
Yuen, Kum Fai .
NEURAL NETWORKS, 2023, 166 :51-69
[10]   Monitoring and modelling of PM2.5 concentration at subway station construction based on IoT and LSTM algorithm optimization [J].
Guo, Xiaohui ;
Wang, Yuanfeng ;
Mei, Shengqi ;
Shi, Chengcheng ;
Liu, Yinshan ;
Pan, Lei ;
Li, Kai ;
Zhang, Boqun ;
Wang, Junshan ;
Zhong, Zhiwu ;
Dong, Minzhong .
JOURNAL OF CLEANER PRODUCTION, 2022, 360