Spatiotemporal informer: A new approach based on spatiotemporal embedding and attention for air quality forecasting

被引:17
作者
Feng, Yang [1 ]
Kim, Ju-Song [1 ,3 ]
Yu, Jin-Won [1 ,3 ]
Ri, Kuk-Chol [2 ,4 ]
Yun, Song-Jun [3 ]
Han, Il-Nam [3 ]
Qi, Zhanfeng [1 ]
Wang, Xiaoli [1 ]
机构
[1] Tianjin Univ Technol, Sch Environm Sci & Safety Engn, Tianjin 300384, Peoples R China
[2] Kim Il Sung Univ, Fac Foreign Languages & Literature, Pyongyang 950001, North Korea
[3] Univ Sci, Dept Math, Pyongyang 999091, South Korea
[4] Tianjin Univ, Sch Foreign Languages, Tianjin 300350, Peoples R China
关键词
Air quality; Deep learning; Informer; Spatiotemporal attention; Spatiotemporal embedding; NEURAL-NETWORK; RANDOM FOREST; MISSING DATA; TIME-SERIES; PM2.5; CHINA; MODEL; POLLUTION; INDIA;
D O I
10.1016/j.envpol.2023.122402
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Accurate prediction of air pollution is essential for public health protection. Air quality, however, is difficult to predict due to the complex dynamics, and its accurate forecast still remains a challenge. This study suggests a spatiotemporal Informer model, which uses a new spatiotemporal embedding and spatiotemporal attention, to improve AQI forecast accuracy. In the first phase of the proposed forecast mechanism, the input data is transformed by the spatiotemporal embedding. Next, the spatiotemporal attention is applied to extract spatiotemporal features from the embedded data. The final forecast is obtained based on the attention tensors. In the proposed forecast model, the input is a 3-dimensional data that consists of air quality data (AQI, PM2.5, O3, SO2, NO2, CO) and geographic information, and the output is a multi-positional, multi-temporal data that shows the AQI forecast result of all the monitoring stations in the study area. The proposed forecast model was evaluated by air quality data of 34 monitoring stations in Beijing, China. Experiments showed that the proposed forecast model could provide highly accurate AQI forecast: the average of MAPE values for from 1 h to 20 h ahead forecast was 11.61%, and it was much smaller than other models. Moreover, the proposed model provided a highly accurate and stable forecast even at the extreme points. These results demonstrated that the proposed spatiotemporal embedding and attention techniques could sufficiently capture the spatiotemporal correlation characteristics of air quality data, and that the proposed spatiotemporal Informer could be successfully applied for air quality forecasting.
引用
收藏
页数:11
相关论文
共 67 条
[1]   ResInformer: Residual Transformer-Based Artificial Time-Series Forecasting Model for PM2.5 Concentration in Three Major Chinese Cities [J].
Al-qaness, Mohammed A. A. ;
Dahou, Abdelghani ;
Ewees, Ahmed A. A. ;
Abualigah, Laith ;
Huai, Jianzhu ;
Abd Elaziz, Mohamed ;
Helmi, Ahmed M. M. .
MATHEMATICS, 2023, 11 (02)
[2]  
[Anonymous], 2007, The figure of $220m is sourced from Global Environmental Facility, as of September 2007. The figure of $50bn is sourced from the Oxfam briefing paper Adapting to climate change
[3]   PM10 emission forecasting using artificial neural networks and genetic algorithm input variable optimization [J].
Antanasijevic, Davor Z. ;
Pocajt, Viktor V. ;
Povrenovic, Dragan S. ;
Ristic, Mirjana D. ;
Peric-Grujic, Aleksandra A. .
SCIENCE OF THE TOTAL ENVIRONMENT, 2013, 443 :511-519
[4]  
Athira V., 2018, Procedia Computer Science, V132, P1394, DOI 10.1016/j.procs.2018.05.068
[5]   Hourly PM2.5 concentration forecast using stacked autoencoder model with emphasis on seasonality [J].
Bai, Yun ;
Li, Yong ;
Zeng, Bo ;
Li, Chuan ;
Zhang, Jin .
JOURNAL OF CLEANER PRODUCTION, 2019, 224 :739-750
[6]   Environmental pollution and COVID-19 outbreak: insights from Germany [J].
Bilal ;
Bashir, Muhammad Farhan ;
Benghoul, Maroua ;
Numan, Umar ;
Shakoor, Awais ;
Komal, Bushra ;
Bashir, Muhammad Adnan ;
Bashir, Madiha ;
Tan, Duojiao .
AIR QUALITY ATMOSPHERE AND HEALTH, 2020, 13 (11) :1385-1394
[7]  
BMBEE China (Beijing Municipal Bureau of Ecology and Environment China), 2023, Beijing Ecological and Environmental Bulletin 2022
[8]   Spatio-temporal Variations in NO2 and PM2.5 over the Central Plains Economic Region of China during 2005-2015 Based on Satellite Observations [J].
Cai, Kun ;
Li, Shenshen ;
Zheng, Fengbin ;
Yu, Chao ;
Zhang, Xueying ;
Liu, Yang ;
Li, Yujing .
AEROSOL AND AIR QUALITY RESEARCH, 2018, 18 (05) :1221-1235
[9]   Recurrent Neural Networks for Multivariate Time Series with Missing Values [J].
Che, Zhengping ;
Purushotham, Sanjay ;
Cho, Kyunghyun ;
Sontag, David ;
Liu, Yan .
SCIENTIFIC REPORTS, 2018, 8
[10]   A hybrid CNN-Transformer model for ozone concentration prediction [J].
Chen, Yibin ;
Chen, Xiaomin ;
Xu, Ailan ;
Sun, Qiang ;
Peng, Xiaoyan .
AIR QUALITY ATMOSPHERE AND HEALTH, 2022, 15 (09) :1533-1546