Attention-based parallel networks (APNet) for PM2.5 spatiotemporal prediction

被引:70
作者
Zhu, Jiaqi [1 ]
Deng, Fang [1 ,2 ]
Zhao, Jiachen [1 ]
Zheng, Hao [1 ]
机构
[1] Beijing Inst Technol, Sch Automat, Beijing 100081, Peoples R China
[2] Beijing Inst Technol Chongqing Innovat Ctr, Chongqing 401120, Peoples R China
基金
中国国家自然科学基金;
关键词
Spatiotemporal correlation; PM2.5; prediction; Attention mechanism; Deep learning; CNN; Transformation-gate LSTM; ARTIFICIAL NEURAL-NETWORKS; SHORT-TERM-MEMORY; RANDOM FOREST; AIR-QUALITY; URBAN AREAS; POLLUTION; POLLUTANTS; MODELS; PM10;
D O I
10.1016/j.scitotenv.2021.145082
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Urban particulate matter forecast is an important part of air pollution early warning and control management, especially the forecast of fine particulate matter (PM2.5). However, the existing PM2.5 concentration prediction methods cannot effectively capture the complex nonlinearity of PM2.5 concentration, and most of them cannot accurately simulate the temporal and spatial dependence of PM2.5 concentration at the same time. In this paper, we propose an attention-based parallel network (APNet), which can extract short-term and long-term temporal features simultaneously based on the attention-based CNN-LSTM multilayer structure to predict PM2.5 concentration in the next 72 h. Firstly, the Maximum Information Coefficient (MIC) is designed for spatiotemporal correlation analysis, fully considering the linearity, non-linearity and non-functionality between the data of each monitoring station. The potential inherent features of the input data are effectively extracted through the convolutional neural network (CNN). Then, an optimized long short-term memroy (LSTM) network captures the short-term mutations of the time series. An attention mechanism is further designed for the proposed model, which automatically assigns different weights to different feature states at different time stages to distinguish their importance, and can achieve precise temporal and spatial interpretability. In order to further explore the long-term time features, we propose a Bi-isnvi parallel module to extract the periodic characteristics of PM2.5 concentration from both previous and posterior directions. Experimental results based on a real-world dataset indicates that the proposed model outperforms other existing state-of-the-art methods. Moreover, evaluations of recall (0.790), precision (0.848) (threshold: 151 mu g/m(3)) for 72 h prediction also verify the feasibility degrees four proposed model. The methodology can be used for predicting other multivariate time series data in the future. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 44 条
[1]   Social LSTM: Human Trajectory Prediction in Crowded Spaces [J].
Alahi, Alexandre ;
Goel, Kratarth ;
Ramanathan, Vignesh ;
Robicquet, Alexandre ;
Li Fei-Fei ;
Savarese, Silvio .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :961-971
[2]   Towards improving the simulation of meteorological fields in urban areas through updated/advanced surface fluxes description [J].
Baklanov, A. ;
Mestayer, P. G. ;
Clappier, A. ;
Zilitinkevich, S. ;
Joffre, S. ;
Mahura, A. ;
Nielsen, N. W. .
ATMOSPHERIC CHEMISTRY AND PHYSICS, 2008, 8 (03) :523-543
[3]   Evaluating ammonia (NH3) predictions in the NOAA National Air Quality Forecast Capability (NAQFC) using in situ aircraft, ground-level, and satellite measurements from the DISCOVER-AQ Colorado campaign [J].
Battye, William H. ;
Bray, Casey D. ;
Aneja, Viney P. ;
Tong, Daniel ;
Lee, Pius ;
Tang, Youhua .
ATMOSPHERIC ENVIRONMENT, 2016, 140 :342-351
[4]   Models-3 community multiscale air quality (CMAQ) model aerosol component - 1. Model description [J].
Binkowski, FS ;
Roselle, SJ .
JOURNAL OF GEOPHYSICAL RESEARCH-ATMOSPHERES, 2003, 108 (D6)
[5]   Air pollution and health [J].
Brunekreef, B ;
Holgate, ST .
LANCET, 2002, 360 (9341) :1233-1242
[6]   The impact of the "Air Pollution Prevention and Control Action Plan" on PM2.5 concentrations in Jing-Jin-Ji region during 2012-2020 [J].
Cai, Siyi ;
Wang, Yangjun ;
Zhao, Bin ;
Wang, Shuxiao ;
Chang, Xing ;
Hao, Jiming .
SCIENCE OF THE TOTAL ENVIRONMENT, 2017, 580 :197-209
[7]   Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN [J].
Chen, Tao ;
Xu, Ruifeng ;
He, Yulan ;
Wang, Xuan .
EXPERT SYSTEMS WITH APPLICATIONS, 2017, 72 :221-230
[8]   The MR-CA Models for Analysis of Pollution Sources and Prediction of PM2.5 [J].
Deng, Fang ;
Ma, Liqiu ;
Gao, Xin ;
Chen, Jie .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (04) :814-820
[9]   Development and comparison of regression models and feedforward backpropagation neural network models to predict seasonal indoor PM2.5-10 and PM2.5 concentrations in naturally ventilated schools [J].
Elbayoumi, Maher ;
Ramli, Nor Azam ;
Yusof, Noor Faizah Fitri Md .
ATMOSPHERIC POLLUTION RESEARCH, 2015, 6 (06) :1013-1023
[10]   Recurrent Neural Network and random forest for analysis and accurate forecast of atmospheric pollutants: A case study in Hangzhou, China [J].
Feng, Rui ;
Zheng, Hui-jun ;
Gao, Han ;
Zhang, An-ran ;
Huang, Chong ;
Zhang, Jun-xi ;
Luo, Kun ;
Fan, Jian-ren .
JOURNAL OF CLEANER PRODUCTION, 2019, 231 :1005-1015