Novel MIA-LSTM Deep Learning Hybrid Model with Data Preprocessing for Forecasting of PM2.5

被引:8
作者
Narkhede, Gaurav [1 ]
Hiwale, Anil [1 ]
Tidke, Bharat [2 ]
Khadse, Chetan [3 ]
机构
[1] MIT World Peace Univ, Sch Elect & Commun Engn, Pune 411038, India
[2] MIT World Peace Univ, Sch Comp Engn & Technol, Pune 411038, India
[3] MIT World Peace Univ, Sch Elect Engn, Pune 411038, India
关键词
MIA-LSTM; data preprocessing; iterative imputation; autoencoder; LSTM; MISSING VALUES; NEURAL-NETWORK; IMPUTATION; AIR; PREDICTION;
D O I
10.3390/a16010052
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Day by day pollution in cities is increasing due to urbanization. One of the biggest challenges posed by the rapid migration of inhabitants into cities is increased air pollution. Sustainable Development Goal 11 indicates that 99 percent of the world's urban population breathes polluted air. In such a trend of urbanization, predicting the concentrations of pollutants in advance is very important. Predictions of pollutants would help city administrations to take timely measures for ensuring Sustainable Development Goal 11. In data engineering, imputation and the removal of outliers are very important steps prior to forecasting the concentration of air pollutants. For pollution and meteorological data, missing values and outliers are critical problems that need to be addressed. This paper proposes a novel method called multiple iterative imputation using autoencoder-based long short-term memory (MIA-LSTM) which uses iterative imputation using an extra tree regressor as an estimator for the missing values in multivariate data followed by an LSTM autoencoder for the detection and removal of outliers present in the dataset. The preprocessed data were given to a multivariate LSTM for forecasting PM2.5 concentration. This paper also presents the effect of removing outliers and missing values from the dataset as well as the effect of imputing missing values in the process of forecasting the concentrations of air pollutants. The proposed method provides better results for forecasting with a root mean square error (RMSE) value of 9.8883. The obtained results were compared with the traditional gated recurrent unit (GRU), 1D convolutional neural network (CNN), and long short-term memory (LSTM) approaches for a dataset of the Aotizhonhxin area of Beijing in China. Similar results were observed for another two locations in China and one location in India. The results obtained show that imputation and outlier/anomaly removal improve the accuracy of air pollution forecasting.
引用
收藏
页数:20
相关论文
共 62 条
[21]  
Gessert G. H., 1991, SIGMOD Record, V20, P30, DOI 10.1145/126482.126486
[22]  
Hazlewood WR, 2011, UBIQUITOUS DEVELOPMENTS IN AMBIENT COMPUTING AND INTELLIGENCE: HUMAN-CENTERED APPLICATIONS, P94, DOI 10.4018/978-1-60960-549-0.ch008
[23]   Incorporating long-term satellite-based aerosol optical depth, localized land use data, and meteorological variables to estimate ground-level PM2.5 concentrations in Taiwan from 2005 to 2015 [J].
Jung, Chau-Ren ;
Hwang, Bing-Fang ;
Chen, Wei-Ting .
ENVIRONMENTAL POLLUTION, 2018, 237 :1000-1010
[24]   Methods for imputation of missing values in air quality data sets [J].
Junninen, H ;
Niska, H ;
Tuppurainen, K ;
Ruuskanen, J ;
Kolehmainen, M .
ATMOSPHERIC ENVIRONMENT, 2004, 38 (18) :2895-2907
[25]   Minimal projective reconstruction including missing data [J].
Kahl, F ;
Heyden, A ;
Quan, L .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (04) :418-424
[26]   Air Pollution Prediction with Multi-Modal Data and Deep Neural Networks [J].
Kalajdjieski, Jovan ;
Zdravevski, Eftim ;
Corizzo, Roberto ;
Lameski, Petre ;
Kalajdziski, Slobodan ;
Pires, Ivan Miguel ;
Garcia, Nuno M. ;
Trajkovik, Vladimir .
REMOTE SENSING, 2020, 12 (24) :1-19
[27]   A Review of Air Quality Modeling [J].
Karroum, Khaoula ;
Lin, Yijun ;
Chiang, Yao-Yi ;
Ben Maissa, Yann ;
El Haziti, Mohamed ;
Sokolov, Anton ;
Delbarre, Herve .
MAPAN-JOURNAL OF METROLOGY SOCIETY OF INDIA, 2020, 35 (02) :287-300
[28]   Conjugate gradient back-propagation based artificial neural network for real time power quality assessment [J].
Khadse, Chetan B. ;
Chaudhari, Madhuri A. ;
Borghate, Vijay B. .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2016, 82 :197-206
[29]   Missing Value Imputation of Time-Series Air-Quality Data via Deep Neural Networks [J].
Kim, Taesung ;
Kim, Jinhee ;
Yang, Wonho ;
Lee, Hunjoo ;
Choo, Jaegul .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2021, 18 (22)
[30]  
Little D.R, 2002, RUBIN STAT ANAL MISS