Genetic algorithm-based hyperparameter optimization of deep learning models for PM2.5 time-series prediction

被引:30
作者
Erden, C. [1 ,2 ]
机构
[1] Sakarya Univ Appl Sci, Fac Appl Sci, Sakarya, Turkiye
[2] Sakarya Univ Appl Sci, AI Res & Applicat Ctr, Sakarya, Turkiye
关键词
Gated recurrent units; Genetic algorithms; Hyperparameter optimization; Long-short term memory; Particulate matter; Recurrent neural networks; PM10; CONCENTRATIONS; MACHINE; OZONE;
D O I
10.1007/s13762-023-04763-6
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Since air pollution negatively affects human health and causes serious diseases, accurate air pollution prediction is essential regarding environmental sustainability. Although conventional statistical and machine learning methods have been widely used for air quality forecasting, they have limitations in finding nonlinear relations and modeling sequential data. In recent years, deep learning methods such as long short-term memory, recurrent neural networks, and gated recurrent units have been successfully applied in several research areas, including time-series forecasting. In this study, deep learning algorithm is employed to predict the PM2.5 dataset, including air pollutants (NO, NO2, NOX, O-3, PM2.5, SO, and SO2) and meteorological features (wind speed, wind direction, and air temperature) in Istanbul metropolitan. Deep learning algorithms have many hyperparameters such as learning and dropout rate, the number of hidden layers and units in each hidden layer, activation function, loss function, and optimizer that need to be optimized in order to achieve optimal training performance. Therefore, a genetic algorithm-based hyperparameter optimization approach is proposed to find the best parameter combination. The prediction results of deep learning algorithms are compared with default hyperparameters and random search algorithms to confirm the efficacy of the genetic algorithm approach. The proposed method outperforms the other configurations, with the MSE error reduced by 13.38% and 55.30% for testing performance, respectively. The experimental results revealed that genetic algorithms are promising and applicable in hyperparameter optimization of deep neural network models, especially in air quality forecasting.
引用
收藏
页码:2959 / 2982
页数:24
相关论文
共 121 条
[1]  
Abadi Martin, 2016, Proceedings of OSDI '16: 12th USENIX Symposium on Operating Systems Design and Implementation. OSDI '16, P265
[2]   Forecasting Particulate Matter Concentration Using Linear and Non-Linear Approaches for Air Quality Decision Support [J].
Abdullah, Samsuri ;
Ismail, Marzuki ;
Ahmed, Ali Najah ;
Abdullah, Ahmad Makmom .
ATMOSPHERE, 2019, 10 (11)
[3]  
Abreu S., 2019, ARXIV
[4]   A deep learning approach to model daily particular matter of Ankara: key features and forecasting [J].
Akbal, Y. ;
Unlu, K. D. .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL SCIENCE AND TECHNOLOGY, 2022, 19 (07) :5911-5927
[5]   Evaluation of data preprocessing and feature selection process for prediction of hourly PM10 concentration using long short-term memory models [J].
Aksangur, Ipek ;
Eren, Beytullah ;
Erden, Caner .
ENVIRONMENTAL POLLUTION, 2022, 311
[6]   Deep Learning: Parameter Optimization Using Proposed Novel Hybrid Bees Bayesian Convolutional Neural Network [J].
Alamri, Nawaf Mohammad H. ;
Packianather, Michael ;
Bigot, Samuel .
APPLIED ARTIFICIAL INTELLIGENCE, 2022, 36 (01)
[7]  
[Anonymous], 2022, IDS 2018
[8]  
[Anonymous], 2013, Pmlr, DOI DOI 10.48550/ARXIV.1211.5063
[9]   Evaluation of Key Parameters Using Deep Convolutional Neural Networks for Airborne Pollution (PM10) Prediction [J].
Antonio Aceves-Fernandez, Marco ;
Dominguez-Guevara, Ricardo ;
Carlos Pedraza-Ortega, Jesus ;
Emilio Vargas-Soto, Jose .
DISCRETE DYNAMICS IN NATURE AND SOCIETY, 2020, 2020
[10]   The use of wind fields in a land use regression model to predict air pollution concentrations for health exposure studies [J].
Arain, M. A. ;
Blair, R. ;
Finkelstein, N. ;
Brook, J. R. ;
Sahsuvaroglu, T. ;
Beckerman, B. ;
Zhang, L. ;
Jerrett, M. .
ATMOSPHERIC ENVIRONMENT, 2007, 41 (16) :3453-3464