Can Denoising Enhance Prediction Accuracy of Learning Models? A Case of Wavelet Decomposition Approach

被引:6
作者
Tamilselvi, C. [1 ]
Yeasin, Md [2 ]
Paul, Ranjit Kumar [2 ]
Paul, Amrit Kumar [2 ]
机构
[1] ICAR Indian Agr Res Inst, Grad Sch, New Delhi 110012, India
[2] ICAR Indian Agr Stat Res Inst, New Delhi 110012, India
关键词
accuracy metrics; denoising; price forecasting; machine learning; LSTM; wavelet decomposition; PRICE;
D O I
10.3390/forecast6010005
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Denoising is an integral part of the data pre-processing pipeline that often works in conjunction with model development for enhancing the quality of data, improving model accuracy, preventing overfitting, and contributing to the overall robustness of predictive models. Algorithms based on a combination of wavelet with deep learning, machine learning, and stochastic model have been proposed. The denoised series are fitted with various benchmark models, including long short-term memory (LSTM), support vector regression (SVR), artificial neural network (ANN), and autoregressive integrated moving average (ARIMA) models. The effectiveness of a wavelet-based denoising approach was investigated on monthly wholesale price data for three major spices (turmeric, coriander, and cumin) for various markets in India. The predictive performance of these models is assessed using root mean square error (RMSE), mean absolute percentage error (MAPE), and mean absolute error (MAE). The wavelet LSTM model with Haar filter at level 6 emerged as a robust choice for accurate price predictions across all spices. It was found that the wavelet LSTM model had a significant gain in accuracy than the LSTM model by more than 30% across all accuracy metrics. The results clearly highlighted the efficacy of a wavelet-based denoising approach in enhancing the accuracy of price forecasting.
引用
收藏
页码:81 / 99
页数:19
相关论文
共 46 条
[1]   A systematic quantitative review on the performance of some of the recent short-term rainfall forecasting techniques [J].
Ashok, Shejule Priya ;
Pekkat, Sreeja .
JOURNAL OF WATER AND CLIMATE CHANGE, 2022, 13 (08) :3004-3029
[2]   Copper Price Prediction Using Support Vector Regression Technique [J].
Astudillo, Gabriel ;
Carrasco, Raul ;
Fernandez-Campusano, Christian ;
Chacon, Max .
APPLIED SCIENCES-BASEL, 2020, 10 (19)
[3]   Wavelet-Based Denoising for Traffic Volume Time Series Forecasting with Self-Organizing Neural Networks [J].
Boto-Giralda, Daniel ;
Diaz-Pernas, Francisco J. ;
Gonzalez-Ortega, David ;
Diez-Higuera, Jose F. ;
Anton-Rodriguez, Miriam ;
Martinez-Zarzuela, Mario ;
Torre-Diez, Isabel .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2010, 25 (07) :530-545
[4]   Forecasting hourly PM2.5 concentrations based on decomposition-ensemble-reconstruction framework incorporating deep learning algorithms [J].
Cai P. ;
Zhang C. ;
Chai J. .
Data Science and Management, 2023, 6 (01) :46-54
[5]   Do Anomalies Really Predict Market Returns? New Data and New Evidence [J].
Cakici, Nusret ;
Fieberg, Christian ;
Metko, Daniel ;
Zaremba, Adam .
REVIEW OF FINANCE, 2024, 28 (01) :1-44
[6]   A case study comparing machine learning with statistical methods for time series forecasting: size matters [J].
Cerqueira, Vitor ;
Torgo, Luis ;
Soares, Carlos .
JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2022, 59 (02) :415-433
[7]   Price Prediction of Agricultural Products Based on Wavelet Analysis-LSTM [J].
Chen, Qinglong ;
Lin, Xiaoyu ;
Zhong, Yiwen ;
Xie, Ziyan .
2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, :984-990
[8]  
Chen X., 2019, IEEE ACCESS, DOI [10.1109/ACCESS.2019.2913366, DOI 10.1109/ACCESS.2019.2913366]
[9]   Multi-step-ahead stock price index forecasting using long short-term memory model with multivariate empirical mode decomposition [J].
Deng, Changrui ;
Huang, Yanmei ;
Hasan, Najmul ;
Bao, Yukun .
INFORMATION SCIENCES, 2022, 607 :297-321
[10]   Anomalies and the Expected Market Return [J].
Dong, Xi ;
Li, Yan ;
Rapach, David E. ;
Zhou, Guofu .
JOURNAL OF FINANCE, 2022, 77 (01) :639-681