Advancing short-term solar irradiance forecasting accuracy through a hybrid deep learning approach with Bayesian optimization

The optimization of solar energy integration into the power grid relies heavily on accurate forecasting of solar irradiance. In this study, a new approach for short-term solar irradiance forecasting is introduced. This method combines Bayesian Optimized Attention-Dilated Long Short-Term Memory and Savitzky-Golay filtering. The methodology is implemented to analyze data obtained from a solar irradiance probe situated in Douala, Cameroon. Initially, the unprocessed data is augmented by integrating distinctive solar irradiation variables, and the Savitzky-Golay filter with Bayesian Optimization is used to enhance its quality. Subsequently, multiple deep learning models, including Long Short-Term Memory, Bidirectional Long Short-Term Memory, Artificial Neural Networks, Bidirectional Long Short-Term Memory with Additive Attention Mechanism, and Bidirectional Long Short-Term Memory with Additive Attention Mechanism and Dilated Convolutional layers, are trained and evaluated. Out of all the models considered, the proposed approach, which combines the attention mechanism and dilated convolutional layers, demonstrates exceptional performance with the best convergence and accuracy in forecasting. Bayesian Optimization is further utilized to fine -tune the polynomial and window size of the Savitzky-Golay filter and optimize the hyperparameters of the deep learning models. The results show a Symmetric Mean Absolute Percentage Error of 0.6564, a Normalized Root Mean Square Error of 0.2250, and a Root Mean Square Error of 22.9445, surpassing previous studies in the literature. Empirical findings highlight the effectiveness of the proposed methodology in enhancing the accuracy of short-term solar irradiance forecasting. This research contributes to the field by introducing novel data pre-processing techniques, a hybrid deep learning architecture, and the development of a benchmark dataset. These advancements benefit both researchers and solar plant managers, improving solar irradiance forecasting capabilities.