An Optimized Bagging Ensemble Learning Approach Using BESTrees for Predicting Students’ Performance

被引:0
作者
Evangelista E. [1 ]
机构
[1] Zayed University, Abu Dhabi Campus
关键词
bagging; BESTrees; decision tree; ensemble; hyperparameters; machine learning; optimization techniques; student prediction; Weka;
D O I
10.3991/ijet.v18i10.38115
中图分类号
学科分类号
摘要
Every academic institution’s goal is to identify students who require additional assistance and to take appropriate actions to improve their performance. As such, various research studies have focused on developing prediction models that can detect correlated patterns influencing students’ performance, dropout, collaboration, and engagement. Among the influential predictive models available, the bagging ensemble has captured the interest of researchers seeking to improve prediction accuracy over single classifiers. However, prior work in this area has focused mainly on selecting single classifiers as the base classifier of the bagging ensemble, with little to no further optimization of the proposed framework. This study aimed to fill this gap by providing a bagging ensemble framework to optimize its hyperparameters and achieve improved prediction accuracy. The proposed model used the Weka BESTrees data mining tool and Math language course student dataset from UCI Machine Learning Repository. Based on the experiments performed, the proposed bagging optimization technique can effectively increase the accuracy of a traditional bagging ensemble method. It reveals further that the proposed BESTrees framework can achieve an optimized performance when trained with the appropriate hyperparameters and hill climb metrics © 2023, International Journal of Emerging Technologies in Learning.All Rights Reserved.
引用
收藏
页码:150 / 165
页数:15
相关论文
共 41 条
[1]  
Altabrawee H., Ali O., Qaisar S., Predicting Students’ Performance Using Machine Learning Techniques, Journal of University of Babylon for Pure and Applied Sciences, 27, pp. 194-205, (2019)
[2]  
Baashar Y, Alkawsi G., Ali N., Alhussian H., Bahbouh H. T., Predicting Student’s Performance using Machine Learning Methods: A Systematic Literature Review, 2021 International Conference on Computer & Information Sciences (ICCOINS), pp. 357-362, (2021)
[3]  
Evangelista E., Sy B., An Approach for Improved Students’ Performance Prediction Using Homogeneous and Heterogeneous Ensemble Methods, International Journal of Electrical and Computer Engineering (IJECE), 12, 5, pp. 5226-5235, (2022)
[4]  
Li Y, Chen W., A Comparative Performance Assessment of Ensemble Learning for Credit Scoring, Mathematics 2020, 8, 8, (2020)
[5]  
Evangelista E., A Hybrid Machine Learning Framework for Predicting Students’ Performance in Virtual Learning Environment, International Journal of Emerging Technologies in Learning (iJET), 16, 24, pp. 255-272, (2021)
[6]  
Kausar S., Oyelere S., Salal Y., Hussain S., Cifci M., Hilcenko S., Iqbal M., Wenhao Z., Huahu X., Mining Smart Learning Analytics Data Using Ensemble Classifiers, International Journal of Emerging Technologies in Learning (IJET), 15, 12, pp. 81-102, (2020)
[7]  
Tuysuzoglu G., Birant D., Enhanced Bagging (eBagging): A Novel Approach for Ensemble Learning, The International Arab Journal of Information Technology, 17, pp. 515-528, (2020)
[8]  
Sahoo R., Pasayat A., Bhowmick B., Fernandes K., Tiwari M., A Hybrid Ensemble Learning-Based Prediction Model to Minimise Delay in Air Cargo Transport using Bagging and Stacking, International Journal of Production Research, 60, 2, pp. 644-660, (2022)
[9]  
Sumana B. V., Santhanam T., Optimizing the Prediction of Bagging and Boosting, Indian Journal of Science and Technology, 8, pp. 1-13, (2015)
[10]  
Saad H., Use Bagging Algorithm to Improve Prediction Accuracy for Evaluation of Worker Performances at a Production Company, Industrial Engineering and Management, 7, pp. 1-7, (2018)