Multi-technique comparative analysis of machine learning algorithms for improving the prediction of teams’ performance

被引:0
作者
Filippos Giannakas
Christos Troussas
Akrivi Krouska
Cleo Sgouropoulou
Ioannis Voyiatzis
机构
[1] University of West Attica,Department of Informatics and Computer Engineering
来源
Education and Information Technologies | 2022年 / 27卷
关键词
Performance analysis; Comparative analysis; Collaboration; Data optimization; Hyperparameter tuning; Machine learning;
D O I
暂无
中图分类号
学科分类号
摘要
Working in groups is an important collaboration activity in the educational context, where a variety of factors can influence the prediction of the teams’ performance. In the pertinent bibliography, several machine learning models are available for delivering predictions. In this sense, the main goal of the current research is to assess 28 different machine learning models, including a Deep Neural Network (DNN) which is structured by 4 hidden layers, for predicting teams’ performance. Additionally, both data analysis and optimization of input data are also explored for their effectiveness in the improvement of the models’ performance. One key finding of the present study is that the XGBoost model succeeded better prediction results, and its precision and robustness were found to be higher, compared to the other models. Additionally, data optimization was shown to be an essential procedure, since the prediction accuracy of all the models, and specifically, that of the XGBoost, improved and found to be 96% during the first phase that of the process, and 94% during the second phase that of the product. Similarly, after applying the hyperparameter tuning and data optimization, the prediction accuracy of the DNN was also improved and found to be 89.94% and 86.16%, during the same two phases. Finally, for interpreting the output of the ML models, in terms of features’ importance, the Shapley Additive Explanations framework (SHAP) was used.
引用
收藏
页码:8461 / 8487
页数:26
相关论文
共 55 条
  • [1] Ali AA(2019)Collaborative educational environments incorporating mixed reality technologies: A systematic mapping study IEEE Transactions on Learning Technologies 12 321-332
  • [2] Dafoulas GA(1992)Demography and design: Predictors of new product team performance Organization Science 3 321-341
  • [3] Augusto JC(2003)Free riding in group projects and the effects of timing, frequency, and specificity of criteria in peer assessments Journal of Education for Business 78 268-272
  • [4] Ancona DG(2019)The differences in pleasing value and learning performance among different groups using mobile augmented reality system for cultural environment learning Multimedia Tools and Applications 78 4965-4986
  • [5] Caldwell DF(2018)Investigating flipped classroom and problem-based learning in a programming module for computing conversion course Journal of Educational Technology & Society 21 232-247
  • [6] Brooks CM(2018)Gender and participation in an engineering problem-based learning environment Interdisciplinary Journal of Problem-Based Learning 12 2-12
  • [7] Ammons JL(2018)Near real-time comprehension classification with artificial neural networks: Decoding e-learner non-verbal behavior IEEE Transactions on Learning Technologies 11 5-143
  • [8] Chang YS(2019)Mobile game-based learning in secondary education: Students’ immersion, game activities, team performance and learning outcomes Computers in Human Behavior 99 137-7020
  • [9] Chen YS(2018)Arabic natural language processing and machine learning-based systems IEEE Access 7 7011-1071
  • [10] Chiang CW(2018)Promoting collaborative skills in online university: comparing effects of games, mixed reality, social media, and other tools for ict-supported pedagogical practices Behaviour & Information Technology 37 1055-602