Earliest Possible Global and Local Interpretation of Students' Performance in Virtual Learning Environment by Leveraging Explainable AI

被引:5
作者
Adnan, Muhammad [1 ]
Uddin, M. Irfan [1 ]
Khan, Emel [2 ]
Alharithi, Fahd S. [3 ]
Amin, Samina [1 ]
Alzahrani, Ahmad A. [4 ]
机构
[1] Kohat Univ Sci & Technol KUST, Inst Comp, Kohat 26000, Pakistan
[2] Kohat Univ Sci & Technol KUST, Inst Numer Sci, Kohat 26000, Pakistan
[3] Taif Univ, Coll Comp & Informat Technol, Dept Comp Sci, Taif 21944, Saudi Arabia
[4] Umm Al Qura Univ, Coll Comp & Informat Syst, Dept Informat Syst, Mecca 24382, Saudi Arabia
关键词
Global explainability; local explainability; explainable AI; course length; decision making; artificial intelligence; personalized feedback; earliest possible intervention; earliest possible interpretation; ARTIFICIAL-INTELLIGENCE; EARLY PREDICTION; ACADEMIC-PERFORMANCE; HIGHER-EDUCATION; AT-RISK; ENGAGEMENT;
D O I
10.1109/ACCESS.2022.3227072
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this research study, we propose an Explainable Artificial Intelligence (XAI) model that provides the earliest possible global and local interpretation of students' performance at various stages of course length. Global and local interpretation is provided in such a way that the prediction accuracy of a single local observation is close to the model's overall prediction accuracy. For the earliest possible understanding of student performance, local and global interpretation is provided at 20%, 40%, 60%, 80%, and 100% of course length. Machine Learning (ML) and Deep Learning (DL) which are subfields of Artificial Intelligence (AI) have recently emerged to assist all educational institution's in predicting the performance, engagement, and dropout rate of online students. Unfortunately, traditional ML and DL techniques lack in providing data analysis results in an understandable human way. Explainable AI (XAI), a new branch of AI, can be used in educational settings, specifically in VLEs, to provide the instructor with the study performance results of thousands or even millions of online students in a human-understandable way. Thus, unlike black box approaches such as traditional ML and DL techniques, XAI can help instructors to interpret the strengths and weaknesses of an individual student, providing them with timely personalized feedback and guidance. Various traditional and various ensemble ML algorithms were trained on demographic, clickstream, and assessment features to determine which algorithm gives the best performance result. The best-performing ML algorithm was ultimately selected and provided to the XAI model as an input for local and global interpretation of students' study behavior at various percentages of course length. We have used various XAI tools to give students' performance reports to instructors, in an explicable human way, at different stages of course length. The intermediate data analysis and performance reports will help instructors and all key stakeholders in decision-making and optimally facilitate online students.
引用
收藏
页码:129843 / 129864
页数:22
相关论文
共 66 条
  • [1] Predicting at-Risk Students at Different Percentages of Course Length for Early Intervention Using Machine Learning Models
    Adnan, Muhammad
    Habib, Asad
    Ashraf, Jawad
    Mussadiq, Shafaq
    Raza, Arsalan Ali
    Abid, Muhammad
    Bashir, Maryam
    Khan, Sana Ullah
    [J]. IEEE ACCESS, 2021, 9 : 7519 - 7539
  • [2] Ahmed Dindar Mikaeel, 2021, 2021 IEEE International Conference on Automatic Control & Intelligent Systems (I2CACIS), P276, DOI 10.1109/I2CACIS52118.2021.9495862
  • [3] From Artificial Intelligence to Explainable Artificial Intelligence in Industry 4.0: A Survey on What, How, and Where
    Ahmed, Imran
    Jeon, Gwanggil
    Piccialli, Francesco
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (08) : 5031 - 5042
  • [4] Utilizing crowdsourcing and machine learning in education: Literature review
    Alenezi, Hadeel S.
    Faisal, Maha H.
    [J]. EDUCATION AND INFORMATION TECHNOLOGIES, 2020, 25 (04) : 2971 - 2986
  • [6] An Explainable Model for Identifying At-Risk Student at Higher Education
    Alwarthan, Sarah
    Aslam, Nida
    Khan, Irfan Ullah
    [J]. IEEE ACCESS, 2022, 10 : 107649 - 107668
  • [7] Adoption and Use of Learning Management Systems in Education: The Role of Playfulness and Self-Management
    Balkaya, Selen
    Akkucuk, Ulas
    [J]. SUSTAINABILITY, 2021, 13 (03) : 1 - 27
  • [8] An Early Feedback Prediction System for Learners At-Risk Within a First-Year Higher Education Course
    Baneres, David
    Elena Rodriguez-Gonzalez, M.
    Serra, Montse
    [J]. IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, 2019, 12 (02): : 249 - 263
  • [9] Q-matrix Extraction from Real Response Data Using Nonnegative Matrix Factorizations
    Casalino, Gabriella
    Castiello, Ciro
    Del Buono, Nicoletta
    Esposito, Flavia
    Mencar, Corrado
    [J]. COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2017, PT I, 2017, 10404 : 203 - 216
  • [10] Utilizing Student Time Series Behaviour in Learning Management Systems for Early Prediction of Course Performance
    Chen, Fu
    Cui, Ying
    [J]. JOURNAL OF LEARNING ANALYTICS, 2020, 7 (02): : 1 - 17