AI-assisted analysis of content, structure, and sentiment in MOOC discussion forums

被引:3
|
作者
Yee, Michael [1 ]
Roy, Anindya [2 ]
Perdue, Meghan [2 ]
Cuevas, Consuelo [1 ]
Quigley, Keegan [1 ]
Bell, Ana [3 ]
Rungta, Ahaan [2 ]
Miyagawa, Shigeru [4 ]
机构
[1] MIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USA
[2] MIT, Open Learning, Cambridge, MA USA
[3] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA USA
[4] MIT, Dept Linguist & Philosophy, Cambridge, MA USA
关键词
MOOCs; discussion forums; forum posts; natural language processing; text classification; machine learning; transformers; artificial intelligence;
D O I
10.3389/feduc.2023.1250846
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Discussion forums are a key component of online learning platforms, allowing learners to ask for help, provide help to others, and connect with others in the learning community. Analyzing patterns of forum usage and their association with course outcomes can provide valuable insight into how learners actually use discussion forums, and suggest strategies for shaping forum dynamics to improve learner experiences and outcomes. However, the fine-grained coding of forum posts required for this kind of analysis is a manually intensive process that can be challenging for large datasets, e.g., those that result from popular MOOCs. To address this issue, we propose an AI-assisted labeling process that uses advanced natural language processing techniques to train machine learning models capable of labeling a large dataset while minimizing human annotation effort. We fine-tune pretrained transformer-based deep learning models on category, structure, and emotion classification tasks. The transformer-based models outperform a more traditional baseline that uses support vector machines and a bag-of-words input representation. The transformer-based models also perform better when we augment the input features for an individual post with additional context from the post's thread (e.g., the thread title). We validate model quality through a combination of internal performance metrics, human auditing, and common-sense checks. For our Python MOOC dataset, we find that annotating approximately 1% of the forum posts achieves performance levels that are reliable for downstream analysis. Using labels from the validated AI models, we investigate the association of learner and course attributes with thread resolution and various forms of forum participation. We find significant differences in how learners of different age groups, gender, and course outcome status ask for help, provide help, and make posts with emotional (positive or negative) sentiment.
引用
收藏
页数:17
相关论文
共 43 条
  • [21] AI-assisted image analysis and physiological validation for progressive drought detection in a diverse panel of Gossypium hirsutum L.
    Reno, Vito
    Cardellicchio, Angelo
    Romanjenko, Benjamin Conrad
    Guadagno, Carmela Rosaria
    FRONTIERS IN PLANT SCIENCE, 2024, 14
  • [22] Real-Time Classroom Behavior Analysis for Enhanced Engineering Education: An AI-Assisted Approach
    Hu, Jia
    Huang, Zhenxi
    Li, Jing
    Xu, Lingfeng
    Zou, Yuntao
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2024, 17 (01)
  • [23] Charting the growth through intelligence: A SWOC analysis on AI-assisted radiologic bone age estimation
    Jani, Gargi
    Patel, Bhoomika
    INTERNATIONAL JOURNAL OF LEGAL MEDICINE, 2025, 139 (02) : 679 - 694
  • [24] HAiVA: Hybrid AI-assisted Visual Analysis Framework to Study the Effects of Cloud Properties on Climate Patterns
    Hazarika, Subhashis
    Hirasawa, Haruki
    Kim, Sookyung
    Ramea, Kalai
    Cachay, Salva R.
    Mitra, Peetak
    Hingmire, Dipti
    Singh, Hansi
    Rasch, Phil J.
    2023 IEEE VISUALIZATION AND VISUAL ANALYTICS, VIS, 2023, : 226 - 230
  • [25] AI-ASSISTED emotion analysis during complementary feeding in infants aged 6-11 months
    Gulsen, Murat
    Aydinb, Beril
    Gurer, Guliz
    Yalcin, Siddika Songul
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 166
  • [26] Comparative bibliometric analysis of artificial intelligence-assisted polyp diagnosis and AI-assisted digestive endoscopy: trends and growth in AI gastroenterology (2003-2023)
    Peng, Ziye
    Wang, Xiangyu
    Li, Jiaxin
    Sun, Jiayi
    Wang, Yuwei
    Li, Yanru
    Li, Wen
    Zhang, Shuyi
    Wang, Ximo
    Pei, Zhengcun
    FRONTIERS IN MEDICINE, 2024, 11
  • [27] DEVELOPMENT OF THE AI-ASSISTED THERMAL HYDRAULIC ANALYSIS METHOD FOR CONDENSING BUBBLES IN VERTICAL SUBCOOLED FLOW BOILING
    Zhou, Wen
    Miwa, Shuichiro
    Okamoto, Koji
    Okawa, Tomio
    Tsujimura, Ryoma
    Thanh-Binh Nguyen
    PROCEEDINGS OF 2024 31ST INTERNATIONAL CONFERENCE ON NUCLEAR ENGINEERING, VOL 11, ICONE31 2024, 2024,
  • [28] A context-specific analysis of ethical principles relevant for AI-assisted decision-making in health care
    Larissa Schlicht
    Miriam Räker
    AI and Ethics, 2024, 4 (4): : 1251 - 1263
  • [29] Analysis of trust factors for AI-assisted diagnosis in intelligent Healthcare: Personalized management strategies in chronic disease management
    Wang, Xiyuan
    Wang, Yong
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255
  • [30] Correcting the Measurement Errors of AI-Assisted Labeling in Image Analysis Using Design-Based Supervised Learning
    Maranca, Alessandra Rister Portinari
    Chung, Jihoon
    Hinck, Musashi
    Wolsky, Adam D.
    Egami, Naoki
    Stewart, Brandon M.
    SOCIOLOGICAL METHODS & RESEARCH, 2025,