PBChat: Enhance Student's Problem Behavior Diagnosis with Large Language Model

被引:1
作者
Chen, Penghe [1 ,2 ]
Fan, Zhilin [2 ]
Lu, Yu [1 ,2 ]
Xu, Qi [1 ]
机构
[1] Beijing Normal Univ, Adv Innovat Ctr Future Educ, Beijing 100875, Peoples R China
[2] Beijing Normal Univ, Fac Educ, Sch Educ Technol, Beijing 100875, Peoples R China
来源
ARTIFICIAL INTELLIGENCE IN EDUCATION, PT I, AIED 2024 | 2024年 / 14829卷
基金
中国国家自然科学基金;
关键词
Problem Behavior; Large Language Model; Parameter-Efficient Fine-Tuning; ADOLESCENTS;
D O I
10.1007/978-3-031-64302-6_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Student's problem behaviors are undesirable behaviors encompass actions that deviate from established school standards, potentially impacting students' overall well-being and academic success significantly. Diagnosing these behaviors demands a multidisciplinary understanding, posing a challenge for conventional educators. Capitalizing on the advancements in Large Language Model (LLM) technology, we introduce this PBChat model, a specialized LLM designed for pinpointing problem behaviors. We articulate a theoretical framework for problem behavior diagnosis, laying the conceptual groundwork for PBChat. To train PBChat, we curate a multi-turn dialogue dataset based on annotated cases, and subsequently, fine-tune the ChatGLM2 base model using the QLoRA algorithm to build PBChat model. Experimental assessments gauge the performance of PBChat, with both automated and human evaluations revealing its efficacy in successfully diagnosing problem behaviors, surpassing the capabilities of general LLMs.
引用
收藏
页码:32 / 45
页数:14
相关论文
共 33 条
  • [21] Prompt matters: evaluation of large language model chatbot responses related to Peyronie's disease
    Warren, Christopher J.
    Edmonds, Victoria S.
    Payne, Nicolette G.
    Voletti, Sandeep
    Wu, Sarah Y.
    Colquitt, Jennakay
    Sadeghi-Nejad, Hossein
    Punjani, Nahid
    SEXUAL MEDICINE, 2024, 12 (04)
  • [22] Applying Object Detection and Large Language Model to Establish a Smart Telemedicine Diagnosis System with Chatbot: A Case Study of Pressure Injuries Diagnosis System
    Chen, Chun-Chia
    Wei, Chia-Jung
    Tseng, Tsung-Yu
    Chiu, Ming-Chuan
    Chang, Chi-Chang
    TELEMEDICINE AND E-HEALTH, 2024, 30 (06) : e1705 - e1712
  • [23] Enhancing Health Literacy: Evaluating the Readability of Patient Handouts Revised by ChatGPT's Large Language Model
    Swisher, Austin R.
    Wu, Arthur W.
    Liu, Gene C.
    Lee, Matthew K.
    Carle, Taylor R.
    Tang, Dennis M.
    OTOLARYNGOLOGY-HEAD AND NECK SURGERY, 2024, 171 (06) : 1751 - 1757
  • [24] Claude 2.0 large language model: Tackling a real-world classification problem with a new iterative prompt engineering approach
    Caruccio, Loredana
    Cirillo, Stefano
    Polese, Giuseppe
    Solimando, Giandomenico
    Sundaramurthy, Shanmugam
    Tortora, Genoveffa
    INTELLIGENT SYSTEMS WITH APPLICATIONS, 2024, 21
  • [25] LLM-TSFD: An industrial time series human-in-the-loop fault diagnosis method based on a large language model
    Zhang, Qi
    Xu, Chao
    Li, Jie
    Sun, Yicheng
    Bao, Jinsong
    Zhang, Dan
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 264
  • [26] Multi large language model collaboration framework for few-shot link prediction in evolutionary fault diagnosis event graphs
    Wang, Tian
    Wang, Ping
    Yang, Feng
    Wang, Shuai
    Fang, Qiang
    Chi, Meng
    JOURNAL OF PROCESS CONTROL, 2025, 145
  • [27] Evaluation of Code Generation for Simulating Participant Behavior in Experience Sampling Method by Iterative In-Context Learning of a Large Language Model
    Khanshan A.
    Van Gorp P.
    Markopoulos P.
    Proceedings of the ACM on Human-Computer Interaction, 2024, 8 (EICS)
  • [28] Multi-objective math problem generation using large language model through an adaptive multi-level retrieval augmentation framework
    Sun, Jianwen
    Shi, Wangzi
    Shen, Xiaoxuan
    Liu, Shengyingjie
    Wei, Luona
    Wan, Qian
    INFORMATION FUSION, 2025, 119
  • [29] Investigating the capabilities of large language model-based task-oriented dialogue chatbots from a learner's perspective
    Lee, Jang Ho
    Shin, Dongkwang
    Hwang, Yohan
    SYSTEM, 2024, 127
  • [30] Revolutionizing Healthcare with ChatGPT: An Early Exploration of an AI Language Model's Impact on Medicine at Large and its Role in Pediatric Surgery
    Xiao, David
    Meyers, Patrick
    Upperman, Jeffrey S.
    Robinson, Jamie R.
    JOURNAL OF PEDIATRIC SURGERY, 2023, 58 (12) : 2410 - 2415