Medical Knowledge Q&A Evaluation Based on ChatGPT Ensemble Learning

被引:0
|
作者
Duan, Pengbo [1 ]
Su, Xin [1 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
来源
HEALTH INFORMATION PROCESSING: EVALUATION TRACK PAPERS, CHIP 2023 | 2024年 / 2080卷
关键词
Medical QA; Prompt Learning; Large Language Model; Ensemble Learning;
D O I
10.1007/978-981-97-1717-0_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the medical field, there is a large amount of clinical medical data, and a lot of knowledge is hidden in it. In recent years, the rapid development of Large Language Models (LLMs) has also affected the development of the medical field. And the application of LLMs has made computer-aided medical diagnosis possible. However, it is critical to ensure the accuracy and reliability of these models in clinical applications. This paper describes our participation in Task 4 of the China Conference on Health Information Processing (CHIP 2023). We propose a framework based on ChatGPT fusion ensemble learning to achieve question answering in medical domain. Experimental results show that our framework has excellent performance, with the Precision of 0.77, the Recall of 0.76, and the F1 of 0.76 in test dataset.
引用
收藏
页码:148 / 155
页数:8
相关论文
共 50 条
  • [1] An ensemble learning method for asthma control level detection with leveraging medical knowledge-based classifier and supervised learning
    Khasha, Roghaye
    Sepehri, Mohammad Mehdi
    Mahdaviani, Seyed Alireza
    JOURNAL OF MEDICAL SYSTEMS, 2019, 43 (06)
  • [2] An ensemble learning method for asthma control level detection with leveraging medical knowledge-based classifier and supervised learning
    Roghaye Khasha
    Mohammad Mehdi Sepehri
    Seyed Alireza Mahdaviani
    Journal of Medical Systems, 2019, 43
  • [3] Knowledge acquisition via ensemble learning
    Zhou, Zhi-Hua
    2008 INTERNATIONAL FORUM ON KNOWLEDGE TECHNOLOGY, 2008, : 361 - 362
  • [4] Ensemble Learning Classification for Medical Diagnosis
    Lohumi, Pratyush
    Garg, Sarthak
    Singh, Taran Pal
    Gopal, Madan
    PROCEEDINGS OF THE 2020 5TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND SECURITY (ICCCS-2020), 2020,
  • [5] Integrative modeling enables ChatGPT to achieve average level of human counselors performance in mental health Q&A
    Huang, Yinghui
    Wang, Weijun
    Zhou, Jinyi
    Zhang, Liang
    Lin, Jionghao
    Liu, Hui
    Hu, Xiangen
    Zhou, Zongkui
    Dong, Wanghao
    INFORMATION PROCESSING & MANAGEMENT, 2025, 62 (05)
  • [6] A Cybersecurity Knowledge Graph Completion Method Based on Ensemble Learning and Adversarial Training
    Wang, Peng
    Liu, Jingju
    Hou, Dongdong
    Zhou, Shicheng
    APPLIED SCIENCES-BASEL, 2022, 12 (24):
  • [7] "In-Network Ensemble": Deep Ensemble Learning with Diversified Knowledge Distillation
    Li, Xingjian
    Xiong, Haoyi
    Chen, Zeyu
    Huan, Jun
    Xu, Cheng-Zhong
    Dou, Dejing
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2021, 12 (05)
  • [8] Improving Symptom-Based Medical Diagnosis Using Ensemble Learning Approaches
    Aissaoui Ferhi, Leila
    Ben Amar, Manel
    Masmoudi, Atef
    Choubani, Fethi
    Bouallegue, Ridha
    SYSTEMS RESEARCH AND BEHAVIORAL SCIENCE, 2025,
  • [9] Comprehensive Fault Evaluation on Maglev Train Based on Ensemble Learning Algorithm
    Long, Zhiqiang
    Wang, Lianchun
    Cai, Ying
    2009 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS ( ICAL 2009), VOLS 1-3, 2009, : 1603 - 1608
  • [10] Mineral prospectivity mapping susceptibility evaluation based on interpretable ensemble learning
    Yu, Zhengbo
    Li, Binbin
    Wang, Xingjie
    ORE GEOLOGY REVIEWS, 2024, 173