Are ChatGPT's knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study

被引:192
作者
Huh, Sun [1 ,2 ]
机构
[1] Hallym Univ, Coll Med, Dept Parasitol, Chunchon, South Korea
[2] Hallym Univ, Inst Med Educ, Coll Med, Chunchon, South Korea
来源
JOURNAL OF EDUCATIONAL EVALUATION FOR HEALTH PROFESSIONS | 2023年 / 20卷
基金
英国科研创新办公室;
关键词
Artificial intelligence; Educational measurement; Knowledge; Medical students; Republic of Korea d bl d l;
D O I
10.3352/jeehp.2023.20.1
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and was administered to ChatGPT on January 1, 2023. The examination results were analyzed in terms of ChatGPT's overall performance score, its correct answer rate by the items' knowledge level, and the acceptability of its explanations of the items. ChatGPT's performance was lower than that of the medical students, and ChatGPT's correct answer rate was not related to the items' knowl-edg level. However, ther was relationship beween acceptable explanations and crrect answers. In conclusion, ChatGPT's knowledge and Are ChatGPT's knowle dge a nd interpretation ability comparable to those of medical students in Koeainterpretationfor takingabilitya for thiparas itologyparasitology examination?:examinationa wre notdescriptiveyet studycomparable to those of medical students in Korea.
引用
收藏
页数:5
相关论文
共 6 条
  • [1] Insights from teaching artificial intelligence to medical students in Canada
    Hu, Ricky
    Fan, Kevin Y.
    Pandey, Prashant
    Hu, Zoe
    Yau, Olivia
    Teng, Minnie
    Wang, Patrick
    Li, Anthony
    Ashraf, Mishal
    Singla, Rohit
    [J]. COMMUNICATIONS MEDICINE, 2022, 2 (01):
  • [3] OpenAI, 2022, CHATGPT DEC 15 VERS
  • [4] What should medical students know about artificial intelligence in medicine?
    Park, Seong Ho
    Do, Kyung-Hyun
    Kim, Sungwon
    Park, Joo Hyun
    Lim, Young-Suk
    [J]. JOURNAL OF EDUCATIONAL EVALUATION FOR HEALTH PROFESSIONS, 2019, 16
  • [5] Mastering the game of Go with deep neural networks and tree search
    Silver, David
    Huang, Aja
    Maddison, Chris J.
    Guez, Arthur
    Sifre, Laurent
    van den Driessche, George
    Schrittwieser, Julian
    Antonoglou, Ioannis
    Panneershelvam, Veda
    Lanctot, Marc
    Dieleman, Sander
    Grewe, Dominik
    Nham, John
    Kalchbrenner, Nal
    Sutskever, Ilya
    Lillicrap, Timothy
    Leach, Madeleine
    Kavukcuoglu, Koray
    Graepel, Thore
    Hassabis, Demis
    [J]. NATURE, 2016, 529 (7587) : 484 - +
  • [6] Stokel-Walker Chris, 2022, Nature, DOI 10.1038/d41586-022-04397-7