Artificial intelligence software can generate residency application personal statements that program directors find acceptable and difficult to distinguish from applicant compositions

被引:17
作者
Johnstone, Robert E. [1 ,2 ]
Neely, Grant [1 ]
Sizemore, Daniel C. [1 ]
机构
[1] West Virginia Univ, Dept Anesthesiol, Morgantown, WV USA
[2] West Virginia Univ, Dept Anesthesiol, POB 8255,1 Med Ctr Dr, Morgantown, WV 26506 USA
关键词
Artificial intelligence; ChatGPT; Residency application; Anesthesiology program; Personal statement;
D O I
10.1016/j.jclinane.2023.111185
中图分类号
R614 [麻醉学];
学科分类号
100217 ;
摘要
Study objective: Create personal statements using an artificial intelligence program for anesthesiology residency applications that residency program directors rate as acceptable.Study design: Generate two personal statements and survey program directors.Setting: Anesthesiology residency training programs. Interventions: We instructed ChatGPT, a new artificial-intelligence software program, to generate two 400-word personal statements using the common applicant experiences of involvement in athletics or gourmet cooking. Methods: We sent the generated personal statements to anesthesia program directors and asked them if the statements were acceptable for application to their individual programs, to rate them as poor, good, or excellent, and determine if they could detect anything in the statements that indicated they were not written by an applicant.Measurements: Ninety-four program directors received and opened the survey, and 31 responded. Twenty-eight (90%) responding directors found the personal statement with athletic experience acceptable, with 22 (74%) rating it as good or excellent. Nineteen (61%) program directors did not detect anything in the statement to distinguish it from an applicant-written composition. Twenty-nine (97%) program directors found the personal statement with cooking experience acceptable, with 19 (63%) finding it good or excellent. Twenty-four (80%) directors did not detect anything in the statement to distinguish it from an applicant-written composition.Conclusions: ChatGPT can create personal statements for residency applications that program directors find acceptable and difficult to differentiate from personally crafted statements. Applicants may stop using expensive contractor application services and start using artificial intelligence software to create their personal statements because of its quickness, low cost, and high quality.
引用
收藏
页数:5
相关论文
共 16 条
  • [1] Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media Forum
    Ayers, John W.
    Poliak, Adam
    Dredze, Mark
    Leas, Eric C.
    Zhu, Zechariah
    Kelley, Jessica B.
    Faix, Dennis J.
    Goodman, Aaron M.
    Longhurst, Christopher A.
    Hogarth, Michael
    Smith, Davey M.
    [J]. JAMA INTERNAL MEDICINE, 2023, 183 (06) : 589 - 596
  • [2] Artificial intelligence: disrupting what we know about services
    Bock, Dora E.
    Wolter, Jeremy S.
    Ferrell, O. C.
    [J]. JOURNAL OF SERVICES MARKETING, 2020, 34 (03) : 317 - 334
  • [3] Brainard J, 2023, SCIENCE, V379, P740, DOI 10.1126/science.adh2762
  • [4] ERAS, 2023, MYERAS RES US GUID
  • [5] Nonhuman "Authors" and Implications for the Integrity of Scientific Publication and Medical Knowledge
    Flanagin, Annette
    Bibbins-Domingo, Kirsten
    Berkwits, Michael
    Christiansen, Stacy L.
    [J]. JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2023, 329 (08): : 637 - 639
  • [6] Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers
    Gao, Catherine A.
    Howard, Frederick M.
    Markov, Nikolay S.
    Dyer, Emma C.
    Ramesh, Siddhi
    Luo, Yuan
    Pearson, Alexander T.
    [J]. NPJ DIGITAL MEDICINE, 2023, 6 (01)
  • [7] Grue D., 2023, PARALLELS CONTRACT C
  • [8] Artificial Intelligence in Anesthesiology Current Techniques, Clinical Applications, and Limitations
    Hashimoto, Daniel A.
    Witkowski, Elan
    Gao, Lei
    Meireles, Ozanan
    Rosman, Guy
    [J]. ANESTHESIOLOGY, 2020, 132 (02) : 379 - 394
  • [9] Johnstone Robert E, 2022, J Grad Med Educ, V14, P526, DOI 10.4300/JGME-D-22-00226.1
  • [10] Describing Oneself: What Anesthesiology Residency Applicants Write in Their Personal Statements
    Johnstone, Robert E.
    [J]. ANESTHESIA AND ANALGESIA, 2011, 113 (02) : 421 - 424