Evaluation of GPT-4's Chest X-Ray Impression Generation: A Reader Study on Performance and Perception

被引：10

作者：

Ziegelmayer, Sebastian ^{[1
,2
]}

Marka, Alexander W. ^{[1
]}

Lenhart, Nicolas ^{[1
]}

Nehls, Nadja ^{[1
]}

Reischl, Stefan ^{[1
]}

Harder, Felix ^{[1
]}

Sauter, Andreas ^{[1
]}

Makowski, Marcus ^{[1
]}

Graf, Markus ^{[1
]}

Gawlitza, Joshua ^{[1
]}

机构：

[1] Tech Univ Munich, Sch Med, Dept Diagnost & Intervent Radiol, Ismaninger Str 22, D-81675 Munich, Germany

[2] Tech Univ Munich, Klinikum Rechts Isar, Ismaninger Str 22, D-81675 Munich, Germany

来源：

JOURNAL OF MEDICAL INTERNET RESEARCH | 2023年 / 25卷

关键词：

generative model; GPT; medical imaging; artificial intelligence; imaging; radiology; radiological; radiography; diagnostic; chest; x-ray; x-rays; generative; multimodal; impression; impressions; image; images; AI;

D O I：

10.2196/50865

中图分类号：

R19 [保健组织与事业（卫生事业管理）];

学科分类号：

摘要：

Exploring the generative capabilities of the multimodal GPT-4, our study uncovered significant differences between radiological assessments and automatic evaluation metrics for chest x-ray impression generation and revealed radiological bias.

引用

页数：5

共 17 条

[11] Raissi M., 2018, arXiv, DOI [10.1002/mp.17312, DOI 10.1002/MP.17312]
[12] Smit A., 2020, C EMP METH NAT LANG
[13] Evaluating GPT-4 on Impressions Generation in Radiology Reports
Sun, Zhaoyi
Ong, Hanley
Kennedy, Patrick
Tang, Liyan
Chen, Shirley
Elias, Jonathan
Lucas, Eugene
Shih, George
Peng, Yifan
[J]. RADIOLOGY, 2023, 307 (05)
[14] ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases
Wang, Xiaosong
Peng, Yifan
Lu, Le
Lu, Zhiyong
Bagheri, Mohammadhadi
Summers, Ronald M.
[J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3462 - 3471
[15] Wei Jerry, 2023, arXiv
[16] Evaluating progress in automatic chest X-ray radiology report generation
Yu, Feiyang
Endo, Mark
Krishnan, Rayan
Pan, Ian
Tsai, Andy
Reis, Eduardo Pontes
Fonseca, Eduardo Kaiser Ururahy Nunes
Lee, Henrique Min Ho
Abad, Zahra Shakeri Hossein
Ng, Andrew Y.
Langlotz, Curtis P.
Venugopal, Vasantha Kumar
Rajpurkar, Pranav
[J]. PATTERNS, 2023, 4 (09):
[17] Zhang Tianyi, 2023, ARXIV

← 1 2 →