Updated Primer on Generative Artificial Intelligence and Large Language Models in Medical Imaging for Medical Professionals

被引:17
作者
Kim, Kiduk [1 ]
Cho, Kyungjin [2 ]
Jang, Ryoungwoo [3 ]
Kyung, Sunggu [2 ]
Lee, Soyoung [2 ]
Ham, Sungwon [4 ]
Choi, Edward [5 ]
Hong, Gil-Sun [6 ,7 ,8 ,9 ]
Kim, Namkug [1 ,6 ,7 ,9 ,10 ]
机构
[1] Univ Ulsan, Coll Med, Asan Med Ctr, Dept Convergence Med, Seoul, South Korea
[2] Univ Ulsan, Asan Med Inst Convergence Sci & Technol, Asan Med Ctr, Dept Biomed Engn,Coll Med, Seoul, South Korea
[3] Coreline Soft Co Ltd, Seoul, South Korea
[4] Korea Univ, Coll Med, Ansan Hosp, Healthcare Readiness Inst Unified Korea, Ansan, South Korea
[5] Korea Adv Inst Sci & Technol, Daejeon, South Korea
[6] Univ Ulsan, Asan Med Ctr, Coll Med, Dept Radiol, Seoul, South Korea
[7] Univ Ulsan, Res Inst Radiol, Asan Med Ctr, Coll Med, Seoul, South Korea
[8] Univ Ulsan, Coll Med, Dept Radiol, Asan Med Ctr, 88 Olymp Ro 43 Gil, Seoul 05505, South Korea
[9] Univ Ulsan, Res Inst Radiol, Asan Med Ctr, Coll Med, 88 Olymp Ro 43 Gil, Seoul 05505, South Korea
[10] Univ Ulsan, Coll Med, Dept Radiol, Dept Convergence Med & Radiol,Asan Med Ctr, 88 Olymp Ro 43 Gil, Seoul 05505, South Korea
关键词
Artificial intelligence; Generative artificial intelligence; Large language model; Synthetic data; Medical imaging; ADVERSARIAL NETWORK; DOSE CT; REDUCTION; CYCLEGAN;
D O I
10.3348/kjr.2023.0818
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
The emergence of Chat Generative Pre-trained Transformer (ChatGPT), a chatbot developed by OpenAI, has garnered interest in the application of generative artificial intelligence (AI) models in the medical field. This review summarizes different generative AI models and their potential applications in the field of medicine and explores the evolving landscape of Generative Adversarial Networks and diffusion models since the introduction of generative AI models. These models have made valuable contributions to the field of radiology. Furthermore, this review also explores the significance of synthetic data in addressing privacy concerns and augmenting data diversity and quality within the medical domain, in addition to emphasizing the role of inversion in the investigation of generative models and outlining an approach to replicate this process. We provide an overview of Large Language Models, such as GPTs and bidirectional encoder representations (BERTs), that focus on prominent representatives and discuss recent initiatives involving language-vision models in radiology, including innovative large language and vision assistant for biomedicine (LLaVa-Med), to illustrate their practical application. This comprehensive review offers insights into the wide-ranging applications of generative AI models in clinical research and emphasizes their transformative potential.
引用
收藏
页码:224 / 242
页数:19
相关论文
共 130 条
[61]   Fast Non-Markovian Diffusion Model for Weakly Supervised Anomaly Detection in Brain MR Images [J].
Li, Jinpeng ;
Cao, Hanqun ;
Wang, Jiaze ;
Liu, Furui ;
Dou, Qi ;
Chen, Guangyong ;
Heng, Pheng-Ann .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT V, 2023, 14224 :579-589
[62]   Generating synthesized computed tomography (CT) from cone-beam computed tomography (CBCT) using CycleGAN for adaptive radiation therapy [J].
Liang, Xiao ;
Chen, Liyuan ;
Dan Nguyen ;
Zhou, Zhiguo ;
Gu, Xuejun ;
Yang, Ming ;
Wang, Jing ;
Jiang, Steve .
PHYSICS IN MEDICINE AND BIOLOGY, 2019, 64 (12)
[63]   Echocardiography View Classification Using Quality Transfer Star Generative Adversarial Networks [J].
Liao, Zhibin ;
Jafari, Mohammad H. ;
Girgis, Hany ;
Gin, Kenneth ;
Rohling, Robert ;
Abolmaesumi, Purang ;
Tsang, Teresa .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 :687-695
[64]  
Liu HT, 2023, Arxiv, DOI [arXiv:2304.08485, DOI 10.48550/ARXIV.2304.08485]
[65]  
Liu X, 2023, Arxiv, DOI arXiv:2305.15887
[66]  
Lyu Q, 2022, Arxiv, DOI [arXiv:2209.12104, DOI 10.48550/ARXIV.2209.12104]
[67]   Segment anything in medical images [J].
Ma, Jun ;
He, Yuting ;
Li, Feifei ;
Han, Lin ;
You, Chenyu ;
Wang, Bo .
NATURE COMMUNICATIONS, 2024, 15 (01)
[68]   Person authentication using brainwaves (EEG) and maximum a posteriori model adaptation [J].
Marcel, Sebastien ;
Millan, Jose del R. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (04) :743-748
[69]   Dose evaluation of fast synthetic-CT generation using a generative adversarial network for general pelvis MR-only radiotherapy [J].
Maspero, Matteo ;
Savenije, Mark H. F. ;
Dinkla, Anna M. ;
Seevinck, Peter R. ;
Intven, Martijn P. W. ;
Jurgenliemk-Schulz, Ina M. ;
Kerkmeijer, Linda G. W. ;
van den Berg, Cornelis A. T. .
PHYSICS IN MEDICINE AND BIOLOGY, 2018, 63 (18)
[70]   Segment anything model for medical image analysis: An experimental study [J].
Mazurowski, Maciej A. ;
Dong, Haoyu ;
Gu, Hanxue ;
Yang, Jichen ;
Konz, Nicholas ;
Zhang, Yixin .
MEDICAL IMAGE ANALYSIS, 2023, 89