Updated Primer on Generative Artificial Intelligence and Large Language Models in Medical Imaging for Medical Professionals

被引:12
作者
Kim, Kiduk [1 ]
Cho, Kyungjin [2 ]
Jang, Ryoungwoo [3 ]
Kyung, Sunggu [2 ]
Lee, Soyoung [2 ]
Ham, Sungwon [4 ]
Choi, Edward [5 ]
Hong, Gil-Sun [6 ,7 ,8 ,9 ]
Kim, Namkug [1 ,6 ,7 ,9 ,10 ]
机构
[1] Univ Ulsan, Coll Med, Asan Med Ctr, Dept Convergence Med, Seoul, South Korea
[2] Univ Ulsan, Asan Med Inst Convergence Sci & Technol, Asan Med Ctr, Dept Biomed Engn,Coll Med, Seoul, South Korea
[3] Coreline Soft Co Ltd, Seoul, South Korea
[4] Korea Univ, Coll Med, Ansan Hosp, Healthcare Readiness Inst Unified Korea, Ansan, South Korea
[5] Korea Adv Inst Sci & Technol, Daejeon, South Korea
[6] Univ Ulsan, Asan Med Ctr, Coll Med, Dept Radiol, Seoul, South Korea
[7] Univ Ulsan, Res Inst Radiol, Asan Med Ctr, Coll Med, Seoul, South Korea
[8] Univ Ulsan, Coll Med, Dept Radiol, Asan Med Ctr, 88 Olymp Ro 43 Gil, Seoul 05505, South Korea
[9] Univ Ulsan, Res Inst Radiol, Asan Med Ctr, Coll Med, 88 Olymp Ro 43 Gil, Seoul 05505, South Korea
[10] Univ Ulsan, Coll Med, Dept Radiol, Dept Convergence Med & Radiol,Asan Med Ctr, 88 Olymp Ro 43 Gil, Seoul 05505, South Korea
关键词
Artificial intelligence; Generative artificial intelligence; Large language model; Synthetic data; Medical imaging; ADVERSARIAL NETWORK; DOSE CT; REDUCTION; CYCLEGAN;
D O I
10.3348/kjr.2023.0818
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
The emergence of Chat Generative Pre-trained Transformer (ChatGPT), a chatbot developed by OpenAI, has garnered interest in the application of generative artificial intelligence (AI) models in the medical field. This review summarizes different generative AI models and their potential applications in the field of medicine and explores the evolving landscape of Generative Adversarial Networks and diffusion models since the introduction of generative AI models. These models have made valuable contributions to the field of radiology. Furthermore, this review also explores the significance of synthetic data in addressing privacy concerns and augmenting data diversity and quality within the medical domain, in addition to emphasizing the role of inversion in the investigation of generative models and outlining an approach to replicate this process. We provide an overview of Large Language Models, such as GPTs and bidirectional encoder representations (BERTs), that focus on prominent representatives and discuss recent initiatives involving language-vision models in radiology, including innovative large language and vision assistant for biomedicine (LLaVa-Med), to illustrate their practical application. This comprehensive review offers insights into the wide-ranging applications of generative AI models in clinical research and emphasizes their transformative potential.
引用
收藏
页码:224 / 242
页数:19
相关论文
共 126 条
  • [1] On the usability of synthetic data for improving the robustness of deep learning-based segmentation of cardiac magnetic resonance images
    Al Khalil, Yasmina
    Amirrajab, Sina
    Lorenz, Cristian
    Weese, Juergen
    Pluim, Josien
    Breeuwer, Marcel
    [J]. MEDICAL IMAGE ANALYSIS, 2023, 84
  • [2] [Anonymous], 2022, UNPAIRED IMAGE TO IM
  • [3] Synthetic data: the future of open-access health-care datasets?
    Arora, Anmol
    [J]. LANCET, 2023, 401 (10381) : 997 - 997
  • [4] Bone Suppression on Chest Radiographs for Pulmonary Nodule Detection: Comparison between a Generative Adversarial Network and Dual-Energy Subtraction
    Bae, Kyungsoo
    Oh, Dong Yul
    Yun, Il Dong
    Jeon, Kyung Nyeo
    [J]. KOREAN JOURNAL OF RADIOLOGY, 2022, 23 (01) : 139 - 149
  • [5] Synthetic control arms in studies of multiple myeloma and diffuse large B-cell lymphoma
    Banerjee, Rahul
    Midha, Shonali
    Kelkar, Amar H.
    Goodman, Aaron
    Prasad, Vinay
    Mohyuddin, Ghulam Rehman
    [J]. BRITISH JOURNAL OF HAEMATOLOGY, 2022, 196 (05) : 1274 - 1277
  • [6] Behrendt F, 2023, Arxiv, DOI arXiv:2303.03758
  • [7] Brown T., 2020, Adv. Neural Inf. Proces. Syst., V33, P1877
  • [8] Cao M, 2022, Arxiv, DOI [arXiv:2203.14713, DOI 10.48550/ARXIV.2203.14713]
  • [9] Chen XP, 2018, Arxiv, DOI arXiv:1812.03426
  • [10] CheSS: Chest X-Ray Pre-trained Model via Self-supervised Contrastive Learning
    Cho, Kyungjin
    Kim, Ki Duk
    Nam, Yujin
    Jeong, Jiheon
    Kim, Jeeyoung
    Choi, Changyong
    Lee, Soyoung
    Lee, Jun Soo
    Woo, Seoyeon
    Hong, Gil-Sun
    Seo, Joon Beom
    Kim, Namkug
    [J]. JOURNAL OF DIGITAL IMAGING, 2023, 36 (03) : 902 - 910