3D synthetic CT patch generation and reconstruction by using multi-resolution generative adversarial network

被引:0
|
作者
Deng, Liwei [1 ,2 ]
Chen, Songyu [1 ]
Ji, Yufei [2 ]
Wang, Jing [5 ]
Yang, Xin [3 ,4 ]
Huang, Sijuan [3 ,4 ]
机构
[1] Harbin Univ Sci & Technol, Sch Comp Sci & Technol, Harbin 150080, Heilongjiang, Peoples R China
[2] Harbin Univ Sci & Technol, Sch Automat, Heilongjiang Prov Key Lab Complex Intelligent Syst, Harbin 150080, Heilongjiang, Peoples R China
[3] Sun Yat Sen Univ, Guangdong Prov Clin Res Ctr Canc, State Key Lab Oncol South China,Canc Ctr, Guangdong Key Lab Nasopharyngeal Carcinoma Diag &, Guangzhou 510060, Guangdong, Peoples R China
[4] Guangdong Esophageal Canc Inst, Guangzhou 510060, Guangdong, Peoples R China
[5] South China Normal Univ, Inst Brain Res & Rehabil, Guangzhou 510631, Peoples R China
基金
美国国家科学基金会;
关键词
CBCT; Multi-resolution generation network; Synthetic CT; Radiation therapy; Scatter correction; BEAM COMPUTED-TOMOGRAPHY; RADIATION;
D O I
10.1007/s11760-024-03807-9
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Cone-beam CT (CBCT) offers several advantages, such as lower radiation doses, improved image quality, more accurate image reconstruction, and faster image display, essential for image-guided radiation therapy and supporting patient diagnosis and treatment. Learning-based methods can significantly enhance CBCT image quality and HU accuracy, aiding in dosimetry calculations. In this study, we introduced a new CBCT-to-tensor mapping range to improve the activation function's computational performance. Additionally, a new deep separable feature extraction module was incorporated into the 3D Double-Chain-CycleGAN (DCC-GAN), and patch-based training and inference methods were employed to reduce hardware costs. Experimental results show that the 3D DCC-GAN model outperforms its 2D-based counterpart, with a 6.67% improvement in mean absolute error (MAE), a 5.14% improvement in root mean squared error, a 0.27 increase in peak signal-to-noise ratio from 27.80 to 28.07, and a 6.4% improvement in Gradient Magnitude Similarity Deviation. Furthermore, the 3D DCC-GAN model requires significantly less GPU memory than similar models, even those based on 2D CBCT images.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] 3D Model Generation and Reconstruction Using Conditional Generative Adversarial Network
    Li, Haisheng
    Zheng, Yanping
    Wu, Xiaoqun
    Cai, Qiang
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2019, 12 (02) : 697 - 705
  • [2] 3D Model Generation and Reconstruction Using Conditional Generative Adversarial Network
    Haisheng Li
    Yanping Zheng
    Xiaoqun Wu
    Qiang Cai
    International Journal of Computational Intelligence Systems, 2019, 12 : 697 - 705
  • [3] A Variational Autoencoder Cascade Generative Adversarial Network for Scalable 3D Object Generation and Reconstruction
    Yu, Min-Su
    Jung, Tae-Won
    Yun, Dai-Yeol
    Hwang, Chi-Gon
    Park, Sea-Young
    Kwon, Soon-Chul
    Jung, Kye-Dong
    SENSORS, 2024, 24 (03)
  • [4] 3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution
    Zhang, Hongtao
    Shinomiya, Yuki
    Yoshida, Shinichi
    SENSORS, 2021, 21 (09)
  • [5] Synthetic 3D Ultrasonic Scan Generation Using Optical Flow and Generative Adversarial Networks
    Posilovic, Luka
    Medak, Duje
    Subasic, Marko
    Petkovic, Tomislav
    Budimir, Marko
    Loncaric, Sven
    PROCEEDINGS OF THE 12TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS (ISPA 2021), 2021, : 213 - 218
  • [6] MR-based synthetic CT generation using a conditional generative adversarial network
    Wang, Zhenyu
    Lian, Jie
    Chen, Tao
    Zheng, Wei
    Yue, Shaolong
    Ji, Senrong
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2019, 125 : 17 - 18
  • [7] Generation of Synthetic Rat Brain MRI Scans with a 3D Enhanced Alpha Generative Adversarial Network
    Ferreira, Andre
    Magalhaes, Ricardo
    Meriaux, Sebastien
    Alves, Victor
    APPLIED SCIENCES-BASEL, 2022, 12 (10):
  • [8] Multi temporal Hyperspectral Image Super-Resolution through 3D generative adversarial network
    Li, Jiaojiao
    Cui, Ruxing
    Li, Yunsong
    Li, Bo
    Du, Qian
    Ge, Chiru
    2019 10TH INTERNATIONAL WORKSHOP ON THE ANALYSIS OF MULTITEMPORAL REMOTE SENSING IMAGES (MULTITEMP), 2019,
  • [9] Urban 3D Structure Reconstruction Through a Generative Adversarial Network Model
    Bharath Haridas Aithal
    Soumya Kanta Das
    Prakash Pilinja Subrahmanya
    Arabian Journal for Science and Engineering, 2020, 45 : 10731 - 10741
  • [10] Urban 3D Structure Reconstruction Through a Generative Adversarial Network Model
    Aithal, Bharath Haridas
    Das, Soumya Kanta
    Subrahmanya, Prakash Pilinja
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2020, 45 (12) : 10731 - 10741