3D synthetic CT patch generation and reconstruction by using multi-resolution generative adversarial network

被引:0
|
作者
Deng, Liwei [1 ,2 ]
Chen, Songyu [1 ]
Ji, Yufei [2 ]
Wang, Jing [5 ]
Yang, Xin [3 ,4 ]
Huang, Sijuan [3 ,4 ]
机构
[1] Harbin Univ Sci & Technol, Sch Comp Sci & Technol, Harbin 150080, Heilongjiang, Peoples R China
[2] Harbin Univ Sci & Technol, Sch Automat, Heilongjiang Prov Key Lab Complex Intelligent Syst, Harbin 150080, Heilongjiang, Peoples R China
[3] Sun Yat Sen Univ, Guangdong Prov Clin Res Ctr Canc, State Key Lab Oncol South China,Canc Ctr, Guangdong Key Lab Nasopharyngeal Carcinoma Diag &, Guangzhou 510060, Guangdong, Peoples R China
[4] Guangdong Esophageal Canc Inst, Guangzhou 510060, Guangdong, Peoples R China
[5] South China Normal Univ, Inst Brain Res & Rehabil, Guangzhou 510631, Peoples R China
基金
美国国家科学基金会;
关键词
CBCT; Multi-resolution generation network; Synthetic CT; Radiation therapy; Scatter correction; BEAM COMPUTED-TOMOGRAPHY; RADIATION;
D O I
10.1007/s11760-024-03807-9
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Cone-beam CT (CBCT) offers several advantages, such as lower radiation doses, improved image quality, more accurate image reconstruction, and faster image display, essential for image-guided radiation therapy and supporting patient diagnosis and treatment. Learning-based methods can significantly enhance CBCT image quality and HU accuracy, aiding in dosimetry calculations. In this study, we introduced a new CBCT-to-tensor mapping range to improve the activation function's computational performance. Additionally, a new deep separable feature extraction module was incorporated into the 3D Double-Chain-CycleGAN (DCC-GAN), and patch-based training and inference methods were employed to reduce hardware costs. Experimental results show that the 3D DCC-GAN model outperforms its 2D-based counterpart, with a 6.67% improvement in mean absolute error (MAE), a 5.14% improvement in root mean squared error, a 0.27 increase in peak signal-to-noise ratio from 27.80 to 28.07, and a 6.4% improvement in Gradient Magnitude Similarity Deviation. Furthermore, the 3D DCC-GAN model requires significantly less GPU memory than similar models, even those based on 2D CBCT images.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] DLGAN: Depth-Preserving Latent Generative Adversarial Network for 3D Reconstruction
    Liu, Caixia
    Kong, Dehui
    Wang, Shaofan
    Li, Jinghua
    Yin, Baocai
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 2843 - 2856
  • [22] GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstruction
    Gecer, Baris
    Ploumpis, Stylianos
    Kotsia, Irene
    Zafeiriou, Stefanos
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1155 - 1164
  • [23] Enhanced generative adversarial network for 3D brain MRI super-resolution
    Wang, Jiancong
    Chen, Yuhua
    Wu, Yifan
    Shi, Jianbo
    Gee, James
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 3616 - 3625
  • [24] Generative adversarial network for 3D super-resolution in fringe projection profilometry
    Wan, Chenyang
    Gai, Shaoyan
    Da, Feipeng
    OPTICS AND LASER TECHNOLOGY, 2025, 183
  • [25] Interactive 3D Modeling with a Generative Adversarial Network
    Liu, Jerry
    Yu, Fisher
    Funkhouser, Thomas
    PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2017, : 126 - 134
  • [26] DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion
    Ma, Jiayi
    Xu, Han
    Jiang, Junjun
    Mei, Xiaoguang
    Zhang, Xiao-Ping
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 4980 - 4995
  • [27] 3D Grain Shape Generation in Polycrystals Using Generative Adversarial Networks
    Jangid, Devendra K.
    Brodnik, Neal R.
    Khan, Amil
    Goebel, Michael G.
    Echlin, McLean P.
    Pollock, Tresa M.
    Daly, Samantha H.
    Manjunath, B. S.
    INTEGRATING MATERIALS AND MANUFACTURING INNOVATION, 2022, 11 (01) : 71 - 84
  • [28] Correction to: 3D solid model generation method based on a generative adversarial network
    Wenfeng Du
    Zhuang Xia
    Leyu Han
    Boqing Gao
    Applied Intelligence, 2023, 53 : 18107 - 18107
  • [29] 3D Grain Shape Generation in Polycrystals Using Generative Adversarial Networks
    Devendra K. Jangid
    Neal R. Brodnik
    Amil Khan
    Michael G. Goebel
    McLean P. Echlin
    Tresa M. Pollock
    Samantha H. Daly
    B. S. Manjunath
    Integrating Materials and Manufacturing Innovation, 2022, 11 : 71 - 84
  • [30] GENERATIVE ADVERSARIAL NETWORKS FOR SINGLE PHOTO 3D RECONSTRUCTION
    Kniaz, V. V.
    Remondino, F.
    Knyaz, V. A.
    8TH INTERNATIONAL WORKSHOP 3D-ARCH: 3D VIRTUAL RECONSTRUCTION AND VISUALIZATION OF COMPLEX ARCHITECTURES, 2019, 42-2 (W9): : 403 - 408