Cross-Modal PET Synthesis Method Based on Improved Edge-Aware Generative Adversarial Network

被引:0
|
作者
Lei, Liting [1 ]
Zhang, Rui [1 ]
Zhang, Haifei [1 ]
Li, Xiujing [1 ]
Zou, Yuchao [2 ]
Aldosary, Saad [3 ]
Hassanein, Azza S. [4 ]
机构
[1] Nantong Inst Technol, Sch Comp & Informat Engn, Nantong 226002, Peoples R China
[2] Yantai Int Airport Grp Ltd, Maintenance Support Dept, Yantai 264007, Peoples R China
[3] King Saud Univ, Community Coll, Dept Comp Sci, Riyadh 11437, Saudi Arabia
[4] Helwan Univ, Fac Engn, Biomed Engn Dept, Cairo 11792, Egypt
关键词
Generative Adversarial Network; Cross-Modal PET Image Synthesis; Edge Detector; Convolutional Block Attention Module; PERFORMANCE; DISEASE; SYSTEM;
D O I
10.1166/jno.2023.3502
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Current cross-modal synthesis techniques for medical imaging have limits in their ability to accurately capture the structural information of human tissue, leading to problems such edge information loss and poor signaltonoise ratio in the generated images. In order to synthesize PET pictures from Magnetic Resonance (MR) images, a novel approach for cross-modal synthesis of medical images is thus suggested. The foundation of this approach is an enhanced Edge-aware Generative Adversarial Network (Ea-GAN), which integrates an edge detector into the GAN framework to better capture local texture and edge information in the pictures. The Convolutional Block Attention Module (CBAM) is added in the generator portion of the GAN to prioritize important characteristics in the pictures. In order to improve the Ea-GAN discriminator, its receptive field is shrunk to concentrate more on the tiny features of brain tissue in the pictures, boosting the generator's performance. The edge loss between actual PET pictures and synthetic PET images is also included into the IP: 2038 109 20 On: Sat 13 Jan 2024 16:08: 2 algorithm's loss function, further enhancing he gnerator's perormance. The suggested PET image synthesis Copyright: American Scientific Publishers algorithm, which is based on the enhanced Ea-GAN, outperforms different current approaches in terms of Delivered by Ingenta both quantitative and qualitative assessments, according to experimental findings. The architecture of the brain tissue are effectively preserved in the synthetic PET pictures, which also aesthetically nearly resemble genuine images.
引用
收藏
页码:1184 / 1192
页数:9
相关论文
共 50 条
  • [1] Cross-modal retrieval method for thyroid ultrasound image and text based on generative adversarial network
    Xu F.
    Ma X.
    Liu L.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2020, 37 (04): : 641 - 651
  • [2] Edge-Aware Image Super-Resolution Using a Generative Adversarial Network
    Das B.
    Roy S.D.
    SN Computer Science, 4 (2)
  • [3] SEMANTIC PRESERVING GENERATIVE ADVERSARIAL NETWORK FOR CROSS-MODAL HASHING
    Wu, Fei
    Luo, Xiaokai
    Huang, Qinghua
    Wei, Pengfei
    Sun, Ying
    Dong, Xiwei
    Wu, Zhiyong
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2743 - 2747
  • [4] Generative Adversarial Network Based Asymmetric Deep Cross-Modal Unsupervised Hashing
    Cao, Yuan
    Gao, Yaru
    Chen, Na
    Lin, Jiacheng
    Chen, Sheng
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2023, PT I, 2024, 14487 : 30 - 48
  • [5] Edge-aware image outpainting with attentional generative adversarial networks
    Li, Xiaoming
    Zhang, Hengzhi
    Feng, Lei
    Hu, Jing
    Zhang, Rongguo
    Qiao, Qiang
    IET IMAGE PROCESSING, 2022, 16 (07) : 1807 - 1821
  • [6] EDBGAN: Image Inpainting via an Edge-Aware Dual Branch Generative Adversarial Network
    Chen, Minyu
    Liu, Zhi
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 842 - 846
  • [7] Ea-GANs: Edge-Aware Generative Adversarial Networks for Cross-Modality MR Image Synthesis
    Yu, Biting
    Zhou, Luping
    Wang, Lei
    Shi, Yinghuan
    Fripp, Jurgen
    Bourgeat, Pierrick
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (07) : 1750 - 1762
  • [8] Unsupervised Generative Adversarial Cross-Modal Hashing
    Zhang, Jian
    Peng, Yuxin
    Yuan, Mingkuan
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 539 - 546
  • [9] Analysis and Validation of Cross-Modal Generative Adversarial Network for Sensory Substitution
    Kim, Mooseop
    Park, YunKyung
    Moon, KyeongDeok
    Jeong, Chi Yoon
    INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2021, 18 (12)
  • [10] A Cross-Modal Generative Adversarial Network for Scenarios Generation of Renewable Energy
    Kang, Mingyu
    Zhu, Ran
    Chen, Duxin
    Li, Chaojie
    Gu, Wei
    Qian, Xusheng
    Yu, Wenwu
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (02) : 2630 - 2640