A novel RCACycleGAN model is proposed for the high-precision reconstruction of sparse TFM images

被引:0
作者
Liu, Zhouteng [1 ]
Li, Liming [1 ]
Zhu, Wenfa [1 ,2 ]
Xiang, Yanxun [2 ,3 ]
Fan, Guopeng [1 ,2 ]
Zhang, Hui [1 ,2 ]
机构
[1] Shanghai Univ Engn Sci, Sch Urban Rail Transportat, Shanghai 201620, Peoples R China
[2] East China Univ Sci & Technol, Sch Mech & Power Engn, Shanghai 200237, Peoples R China
[3] East China Univ Sci & Technol, Shanghai Key Lab Intelligent Sensing & Detect Tech, Shanghai 200237, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; sparse total focusing method (TFM) image; image reconstruction; coordinate attention; relativistic discriminator; ARRAY;
D O I
10.1784/insi.2024.66.5.272
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
The sparse total focusing method (TFM) has been shown to enhance the computational efficacy of ultrasound imaging but the image quality of ultrasound regrettably deteriorates with an increase in the sparsity rate of array elements. Deep learning has made remarkable advancements in image processing and cycle-consistent generative adversarial networks (CycleGANs) have been extensively employed to reconstruct diverse image categories. However, due to the incomplete extraction of image feature information by the generator and discriminator in a CycleGAN, high-quality sparse TFM images cannot be directly reconstructed using CycleGANs. There is also a risk of losing crucial feature information related to minor defects. As a result, this paper modifies the generator and discriminator in the CycleGAN to construct a new relativistic discriminator and coordinate attention CycleGAN (RCACycleGAN) model, which enables high-precision reconstruction of sparse TFM images. The addition of the coordinate attention module to the CycleGAN enhances the defective feature representation by fully considering the channel and spatial correlation between regions and using the fusion of spatially perceived feature maps in different directions. It solves the problem of easy loss of defective key feature information. The relativistic discriminator replaces the PatchGAN discriminator in the CycleGAN and evaluates the quality of both real and sparse TFM reconstructed images to ensure a relative image quality evaluation. This process solves the problem of unstable image quality of the sparse TFM reconstructed image. Experimental results demonstrate that RCACycleGAN can stably reconstruct sparse TFM images even in small sample dataset scenarios. The proposed network model reconstructs images with better accuracy, including in terms of structural similarity, defect roundness and area, and has a shorter training time than several existing network models.
引用
收藏
页码:272 / 280and286
页数:10
相关论文
共 34 条
  • [1] Ahn N, 2018, Arxiv, DOI [arXiv:1803.08664, DOI 10.48550/ARXIV.1803.08664]
  • [2] Miniaturized phased-array ultrasound and photoacoustic endoscopic imaging system
    Basij, Maryam
    Yan, Yan
    Alshahrani, Suhail S.
    Helmi, Hamid
    Burton, Timothy K.
    Burmeister, Jay W.
    Dominello, Michael M.
    Winer, Ira S.
    Mehrmohammadi, Mohammad
    [J]. PHOTOACOUSTICS, 2019, 15
  • [3] Study on the Influence of Learning engagement on Deep Learning in E-Learning Environment
    Dong Xiaoxiao
    Zhou Dongdai
    [J]. ICIET 2020: 2020 8TH INTERNATIONAL CONFERENCE ON INFORMATION AND EDUCATION TECHNOLOGY, 2020, : 63 - 67
  • [4] RECOVER THE RESIDUAL OF RESIDUAL: RECURRENT RESIDUAL REFINEMENT NETWORK FOR IMAGE SUPER-RESOLUTION
    Gao, Tianxiao
    Xiong, Ruiqin
    Zhao, Rui
    Zhang, Jian
    Zhu, Shuyuan
    Huang, Tiejun
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1804 - 1808
  • [5] Goodfellow I, 2016, ADAPT COMPUT MACH LE, P1
  • [6] Heusel M, 2017, ADV NEUR IN, V30
  • [7] Post-processing of the full matrix of ultrasonic transmit-receive array data for non-destructive evaluation
    Holmes, C
    Drinkwater, BW
    Wilcox, PD
    [J]. NDT & E INTERNATIONAL, 2005, 38 (08) : 701 - 711
  • [8] Hou QB, 2021, Arxiv, DOI [arXiv:2103.02907, 10.48550/arXiv.2103.02907]
  • [9] Object-based multispectral image fusion method using deep learning
    Jang, Hyunsung
    Ha, Namkoo
    Yeon, Yoonmo
    Kwon, Kuyong
    Gil, Sungho
    Lee, Seungha
    Park, Sungsoon
    Jung, Hyungjoo
    Sohn, Kwanghoon
    [J]. ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING IN DEFENSE APPLICATIONS, 2019, 11169
  • [10] Ji Y, 2020, WD SCI P COMP ENG, V12, P1180