Super-resolution reconstruction of ultrasound image using a modified diffusion model

被引:2
作者
Liu, Tianyu [1 ]
Han, Shuai [1 ]
Xie, Linru [1 ]
Xing, Wenyu [1 ]
Liu, Chengcheng [1 ,2 ]
Li, Boyi [1 ]
Ta, Dean [2 ,3 ]
机构
[1] Fudan Univ, Inst Biomed Engn & Technol, Acad Engn & Technol, Shanghai 200433, Peoples R China
[2] Fudan Univ, State Key Lab Integrated Chips & Syst, Shanghai 201203, Peoples R China
[3] Fudan Univ, Sch Informat Sci & Technol, Dept Biomed Engn, Shanghai 200438, Peoples R China
基金
中国国家自然科学基金;
关键词
ultrasound image; super-resolution; diffusion model; multi-layer self-attention; wavelet transform; RESOLUTION;
D O I
10.1088/1361-6560/ad4086
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. This study aims to perform super-resolution (SR) reconstruction of ultrasound images using a modified diffusion model, designated as the diffusion model for ultrasound image super-resolution (DMUISR). SR involves converting low-resolution images to high-resolution ones, and the proposed model is designed to enhance the suitability of diffusion models for this task in the context of ultrasound imaging. Approach. DMUISR incorporates a multi-layer self-attention (MLSA) mechanism and a wavelet-transform based low-resolution image (WTLR) encoder to enhance its suitability for ultrasound image SR tasks. The model takes interpolated and magnified images as input and outputs high-quality, detailed SR images. The study utilized 1,334 ultrasound images from the public fetal head-circumference dataset (HC18) for evaluation. Main results. Experiments were conducted at 2x , 4x , and 8x magnification factors. DMUISR outperformed mainstream ultrasound SR methods (Bicubic, VDSR, DECUSR, DRCN, REDNet, SRGAN) across all scales, providing high-quality images with clear structures and rich detailed textures in both hard and soft tissue regions. DMUISR successfully accomplished multiscale SR reconstruction while suppressing over-smoothing and mode collapse problems. Quantitative results showed that DMUISR achieved the best performance in terms of learned perceptual image patch similarity, with a significant decrease of over 50% at all three magnification factors (2x , 4x , and 8x ), as well as improvements in peak signal-to-noise ratio and structural similarity index measure. Ablation experiments validated the effectiveness of the MLSA mechanism and WTLR encoder in improving DMUISR's SR performance. Furthermore, by reducing the number of diffusion steps, the computational time of DMUISR was shortened to nearly one-tenth of its original while maintaining image quality without significant degradation. Significance. This study demonstrates that the modified diffusion model, DMUISR, provides superior performance for SR reconstruction of ultrasound images and has potential in improving imaging quality in the medical ultrasound field.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Super-resolution image reconstruction using surface fitting with hierarchical structure
    Wang, Xiaofeng
    Zhou, Didong
    Zeng, Nengliang
    Yu, Xina
    Hu, Shaolin
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 53 : 65 - 75
  • [32] MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusion
    Chung, Hyungjin
    Lee, Eun Sun
    Ye, Jong Chul
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (04) : 922 - 934
  • [33] SUPER-RESOLUTION RECONSTRUCTION OF IMAGE BASED ON PRIOR IMAGE CONSTRAINT
    Tang Bin-Bing
    Wang Zheng-Ming
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2008, 27 (05) : 389 - 392
  • [34] OmniSSR: Zero-Shot Omnidirectional Image Super-Resolution Using Stable Diffusion Model
    Li, Runyi
    Sheng, Xuhan
    Li, Weiqi
    Zhang, Jian
    COMPUTER VISION - ECCV 2024, PT XXXI, 2025, 15089 : 198 - 216
  • [35] Lightweight Stereo Image Super-Resolution Using modified Parallax Attention
    Govind, Smriti
    Pradeep, R.
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2025, : 1 - 10
  • [36] Image Super-Resolution Reconstruction Based on Hierarchical Clustering
    Zeng Taiying
    Du Fei
    ACTA OPTICA SINICA, 2018, 38 (04)
  • [37] Terahertz Super-Resolution Image Reconstruction by Frequency Mapping
    Zhu, Ting
    Fang, Guangyou
    Pickwell-MacPherson, Emma
    Chen, Xuequan
    2024 49TH INTERNATIONAL CONFERENCE ON INFRARED, MILLIMETER, AND TERAHERTZ WAVES, IRMMW-THZ 2024, 2024,
  • [38] Super-Resolution Image Reconstruction Based on MWSVR Estimation
    Cheng, Hui
    Liu, Junbo
    2008 7TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-23, 2008, : 5990 - 5994
  • [39] Adaptive Regularization of Infrared Image Super-resolution Reconstruction
    Dai Shao-Sheng
    Xiang Hai-Yan
    Du Zhi-Hui
    Liu Jin-Song
    2014 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT, 2014,
  • [40] Efficient image magnification and applications to super-resolution reconstruction
    Shao, Wenze
    Wei, Zhihui
    IEEE ICMA 2006: PROCEEDING OF THE 2006 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, VOLS 1-3, PROCEEDINGS, 2006, : 2372 - +