Super-resolution reconstruction of ultrasound image using a modified diffusion model

被引:1
|
作者
Liu, Tianyu [1 ]
Han, Shuai [1 ]
Xie, Linru [1 ]
Xing, Wenyu [1 ]
Liu, Chengcheng [1 ,2 ]
Li, Boyi [1 ]
Ta, Dean [2 ,3 ]
机构
[1] Fudan Univ, Inst Biomed Engn & Technol, Acad Engn & Technol, Shanghai 200433, Peoples R China
[2] Fudan Univ, State Key Lab Integrated Chips & Syst, Shanghai 201203, Peoples R China
[3] Fudan Univ, Sch Informat Sci & Technol, Dept Biomed Engn, Shanghai 200438, Peoples R China
基金
中国国家自然科学基金;
关键词
ultrasound image; super-resolution; diffusion model; multi-layer self-attention; wavelet transform; RESOLUTION;
D O I
10.1088/1361-6560/ad4086
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. This study aims to perform super-resolution (SR) reconstruction of ultrasound images using a modified diffusion model, designated as the diffusion model for ultrasound image super-resolution (DMUISR). SR involves converting low-resolution images to high-resolution ones, and the proposed model is designed to enhance the suitability of diffusion models for this task in the context of ultrasound imaging. Approach. DMUISR incorporates a multi-layer self-attention (MLSA) mechanism and a wavelet-transform based low-resolution image (WTLR) encoder to enhance its suitability for ultrasound image SR tasks. The model takes interpolated and magnified images as input and outputs high-quality, detailed SR images. The study utilized 1,334 ultrasound images from the public fetal head-circumference dataset (HC18) for evaluation. Main results. Experiments were conducted at 2x , 4x , and 8x magnification factors. DMUISR outperformed mainstream ultrasound SR methods (Bicubic, VDSR, DECUSR, DRCN, REDNet, SRGAN) across all scales, providing high-quality images with clear structures and rich detailed textures in both hard and soft tissue regions. DMUISR successfully accomplished multiscale SR reconstruction while suppressing over-smoothing and mode collapse problems. Quantitative results showed that DMUISR achieved the best performance in terms of learned perceptual image patch similarity, with a significant decrease of over 50% at all three magnification factors (2x , 4x , and 8x ), as well as improvements in peak signal-to-noise ratio and structural similarity index measure. Ablation experiments validated the effectiveness of the MLSA mechanism and WTLR encoder in improving DMUISR's SR performance. Furthermore, by reducing the number of diffusion steps, the computational time of DMUISR was shortened to nearly one-tenth of its original while maintaining image quality without significant degradation. Significance. This study demonstrates that the modified diffusion model, DMUISR, provides superior performance for SR reconstruction of ultrasound images and has potential in improving imaging quality in the medical ultrasound field.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Using the Kullback-Leibler Divergence to Combine Image Priors in Super-Resolution Image Reconstruction
    Villena, Salvador
    Vega, Miguel
    Derin Babacan, S.
    Molina, Rafael
    Katsaggelos, Aggelos K.
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 893 - 896
  • [22] Overview of Research on Image Super-Resolution Reconstruction
    Yu Mengbei
    Wang Hongjuan
    Liu Mengyang
    Li Pei
    2021 IEEE INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND SOFTWARE ENGINEERING (ICICSE 2021), 2021, : 131 - 135
  • [23] Image reconstruction with improved super-resolution algorithm
    Chen, CY
    Kuo, YC
    Fuh, CS
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2004, 18 (08) : 1513 - 1527
  • [24] Super-Resolution Reconstruction of Radio Tomographic Image
    Sun, Cheng
    Gao, Fei
    Liu, Heng
    2016 IEEE 83RD VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2016,
  • [25] Order filters in super-resolution image reconstruction
    Trimeche, M
    Yrjänäinen, J
    IMAGE PROCESSING: ALGORITHMS AND SYSTEMS II, 2003, 5014 : 190 - 200
  • [26] Depth image super-resolution reconstruction based on a modified joint trilateral filter
    Zhou, Dongsheng
    Wang, Ruyi
    Yang, Xin
    Zhang, Qiang
    Wei, Xiaopeng
    ROYAL SOCIETY OPEN SCIENCE, 2019, 6 (01):
  • [27] ISPDiff: Interpretable Scale-Propelled Diffusion Model for Hyperspectral Image Super-Resolution
    Dong, Wenqian
    Liu, Sen
    Qu, Jiahui
    Xiao, Song
    Li, Yunsong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [28] A Spectral Diffusion Prior for Unsupervised Hyperspectral Image Super-Resolution
    Liu, Jianjun
    Wu, Zebin
    Xiao, Liang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [29] POCS-Based Super-Resolution Image Reconstruction Using Local Gradient Constraint
    Ye, Dong-Jun
    Zhou, Bin
    Zhong, Bi-Ying
    Wei, Wei
    Duan, Xue-Mei
    THIRD INTERNATIONAL SYMPOSIUM ON IMAGE COMPUTING AND DIGITAL MEDICINE (ISICDM 2019), 2019, : 274 - 277
  • [30] Super-resolution image reconstruction using surface fitting with hierarchical structure
    Wang, Xiaofeng
    Zhou, Didong
    Zeng, Nengliang
    Yu, Xina
    Hu, Shaolin
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 53 : 65 - 75