Super-resolution reconstruction of ultrasound image using a modified diffusion model

被引:2
作者
Liu, Tianyu [1 ]
Han, Shuai [1 ]
Xie, Linru [1 ]
Xing, Wenyu [1 ]
Liu, Chengcheng [1 ,2 ]
Li, Boyi [1 ]
Ta, Dean [2 ,3 ]
机构
[1] Fudan Univ, Inst Biomed Engn & Technol, Acad Engn & Technol, Shanghai 200433, Peoples R China
[2] Fudan Univ, State Key Lab Integrated Chips & Syst, Shanghai 201203, Peoples R China
[3] Fudan Univ, Sch Informat Sci & Technol, Dept Biomed Engn, Shanghai 200438, Peoples R China
基金
中国国家自然科学基金;
关键词
ultrasound image; super-resolution; diffusion model; multi-layer self-attention; wavelet transform; RESOLUTION;
D O I
10.1088/1361-6560/ad4086
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. This study aims to perform super-resolution (SR) reconstruction of ultrasound images using a modified diffusion model, designated as the diffusion model for ultrasound image super-resolution (DMUISR). SR involves converting low-resolution images to high-resolution ones, and the proposed model is designed to enhance the suitability of diffusion models for this task in the context of ultrasound imaging. Approach. DMUISR incorporates a multi-layer self-attention (MLSA) mechanism and a wavelet-transform based low-resolution image (WTLR) encoder to enhance its suitability for ultrasound image SR tasks. The model takes interpolated and magnified images as input and outputs high-quality, detailed SR images. The study utilized 1,334 ultrasound images from the public fetal head-circumference dataset (HC18) for evaluation. Main results. Experiments were conducted at 2x , 4x , and 8x magnification factors. DMUISR outperformed mainstream ultrasound SR methods (Bicubic, VDSR, DECUSR, DRCN, REDNet, SRGAN) across all scales, providing high-quality images with clear structures and rich detailed textures in both hard and soft tissue regions. DMUISR successfully accomplished multiscale SR reconstruction while suppressing over-smoothing and mode collapse problems. Quantitative results showed that DMUISR achieved the best performance in terms of learned perceptual image patch similarity, with a significant decrease of over 50% at all three magnification factors (2x , 4x , and 8x ), as well as improvements in peak signal-to-noise ratio and structural similarity index measure. Ablation experiments validated the effectiveness of the MLSA mechanism and WTLR encoder in improving DMUISR's SR performance. Furthermore, by reducing the number of diffusion steps, the computational time of DMUISR was shortened to nearly one-tenth of its original while maintaining image quality without significant degradation. Significance. This study demonstrates that the modified diffusion model, DMUISR, provides superior performance for SR reconstruction of ultrasound images and has potential in improving imaging quality in the medical ultrasound field.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Super-resolution image reconstruction based on sparse threshold
    He Yang
    Huang Wei
    Wang Xin-hua
    Hao Jian-kun
    CHINESE OPTICS, 2016, 9 (05): : 532 - 539
  • [42] Super-Resolution Image Reconstruction for Ultrasonic Nondestructive Evaluation
    Li, Shanglei
    Chu, Tsuchin Philip
    IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2013, 60 (12) : 2575 - 2585
  • [43] An Adaptive Regularization Image Super-resolution Reconstruction Algorithm
    Zhao Xiao-qiang
    Jia Yun-xia
    2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 7258 - 7262
  • [44] Implementation schemes of regularization super-resolution image reconstruction
    Yan, Hua
    Liu, Ju
    2007 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS, VOLS 1 AND 2, 2007, : 615 - +
  • [45] Event-Guided Image Super-Resolution Reconstruction
    Guo, Guangsha
    Feng, Yang
    Lv, Hengyi
    Zhao, Yuchen
    Liu, Hailong
    Bi, Guoling
    SENSORS, 2023, 23 (04)
  • [46] MAP Based Super-resolution Image Reconstruction Method
    He, Panli
    Wang, Boyang
    Liu, Xiaoxia
    Han, Xiaowei
    ADVANCES IN MANUFACTURING TECHNOLOGY, PTS 1-4, 2012, 220-223 : 2754 - 2757
  • [47] An Experimental Comparison of Super-resolution Reconstruction for Image Sequences
    Gong Youmin
    Zou Xing
    Guo Yanning
    Dong Zhen
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 5044 - 5049
  • [48] Super-resolution PET image reconstruction with sparse representation
    Hu, Zhanli
    Li, Tao
    Yang, Yongfeng
    Liu, Xin
    Zheng, Hairong
    Liang, Dong
    2017 IEEE NUCLEAR SCIENCE SYMPOSIUM AND MEDICAL IMAGING CONFERENCE (NSS/MIC), 2017,
  • [49] Manifold-regularization super-resolution image reconstruction
    Zeng X.-H.
    Hou S.-L.
    Zeng, Xian-Hua (zengxh@cqupt.edu.cn), 2017, Computer Society of the Republic of China (28) : 119 - 136
  • [50] Super-Resolution Image Reconstruction Based on the Minimal Surface Constraint on the Manifold
    Yuan, Jian-Hua
    PROCEEDINGS OF THE 2009 CHINESE CONFERENCE ON PATTERN RECOGNITION AND THE FIRST CJK JOINT WORKSHOP ON PATTERN RECOGNITION, VOLS 1 AND 2, 2009, : 277 - 280