Saliency-Aware Deep Learning Approach for Enhanced Endoscopic Image Super-Resolution

被引:9
|
作者
Hayat, Mansoor [1 ]
Aramvith, Supavadee [2 ]
机构
[1] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Bangkok 10330, Thailand
[2] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Multimedia Data Analyt & Proc Res Unit, Bangkok 10330, Thailand
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Surgery; Visualization; Image resolution; Deep learning; Imaging; Feature extraction; Biomedical imaging; Robotic surgery; stereo endoscopic surgical imaging; SR; surgical instruments;
D O I
10.1109/ACCESS.2024.3402953
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The adoption of Stereo Imaging technology within endoscopic procedures represents a transformative advancement in medical imaging, providing surgeons with depth perception and detailed views of internal anatomy for enhanced diagnostic accuracy and surgical precision. However, the practical application of stereo imaging in endoscopy faces challenges, including the generation of low-resolution and blurred images, which can hinder the effectiveness of medical diagnoses and interventions. Our research introduces an endoscopic image SR model in response to these specific. This model features an innovative feature extraction module and an advanced cross-view feature interaction module tailored for the intricacies of endoscopic imagery. Initially trained on the SCARED dataset, our model was rigorously tested across four additional publicly available endoscopic image datasets at scales 2, 4, and 8, demonstrating unparalleled performance improvements in endoscopic SR. Our results are compelling. They show that our model not only substantially enhances the quality of endoscopic images but also consistently surpasses other existing methods like E-SEVSR, DCSSRNet, and CCSBESR in all tested datasets, in quantitative measures such as PSNR and SSIM, and in qualitative evaluations. The successful application of our SR model in endoscopic imaging has the potential to revolutionize medical diagnostics and surgery, significantly increasing the precision and effectiveness of endoscopic procedures. The code will be released on GitHub and can be accessed at https://github.com/cu-vtrg-lab/Saliency-Aware-Deep-Learning-Approach-for-Enhanced-Endoscopic-Image-SR.
引用
收藏
页码:83452 / 83465
页数:14
相关论文
共 50 条
  • [1] Deep Learning Based Approach Implemented to Image Super-Resolution
    Thuong Le-Tien
    Tuan Nguyen-Thanh
    Hanh-Phan Xuan
    Giang Nguyen-Truong
    Vinh Ta-Quoc
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2020, 11 (04) : 209 - 216
  • [2] Deep Learning for Multiple-Image Super-Resolution
    Kawulok, Michal
    Benecki, Pawel
    Piechaczek, Szymon
    Hrynczenko, Krzysztof
    Kostrzewa, Daniel
    Nalepa, Jakub
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (06) : 1062 - 1066
  • [3] Lightweight Stepless Super-Resolution of Remote Sensing Images via Saliency-Aware Dynamic Routing Strategy
    Wu, Hanlin
    Ni, Ning
    Zhang, Libao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [4] Deep Learning for Image Super-Resolution: A Survey
    Wang, Zhihao
    Chen, Jian
    Hoi, Steven C. H.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (10) : 3365 - 3387
  • [5] Deep Learning for Simultaneous Seismic Image Super-Resolution and Denoising
    Li, Jintao
    Wu, Xinming
    Hu, Zhanxuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] Deep Learning for Remote Sensing Image Super-Resolution
    Ul Hoque, Md Reshad
    Burks, Roland, III
    Kwan, Chiman
    Li, Jiang
    2019 IEEE 10TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2019, : 286 - 292
  • [7] Enhanced Deep Learning Super-Resolution for Bathymetry Data
    Li, Xingyan
    Li, Jian
    Williams, Zachary
    Huang, Xin
    Carroll, Mark
    Wang, Jianwu
    2022 IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES, BDCAT, 2022, : 48 - 57
  • [8] Deep Bilateral Learning for Stereo Image Super-Resolution
    Xu, Qingyu
    Wang, Longguang
    Wang, Yingqian
    Sheng, Weidong
    Deng, Xinpu
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 613 - 617
  • [9] Deep Learning Based Single Image Super-resolution: A Survey
    Viet Khanh Ha
    Ren, Jin-Chang
    Xu, Xin-Ying
    Zhao, Sophia
    Xie, Gang
    Masero, Valentin
    Hussain, Amir
    INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2019, 16 (04) : 413 - 426
  • [10] A brief survey on deep learning based image super-resolution
    Zhu X.
    Li S.
    Wang L.
    High Technology Letters, 2021, 27 (03) : 294 - 302