Saliency-Aware Deep Learning Approach for Enhanced Endoscopic Image Super-Resolution

被引:9
|
作者
Hayat, Mansoor [1 ]
Aramvith, Supavadee [2 ]
机构
[1] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Bangkok 10330, Thailand
[2] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Multimedia Data Analyt & Proc Res Unit, Bangkok 10330, Thailand
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Surgery; Visualization; Image resolution; Deep learning; Imaging; Feature extraction; Biomedical imaging; Robotic surgery; stereo endoscopic surgical imaging; SR; surgical instruments;
D O I
10.1109/ACCESS.2024.3402953
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The adoption of Stereo Imaging technology within endoscopic procedures represents a transformative advancement in medical imaging, providing surgeons with depth perception and detailed views of internal anatomy for enhanced diagnostic accuracy and surgical precision. However, the practical application of stereo imaging in endoscopy faces challenges, including the generation of low-resolution and blurred images, which can hinder the effectiveness of medical diagnoses and interventions. Our research introduces an endoscopic image SR model in response to these specific. This model features an innovative feature extraction module and an advanced cross-view feature interaction module tailored for the intricacies of endoscopic imagery. Initially trained on the SCARED dataset, our model was rigorously tested across four additional publicly available endoscopic image datasets at scales 2, 4, and 8, demonstrating unparalleled performance improvements in endoscopic SR. Our results are compelling. They show that our model not only substantially enhances the quality of endoscopic images but also consistently surpasses other existing methods like E-SEVSR, DCSSRNet, and CCSBESR in all tested datasets, in quantitative measures such as PSNR and SSIM, and in qualitative evaluations. The successful application of our SR model in endoscopic imaging has the potential to revolutionize medical diagnostics and surgery, significantly increasing the precision and effectiveness of endoscopic procedures. The code will be released on GitHub and can be accessed at https://github.com/cu-vtrg-lab/Saliency-Aware-Deep-Learning-Approach-for-Enhanced-Endoscopic-Image-SR.
引用
收藏
页码:83452 / 83465
页数:14
相关论文
共 50 条
  • [11] DEEP LEARNING BASED IMAGE SUPER-RESOLUTION WITH COUPLED BACKPROPAGATION
    Guo, Tiantong
    Mousavi, Hojjai S.
    Monga, Vishal
    2016 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2016, : 237 - 241
  • [12] Remote Sensing Image Super-Resolution using Deep Learning
    Rajeshwari, P.
    Priya, Pamujula Lakshmi
    Pooja, M.
    Abhishek, G.
    2024 IEEE SPACE, AEROSPACE AND DEFENCE CONFERENCE, SPACE 2024, 2024, : 665 - 668
  • [13] Recent Advances in Deep Learning for Single Image Super-Resolution
    Zhang, Yungang
    Xiang, Yu
    ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2018, 2018, 10989 : 85 - 95
  • [14] Research on Image Super-Resolution Reconstruction Based on Deep Learning
    An, Lingran
    Dai, Fengzhi
    Yuan, Yasheng
    PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB2020), 2020, : 640 - 643
  • [15] Deep Learning for Single Image Super-Resolution: A Brief Review
    Yang, Wenming
    Zhang, Xuechen
    Tian, Yapeng
    Wang, Wei
    Xue, Jing-Hao
    Liao, Qingmin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (12) : 3106 - 3121
  • [16] Deep Learning Based Single Image Super-resolution: A Survey
    Viet Khanh Ha
    Jin-Chang Ren
    Xin-Ying Xu
    Sophia Zhao
    Gang Xie
    Valentin Masero
    Amir Hussain
    International Journal of Automation and Computing, 2019, 16 : 413 - 426
  • [17] DEEP NETWORK FOR IMAGE SUPER-RESOLUTION WITH A DICTIONARY LEARNING LAYER
    Liu, Yang
    Chen, Qingchao
    Wassell, Ian
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 967 - 971
  • [18] Deep Learning Based Single Image Super-resolution:A Survey
    Viet Khanh Ha
    Jin-Chang Ren
    Xin-Ying Xu
    Sophia Zhao
    Gang Xie
    Valentin Masero
    Amir Hussain
    International Journal of Automation and Computing, 2019, 16 (04) : 413 - 426
  • [19] A Review of Hyperspectral Image Super-Resolution Based on Deep Learning
    Chen, Chi
    Wang, Yongcheng
    Zhang, Ning
    Zhang, Yuxi
    Zhao, Zhikang
    REMOTE SENSING, 2023, 15 (11)
  • [20] A Review of Single Image Super-resolution Based on Deep Learning
    Zhang N.
    Wang Y.-C.
    Zhang X.
    Xu D.-D.
    Zidonghua Xuebao/Acta Automatica Sinica, 2020, 46 (12): : 2479 - 2499