Saliency-Aware Deep Learning Approach for Enhanced Endoscopic Image Super-Resolution

被引:9
|
作者
Hayat, Mansoor [1 ]
Aramvith, Supavadee [2 ]
机构
[1] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Bangkok 10330, Thailand
[2] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Multimedia Data Analyt & Proc Res Unit, Bangkok 10330, Thailand
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Surgery; Visualization; Image resolution; Deep learning; Imaging; Feature extraction; Biomedical imaging; Robotic surgery; stereo endoscopic surgical imaging; SR; surgical instruments;
D O I
10.1109/ACCESS.2024.3402953
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The adoption of Stereo Imaging technology within endoscopic procedures represents a transformative advancement in medical imaging, providing surgeons with depth perception and detailed views of internal anatomy for enhanced diagnostic accuracy and surgical precision. However, the practical application of stereo imaging in endoscopy faces challenges, including the generation of low-resolution and blurred images, which can hinder the effectiveness of medical diagnoses and interventions. Our research introduces an endoscopic image SR model in response to these specific. This model features an innovative feature extraction module and an advanced cross-view feature interaction module tailored for the intricacies of endoscopic imagery. Initially trained on the SCARED dataset, our model was rigorously tested across four additional publicly available endoscopic image datasets at scales 2, 4, and 8, demonstrating unparalleled performance improvements in endoscopic SR. Our results are compelling. They show that our model not only substantially enhances the quality of endoscopic images but also consistently surpasses other existing methods like E-SEVSR, DCSSRNet, and CCSBESR in all tested datasets, in quantitative measures such as PSNR and SSIM, and in qualitative evaluations. The successful application of our SR model in endoscopic imaging has the potential to revolutionize medical diagnostics and surgery, significantly increasing the precision and effectiveness of endoscopic procedures. The code will be released on GitHub and can be accessed at https://github.com/cu-vtrg-lab/Saliency-Aware-Deep-Learning-Approach-for-Enhanced-Endoscopic-Image-SR.
引用
收藏
页码:83452 / 83465
页数:14
相关论文
共 50 条
  • [21] A Survey of Deep Learning Video Super-Resolution
    Baniya, Arbind Agrahari
    Lee, Tsz-Kwan
    Eklund, Peter W.
    Aryal, Sunil
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (04): : 2655 - 2676
  • [22] Super-Resolution Reconstruction of Cytoskeleton Image Based on Deep Learning
    Hu Fen
    Lin Yang
    Hou Mengdi
    Hu Haofeng
    Pan Leiting
    Liu Tiegen
    Xu Jingjun
    ACTA OPTICA SINICA, 2020, 40 (24)
  • [23] Learning Dynamic Generative Attention for Single Image Super-Resolution
    Chen, Rui
    Zhang, Yan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (12) : 8368 - 8382
  • [24] Learning Temporal Dynamics for Video Super-Resolution: A Deep Learning Approach
    Liu, Ding
    Wang, Zhaowen
    Fan, Yuchen
    Liu, Xianming
    Wang, Zhangyang
    Chang, Shiyu
    Wang, Xinchao
    Huang, Thomas S.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (07) : 3432 - 3445
  • [25] Deep Objective Quality Assessment Driven Single Image Super-Resolution
    Yan, Bo
    Bare, Bahetiyaer
    Ma, Chenxi
    Li, Ke
    Tan, Weimin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (11) : 2957 - 2971
  • [26] Multimodal Deep Unfolding for Guided Image Super-Resolution
    Marivani, Iman
    Tsiligianni, Evaggelia
    Cornelis, Bruno
    Deligiannis, Nikos
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 8443 - 8456
  • [27] SAFE-RL: Saliency-Aware Counterfactual Explainer for Deep Reinforcement Learning Policies
    Samadi, Amir
    Koufos, Konstantinos
    Debattista, Kurt
    Dianati, Mehrdad
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (11): : 9994 - 10001
  • [28] A Conspectus of Deep Learning Techniques for Single-Image Super-Resolution
    Pattern Recognition and Image Analysis, 2022, 32 : 11 - 32
  • [29] Image super-resolution reconstruction based on sparse representation and deep learning
    Zhang, Jing
    Shao, Minhao
    Yu, Lulu
    Li, Yunsong
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 87
  • [30] Deep Shearlet Residual Learning Network for Single Image Super-Resolution
    Geng, Tianyu
    Liu, Xiao-Yang
    Wang, Xiaodong
    Sun, Guiling
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4129 - 4142