Saliency-Aware Deep Learning Approach for Enhanced Endoscopic Image Super-Resolution

被引:9
|
作者
Hayat, Mansoor [1 ]
Aramvith, Supavadee [2 ]
机构
[1] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Bangkok 10330, Thailand
[2] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Multimedia Data Analyt & Proc Res Unit, Bangkok 10330, Thailand
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Surgery; Visualization; Image resolution; Deep learning; Imaging; Feature extraction; Biomedical imaging; Robotic surgery; stereo endoscopic surgical imaging; SR; surgical instruments;
D O I
10.1109/ACCESS.2024.3402953
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The adoption of Stereo Imaging technology within endoscopic procedures represents a transformative advancement in medical imaging, providing surgeons with depth perception and detailed views of internal anatomy for enhanced diagnostic accuracy and surgical precision. However, the practical application of stereo imaging in endoscopy faces challenges, including the generation of low-resolution and blurred images, which can hinder the effectiveness of medical diagnoses and interventions. Our research introduces an endoscopic image SR model in response to these specific. This model features an innovative feature extraction module and an advanced cross-view feature interaction module tailored for the intricacies of endoscopic imagery. Initially trained on the SCARED dataset, our model was rigorously tested across four additional publicly available endoscopic image datasets at scales 2, 4, and 8, demonstrating unparalleled performance improvements in endoscopic SR. Our results are compelling. They show that our model not only substantially enhances the quality of endoscopic images but also consistently surpasses other existing methods like E-SEVSR, DCSSRNet, and CCSBESR in all tested datasets, in quantitative measures such as PSNR and SSIM, and in qualitative evaluations. The successful application of our SR model in endoscopic imaging has the potential to revolutionize medical diagnostics and surgery, significantly increasing the precision and effectiveness of endoscopic procedures. The code will be released on GitHub and can be accessed at https://github.com/cu-vtrg-lab/Saliency-Aware-Deep-Learning-Approach-for-Enhanced-Endoscopic-Image-SR.
引用
收藏
页码:83452 / 83465
页数:14
相关论文
共 50 条
  • [41] A review of single image super-resolution reconstruction based on deep learning
    Ming Yu
    Jiecong Shi
    Cuihong Xue
    Xiaoke Hao
    Gang Yan
    Multimedia Tools and Applications, 2024, 83 : 55921 - 55962
  • [42] Edge-aware and edge-enhancing single digital image super-resolution using deep learning
    Kolli, Abhiram
    De Silva, Perumadura
    Mohsenzadegan, Kabeh
    Tavakkoli, Vahid
    Al Sayed, Mohamad
    Kyamakya, Kyandoghere
    Pichler, Ralf
    Bouwmeester, Olaf
    Zupan, Robert
    DEVELOPMENTS OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN COMPUTATION AND ROBOTICS, 2020, 12 : 1069 - 1077
  • [43] Deep Learning Algorithms for Single Image Super-Resolution: A Systematic Review
    Ooi, Yoong Khang
    Ibrahim, Haidi
    ELECTRONICS, 2021, 10 (07)
  • [44] A Review of Single Image Super-Resolution Reconstruction Based on Deep Learning
    Wu J.
    Ye X.-J.
    Huang F.
    Chen L.-Q.
    Wang Z.-F.
    Liu W.-X.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (09): : 2265 - 2294
  • [45] A Conspectus of Deep Learning Techniques for Single-Image Super-Resolution
    Pandey, Garima
    Ghanekar, Umesh
    PATTERN RECOGNITION AND IMAGE ANALYSIS, 2022, 32 (01) : 11 - 32
  • [46] A Novel Deep-Learning-Based Enhanced Texture Transformer Network for Reference Image Super-Resolution
    Liu, Changhong
    Li, Hongyin
    Liang, Zhongwei
    Zhang, Yongjun
    Yan, Yier
    Zhong, Ray Y.
    Peng, Shaohu
    ELECTRONICS, 2022, 11 (19)
  • [47] Deep Network Cascade for Image Super-resolution
    Cui, Zhen
    Chang, Hong
    Shan, Shiguang
    Zhong, Bineng
    Chen, Xilin
    COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 : 49 - 64
  • [48] A DEEP DICTIONARY MODEL FOR IMAGE SUPER-RESOLUTION
    Huang, Jun-Jie
    Dragotti, Pier Luigi
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 6777 - 6781
  • [49] Deep Stereoscopic Image Super-Resolution via Interaction Module
    Lei, Jianjun
    Zhang, Zhe
    Fan, Xiaoting
    Yang, Bolan
    Li, Xinxin
    Chen, Ying
    Huang, Qingming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (08) : 3051 - 3061
  • [50] Deep learning based speckle image super-resolution for digital image correlation measurement
    Wang, Lianpo
    Lei, Zhaoyang
    OPTICS AND LASER TECHNOLOGY, 2025, 181