Saliency-Aware Deep Learning Approach for Enhanced Endoscopic Image Super-Resolution

被引:9
|
作者
Hayat, Mansoor [1 ]
Aramvith, Supavadee [2 ]
机构
[1] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Bangkok 10330, Thailand
[2] Chulalongkorn Univ, Fac Engn, Dept Elect Engn, Multimedia Data Analyt & Proc Res Unit, Bangkok 10330, Thailand
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Surgery; Visualization; Image resolution; Deep learning; Imaging; Feature extraction; Biomedical imaging; Robotic surgery; stereo endoscopic surgical imaging; SR; surgical instruments;
D O I
10.1109/ACCESS.2024.3402953
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The adoption of Stereo Imaging technology within endoscopic procedures represents a transformative advancement in medical imaging, providing surgeons with depth perception and detailed views of internal anatomy for enhanced diagnostic accuracy and surgical precision. However, the practical application of stereo imaging in endoscopy faces challenges, including the generation of low-resolution and blurred images, which can hinder the effectiveness of medical diagnoses and interventions. Our research introduces an endoscopic image SR model in response to these specific. This model features an innovative feature extraction module and an advanced cross-view feature interaction module tailored for the intricacies of endoscopic imagery. Initially trained on the SCARED dataset, our model was rigorously tested across four additional publicly available endoscopic image datasets at scales 2, 4, and 8, demonstrating unparalleled performance improvements in endoscopic SR. Our results are compelling. They show that our model not only substantially enhances the quality of endoscopic images but also consistently surpasses other existing methods like E-SEVSR, DCSSRNet, and CCSBESR in all tested datasets, in quantitative measures such as PSNR and SSIM, and in qualitative evaluations. The successful application of our SR model in endoscopic imaging has the potential to revolutionize medical diagnostics and surgery, significantly increasing the precision and effectiveness of endoscopic procedures. The code will be released on GitHub and can be accessed at https://github.com/cu-vtrg-lab/Saliency-Aware-Deep-Learning-Approach-for-Enhanced-Endoscopic-Image-SR.
引用
收藏
页码:83452 / 83465
页数:14
相关论文
共 50 条
  • [31] An improved method for single image super-resolution based on deep learning
    Xie, Chao
    Liu, Ying
    Zeng, Weili
    Lu, Xiaobo
    SIGNAL IMAGE AND VIDEO PROCESSING, 2019, 13 (03) : 557 - 565
  • [32] Aerial image super-resolution restruction based on sparsity and deep learning
    Wang C.
    Li Y.
    Li X.
    Wang J.
    Wei W.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2021, 43 (08): : 2045 - 2050
  • [33] A deep learning method for image super-resolution based on geometric similarity
    Lu, Jian
    Hu, Weidong
    Sun, Yi
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 70 : 210 - 219
  • [34] Benchmark of deep learning models for single image super-resolution (SISR)
    Soufi, Omar
    Aarab, Zineb
    Belouadha, Fatima-Zahra
    2022 2ND INTERNATIONAL CONFERENCE ON INNOVATIVE RESEARCH IN APPLIED SCIENCE, ENGINEERING AND TECHNOLOGY (IRASET'2022), 2022, : 558 - 565
  • [35] Hyperspectral Image Super-Resolution Meets Deep Learning: A Survey and Perspective
    Wang, Xinya
    Hu, Qian
    Cheng, Yingsong
    Ma, Jiayi
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (08) : 1668 - 1691
  • [36] An improved method for single image super-resolution based on deep learning
    Chao Xie
    Ying Liu
    Weili Zeng
    Xiaobo Lu
    Signal, Image and Video Processing, 2019, 13 : 557 - 565
  • [37] A review of single image super-resolution reconstruction based on deep learning
    Yu, Ming
    Shi, Jiecong
    Xue, Cuihong
    Hao, Xiaoke
    Yan, Gang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) : 55921 - 55962
  • [38] Image Super-resolution Reconstruction based on Deep Learning and Sparse Representation
    Lei, Qian
    Zhang, Zhao-hui
    Hao, Cun-ming
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER NETWORKS AND COMMUNICATION TECHNOLOGY (CNCT 2016), 2016, 54 : 546 - 555
  • [39] Deep Learning for Image Super-Resolution and Its Application in Urban Security
    Kong, Yihan
    Ren, Xuanang
    Zhou, Renjie
    2ND INTERNATIONAL CONFERENCE ON APPLIED MATHEMATICS, MODELLING, AND INTELLIGENT COMPUTING (CAMMIC 2022), 2022, 12259
  • [40] Deep Learning-Based Single-Image Super-Resolution: A Comprehensive Review
    Chauhan, Karansingh
    Patel, Shail Nimish
    Kumhar, Malaram
    Bhatia, Jitendra
    Tanwar, Sudeep
    Davidson, Innocent Ewean
    Mazibuko, Thokozile F. F.
    Sharma, Ravi
    IEEE ACCESS, 2023, 11 : 21811 - 21830