COMPUSR: Computationally Efficient Unsupervised Super-Resolution Approach for Wireless Capsule Endoscopy

被引:0
作者
Saha, Nirban [1 ]
Sarvaiya, Anjali [1 ]
Upla, Kishor [1 ]
Raja, Kiran [2 ]
Pedersen, Marius [2 ]
机构
[1] Sardar Vallabhbhai Natl Inst Technol SVNIT, Surat, India
[2] Norwegian Univ Sci & Technol NTNU, Gjovik, Norway
来源
COMPUTER VISION AND IMAGE PROCESSING, CVIP 2023, PT II | 2024年 / 2010卷
关键词
Super-Resolution; Wireless Capsule Endoscopy; Unsupervised Approach; GAN; Computational Efficient; IMAGE SUPERRESOLUTION;
D O I
10.1007/978-3-031-58174-8_38
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wireless Capsule Endoscopy (WCE) is an imaging technology for diseases related to Gastrointestinal (GI) track. However, due to limited hardware, the spatial resolution of acquired images is usually coarser leading to poor diagnostic quality. To enhance high-frequency details associated to edges, object boundaries, corners, etc., which are required for detection and recognition tasks, High-Resolution (HR) images are usually constructed through software-driven Super-Resolution (SR) techniques. Deep learning-based SR approaches has been frequently explored in the computer-vision community recently to increase the SR picture's quality. However, the prime barrier associated with the presently available deep learning SR approaches is the usage of supervised training where, LR images are simulated by using known deterioration (for instance, bicubic downsampling) from the acquired HR images. It is apparent that the deep models trained on such LR-HR pair exhibits poor generalization on the real LR observation. On the other hand, it is challenging to collect large clinical datasets consisting of true LR-HR pair for supervised learning. To circumvent this problem, we propose a computationally efficient unsupervised approach for SR task using Generative Adversarial Network (GAN) for WCE images (referred as COMPUSR). The proposed model avoids LR-HR pair and is trained using unsupervised strategy to learn the degradation of LR observation. It is validated on a derivative dataset of the original Kvasir dataset consisting of 10, 000 training samples and reveals considerable improvement over the other state-of-the-art methods on subjective and quantitative evaluations. Remarkably, the proposed approach needs significantly less number of learnable parameters (i.e., 2.4M) and a number of GFLOPS (i.e., 91.56G) than that of other approaches.
引用
收藏
页码:445 / 460
页数:16
相关论文
共 21 条
  • [1] Gatys LA, 2015, Arxiv, DOI [arXiv:1505.07376, 10.48550/arXiv.1505.07376]
  • [2] SimUSR: A Simple but Strong Baseline for Unsupervised Image Super-resolution
    Ahn, Namhyuk
    Yoo, Jaejun
    Sohn, Kyung-Ah
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1953 - 1961
  • [3] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [4] Frequency Separation for Real-World Super-Resolution
    Fritsche, Manuel
    Gu, Shuhang
    Timofte, Radu
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3599 - 3608
  • [5] Häfner M, 2013, COMP MED SY, P185, DOI 10.1109/CBMS.2013.6627786
  • [6] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [7] Kim J, 2016, PROC CVPR IEEE, P1637, DOI [10.1109/CVPR.2016.182, 10.1109/CVPR.2016.181]
  • [8] Enhanced Deep Residual Networks for Single Image Super-Resolution
    Lim, Bee
    Son, Sanghyun
    Kim, Heewon
    Nah, Seungjun
    Lee, Kyoung Mu
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1132 - 1140
  • [9] Unsupervised Real Image Super-Resolution via Generative Variational AutoEncoder
    Liu, Zhi-Song
    Siu, Wan-Chi
    Wang, Li-Wen
    Li, Chu-Tak
    Cani, Marie-Paule
    Chan, Yui-Lam
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1788 - 1797
  • [10] NTIRE 2020 Challenge on Real-World Image Super-Resolution: Methods and Results
    Lugmayr, Andreas
    Danelljan, Martin
    Timofte, Radu
    Ahn, Namhyuk
    Bai, Dongwoon
    Cai, Jie
    Cao, Yun
    Chen, Junyang
    Cheng, Kaihua
    Chun, SeYoung
    Deng, Wei
    El-Khamy, Mostafa
    Ho, Chiu Man
    Ji, Xiaozhong
    Kheradmand, Amin
    Kim, Gwantae
    Ko, Hanseok
    Lee, Kanghyu
    Lee, Jungwon
    Li, Hao
    Liu, Ziluan
    Liu, Zhi-Song
    Liu, Shuai
    Lu, Yunhua
    Meng, Zibo
    Michelini, Pablo Navarrete
    Micheloni, Christian
    Prajapati, Kalpesh
    Ren, Haoyu
    Seo, Yong Hyeok
    Siu, Wan-Chi
    Sohn, Kyung-Ah
    Tai, Ying
    Umer, Rao Muhammad
    Wang, Shuangquan
    Wang, Huibing
    Wu, Timothy Haoning
    Wu, Haoning
    Yang, Biao
    Yang, Fuzhi
    Yoo, Jaejun
    Zhao, Tongtong
    Zhou, Yuanbo
    Zhuo, Haijie
    Zong, Ziyao
    Zou, Xueyi
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2058 - 2076