DeSmoke-LAP: improved unpaired image-to-image translation for desmoking in laparoscopic surgery

被引:0
|
作者
Pan, Yirou [1 ]
Bano, Sophia [1 ]
Vasconcelos, Francisco [1 ]
Park, Hyun [2 ]
Jeong, Taikyeong Ted [3 ]
Stoyanov, Danail [1 ]
机构
[1] UCL, Wellcome EPSRC Ctr Intervent & Surg Sci, Dept Comp Sci, London, England
[2] CHA Univ, CHA Bundang Med Ctr, Dept Obstet & Gynecol, Seongnam, South Korea
[3] Hallym Univ, Sch Artificial Intelligence Convergence, Chunchon, South Korea
基金
英国工程与自然科学研究理事会;
关键词
Desmoking; Robotic-assisted laparoscopic hysterectomy; Deep learning; Generative adversarial network;
D O I
10.1007/s11548-077-07595-2
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Robotic-assisted laparoscopic surgery has become the trend in medicine thanks to its convenience and lower risk of infection against traditional open surgery. However, the visibility during these procedures may severely deteriorate due to electrocauterisation which generates smoke in the operating cavity. This decreased visibility hinders the procedural time and surgical performance. Recent deep learning-based techniques have shown the potential for smoke and glare removal, but few targets laparoscopic videos. Method We propose DeSmoke-LAP, a new method for removing smoke from real robotic laparoscopic hysterectomy videos. The proposed method is based on the unpaired image-to-image cycle-consistent generative adversarial network in which two novel loss functions, namely, inter-channel discrepancies and dark channel prior, are integrated to facilitate smoke removal while maintaining the true semantics and illumination of the scene. Results DeSmoke-LAP is compared with several state-of-the-art desmoking methods qualitatively and quantitatively using referenceless image quality metrics on 10 laparoscopic hysterectomy videos through 5-fold cross-validation. Conclusion DeSmoke-LAP outperformed existing methods and generated smoke-free images without applying ground truths (paired images) and atmospheric scattering model. This shows distinctive achievement in dehazing in surgery, even in scenarios with partial inhomogenenous smoke. Our code and hysterectomy dataset will be made publicly available at https://www.ucl. ac.uk/interventional-surgical-sciences/weiss-open-research/weiss-open-data-server/desmoke-lap.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Unsupervised Exemplar-Domain Aware Image-to-Image Translation
    Fu, Yuanbin
    Ma, Jiayi
    Guo, Xiaojie
    ENTROPY, 2021, 23 (05)
  • [32] Spatial-Intensity Transforms for Medical Image-to-Image Translation
    Wang, Clinton J.
    Rost, Natalia S.
    Golland, Polina
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (11) : 3362 - 3373
  • [33] Literature Review of Generative models for Image-to-Image translation problems
    Kamil, Anwar
    Shaikh, Talal
    PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND KNOWLEDGE ECONOMY (ICCIKE' 2019), 2019, : 341 - 346
  • [34] Knowledge Distillation Generative Adversarial Network for Image-to-Image Translation
    Sub-r-pa, Chayanon
    Chen, Rung-Ching
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2024, 15 (08) : 896 - 902
  • [35] InvolutionGAN: lightweight GAN with involution for unsupervised image-to-image translation
    Deng, Haipeng
    Wu, Qiuxia
    Huang, Han
    Yang, Xiaowei
    Wang, Zhiyong
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (22) : 16593 - 16605
  • [36] Deep Generative Adversarial Networks for Image-to-Image Translation: A Review
    Alotaibi, Aziz
    SYMMETRY-BASEL, 2020, 12 (10): : 1 - 26
  • [37] InvolutionGAN: lightweight GAN with involution for unsupervised image-to-image translation
    Haipeng Deng
    Qiuxia Wu
    Han Huang
    Xiaowei Yang
    Zhiyong Wang
    Neural Computing and Applications, 2023, 35 : 16593 - 16605
  • [38] Image-to-image translation for improved digital holographic reconstruction based on a generative adversarial network learning framework
    Lu, Zhenzhong
    Cao, Yuping
    Liu, Min
    Han, Biao
    Liao, Jiali
    Sun, Yanling
    Ma, Lin
    OPTICS AND LASER TECHNOLOGY, 2023, 166
  • [39] Underwater dam crack image generation based on unsupervised image-to-image translation
    Huang, Ben
    Kang, Fei
    Li, Xinyu
    Zhu, Sisi
    AUTOMATION IN CONSTRUCTION, 2024, 163
  • [40] Spectral normalization and dual contrastive regularization for image-to-image translation
    Zhao, Chen
    Cai, Wei-Ling
    Yuan, Zheng
    VISUAL COMPUTER, 2025, 41 (01) : 129 - 140