DeSmoke-LAP: improved unpaired image-to-image translation for desmoking in laparoscopic surgery

被引:0
|
作者
Pan, Yirou [1 ]
Bano, Sophia [1 ]
Vasconcelos, Francisco [1 ]
Park, Hyun [2 ]
Jeong, Taikyeong Ted [3 ]
Stoyanov, Danail [1 ]
机构
[1] UCL, Wellcome EPSRC Ctr Intervent & Surg Sci, Dept Comp Sci, London, England
[2] CHA Univ, CHA Bundang Med Ctr, Dept Obstet & Gynecol, Seongnam, South Korea
[3] Hallym Univ, Sch Artificial Intelligence Convergence, Chunchon, South Korea
基金
英国工程与自然科学研究理事会;
关键词
Desmoking; Robotic-assisted laparoscopic hysterectomy; Deep learning; Generative adversarial network;
D O I
10.1007/s11548-077-07595-2
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Robotic-assisted laparoscopic surgery has become the trend in medicine thanks to its convenience and lower risk of infection against traditional open surgery. However, the visibility during these procedures may severely deteriorate due to electrocauterisation which generates smoke in the operating cavity. This decreased visibility hinders the procedural time and surgical performance. Recent deep learning-based techniques have shown the potential for smoke and glare removal, but few targets laparoscopic videos. Method We propose DeSmoke-LAP, a new method for removing smoke from real robotic laparoscopic hysterectomy videos. The proposed method is based on the unpaired image-to-image cycle-consistent generative adversarial network in which two novel loss functions, namely, inter-channel discrepancies and dark channel prior, are integrated to facilitate smoke removal while maintaining the true semantics and illumination of the scene. Results DeSmoke-LAP is compared with several state-of-the-art desmoking methods qualitatively and quantitatively using referenceless image quality metrics on 10 laparoscopic hysterectomy videos through 5-fold cross-validation. Conclusion DeSmoke-LAP outperformed existing methods and generated smoke-free images without applying ground truths (paired images) and atmospheric scattering model. This shows distinctive achievement in dehazing in surgery, even in scenarios with partial inhomogenenous smoke. Our code and hysterectomy dataset will be made publicly available at https://www.ucl. ac.uk/interventional-surgical-sciences/weiss-open-research/weiss-open-data-server/desmoke-lap.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] DeSmoke-LAP: improved unpaired image-to-image translation for desmoking in laparoscopic surgery
    Yirou Pan
    Sophia Bano
    Francisco Vasconcelos
    Hyun Park
    Taikyeong Ted. Jeong
    Danail Stoyanov
    International Journal of Computer Assisted Radiology and Surgery, 2022, 17 : 885 - 893
  • [2] DeSmoke-LAP: improved unpaired image-to-image translation for desmoking in laparoscopic surgery
    Pan, Yirou
    Bano, Sophia
    Vasconcelos, Francisco
    Park, Hyun
    Jeong, Taikyeong Ted
    Stoyanov, Danail
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2022, 17 (05) : 885 - 893
  • [3] Unpaired image-to-image translation with improved two-dimensional feature
    Hangyao Tu
    Wanliang Wang
    Jiachen Chen
    Fei Wu
    Guoqing Li
    Multimedia Tools and Applications, 2022, 81 : 43851 - 43872
  • [4] Unpaired image-to-image translation with improved two-dimensional feature
    Tu, Hangyao
    Wang, Wanliang
    Chen, Jiachen
    Wu, Fei
    Li, Guoqing
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (30) : 43851 - 43872
  • [5] Avoiding Shortcuts in Unpaired Image-to-Image Translation
    Fontanini, Tomaso
    Botti, Filippo
    Bertozzi, Massimo
    Prati, Andrea
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I, 2022, 13231 : 463 - 475
  • [6] Unpaired image-to-image translation of structural damage
    Varghese, Subin
    Hoskere, Vedhus
    ADVANCED ENGINEERING INFORMATICS, 2023, 56
  • [7] CycleSAR: SAR Image Despeckling as Unpaired Image-to-Image Translation
    Lattari, Francesco
    Santomarco, Vincenzo
    Santambrogio, Riccardo
    Rucci, Alessio
    Matteucci, Matteo
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [8] Unpaired Image-to-Image Translation with Diffusion Adversarial Network
    Tu, Hangyao
    Wang, Zheng
    Zhao, Yanwei
    MATHEMATICS, 2024, 12 (20)
  • [9] Multilevel contrast strategy for unpaired image-to-image translation
    Han, Minggui
    Shao, Mingwen
    Meng, Lingzhuang
    Liu, Yuexian
    Qiao, Yuanjian
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (06) : 63030
  • [10] Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translation
    Lin, Yupei
    Zhang, Sen
    Chen, Tianshui
    Lu, Yongyi
    Li, Guangping
    Shi, Yukai
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1186 - 1194