DeSmoke-LAP: improved unpaired image-to-image translation for desmoking in laparoscopic surgery

被引:0
|
作者
Pan, Yirou [1 ]
Bano, Sophia [1 ]
Vasconcelos, Francisco [1 ]
Park, Hyun [2 ]
Jeong, Taikyeong Ted [3 ]
Stoyanov, Danail [1 ]
机构
[1] UCL, Wellcome EPSRC Ctr Intervent & Surg Sci, Dept Comp Sci, London, England
[2] CHA Univ, CHA Bundang Med Ctr, Dept Obstet & Gynecol, Seongnam, South Korea
[3] Hallym Univ, Sch Artificial Intelligence Convergence, Chunchon, South Korea
基金
英国工程与自然科学研究理事会;
关键词
Desmoking; Robotic-assisted laparoscopic hysterectomy; Deep learning; Generative adversarial network;
D O I
10.1007/s11548-077-07595-2
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Robotic-assisted laparoscopic surgery has become the trend in medicine thanks to its convenience and lower risk of infection against traditional open surgery. However, the visibility during these procedures may severely deteriorate due to electrocauterisation which generates smoke in the operating cavity. This decreased visibility hinders the procedural time and surgical performance. Recent deep learning-based techniques have shown the potential for smoke and glare removal, but few targets laparoscopic videos. Method We propose DeSmoke-LAP, a new method for removing smoke from real robotic laparoscopic hysterectomy videos. The proposed method is based on the unpaired image-to-image cycle-consistent generative adversarial network in which two novel loss functions, namely, inter-channel discrepancies and dark channel prior, are integrated to facilitate smoke removal while maintaining the true semantics and illumination of the scene. Results DeSmoke-LAP is compared with several state-of-the-art desmoking methods qualitatively and quantitatively using referenceless image quality metrics on 10 laparoscopic hysterectomy videos through 5-fold cross-validation. Conclusion DeSmoke-LAP outperformed existing methods and generated smoke-free images without applying ground truths (paired images) and atmospheric scattering model. This shows distinctive achievement in dehazing in surgery, even in scenarios with partial inhomogenenous smoke. Our code and hysterectomy dataset will be made publicly available at https://www.ucl. ac.uk/interventional-surgical-sciences/weiss-open-research/weiss-open-data-server/desmoke-lap.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Unsupervised Image-to-Image Translation with Style Consistency
    Lai, Binxin
    Wang, Yuan-Gen
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VI, 2024, 14430 : 322 - 334
  • [22] Image-to-image Translation Based on Improved Cycle-consistent Generative Adversarial Network
    Zhang Jinglei
    Hou Yawei
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (05) : 1216 - 1222
  • [23] MULTIMODAL IMAGE-TO-IMAGE TRANSLATION FOR GENERATION OF GASTRITIS IMAGES
    Togo, Ren
    Ogawa, Takahiro
    Haseyama, Miki
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2466 - 2470
  • [24] OmniStyleGAN for Style-Guided Image-to-Image Translation
    Zhao, Qianyi
    Wang, Mengyin
    Zhang, Qing
    Wang, Fasheng
    Sun, Fuming
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XI, 2025, 15041 : 351 - 365
  • [25] A Diffusion Model Translator for Efficient Image-to-Image Translation
    Xia, Mengfei
    Zhou, Yu
    Yi, Ran
    Liu, Yong-Jin
    Wang, Wenping
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 10272 - 10283
  • [26] Improving Learning time in Unsupervised Image-to-Image Translation
    Min, Tae-Hong
    Kim, Do-Yun
    Choi, Young-June
    2019 1ST INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION (ICAIIC 2019), 2019, : 455 - 458
  • [27] Hierarchical image-to-image translation with nested distributions modeling
    Qiao, Shishi
    Wang, Ruiping
    Shan, Shiguang
    Chen, Xilin
    PATTERN RECOGNITION, 2024, 146
  • [28] Photogenic Guided Image-to-Image Translation With Single Encoder
    Oh, Rina
    Gonsalves, T.
    IEEE OPEN JOURNAL OF THE COMPUTER SOCIETY, 2024, 5 : 624 - 635
  • [29] EM-LAST: Effective Multidimensional Latent Space Transport for an Unpaired Image-to-Image Translation With an Energy-Based Model
    Han, Giwoong
    Min, Jinhong
    Han, Sung Won
    IEEE ACCESS, 2022, 10 : 72839 - 72849
  • [30] Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation
    Gao, Fei
    Xu, Xingxin
    Yu, Jun
    Shang, Meimei
    Li, Xiang
    Tao, Dacheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3487 - 3498