Reusability report: Unpaired deep-learning approaches for holographic image reconstruction

被引:3
|
作者
Zhang, Yuhe [1 ]
Ritschel, Tobias [2 ]
Villanueva-Perez, Pablo [1 ]
机构
[1] Lund Univ, Synchrotron Radiat Res & NanoLund, Lund, Sweden
[2] Univ London, Goldsmiths Coll, London, England
关键词
Deep learning - Holography - Learning systems - Medical imaging - Reusability;
D O I
10.1038/s42256-024-00798-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep-learning methods using unpaired datasets hold great potential for image reconstruction, especially in biomedical imaging where obtaining paired datasets is often difficult due to practical concerns. A recent study by Lee et al. (Nature Machine Intelligence 2023) has introduced a parameterized physical model (referred to as FMGAN) using the unpaired approach for adaptive holographic imaging, which replaces the forward generator network with a physical model parameterized on the propagation distance of the probing light. FMGAN has demonstrated its capability to reconstruct the complex phase and amplitude of objects, as well as the propagation distance, even in scenarios where the object-to-sensor distance exceeds the range of the training data. We performed additional experiments to comprehensively assess FMGAN's capabilities and limitations. As in the original paper, we compared FMGAN to two state-of-the-art unpaired methods, CycleGAN and PhaseGAN, and evaluated their robustness and adaptability under diverse conditions. Our findings highlight FMGAN's reproducibility and generalizability when dealing with both in-distribution and out-of-distribution data, corroborating the results reported by the original authors. We also extended FMGAN with explicit forward models describing the response of specific optical systems, which improved performance when dealing with non-perfect systems. However, we observed that FMGAN encounters difficulties when explicit forward models are unavailable. In such scenarios, PhaseGAN outperformed FMGAN. A parameterized physical model that uses unpaired datasets for adaptive holographic imaging was published in Nature Machine Intelligence in 2023. Zhang and colleagues evaluate its performance and extend it to non-perfect optical systems by integrating specific optical response functions.
引用
收藏
页码:284 / 290
页数:7
相关论文
共 50 条
  • [1] Reusability report: Unpaired deep-learning approaches for holographic image reconstruction
    Yuhe Zhang
    Tobias Ritschel
    Pablo Villanueva-Perez
    Nature Machine Intelligence, 2024, 6 : 284 - 290
  • [2] Digital Holographic Reconstruction Based on Deep Learning Framework With Unpaired Data
    Yin, Da
    Gu, Zhongzheng
    Zhang, Yanran
    Gu, Fengyan
    Nie, Shouping
    Ma, Jun
    Yuan, Caojin
    IEEE PHOTONICS JOURNAL, 2020, 12 (02):
  • [3] Deep-Learning Multiscale Digital Holographic Intensity and Phase Reconstruction
    Chen, Bo
    Li, Zhaoyi
    Zhou, Yilin
    Zhang, Yirui
    Jia, Jingjing
    Wang, Ying
    APPLIED SCIENCES-BASEL, 2023, 13 (17):
  • [4] Unpaired learning for digital holographic reconstruction and generation
    Sun, Xiaotian
    Xiong, Chencen
    Ren, Zhenbo
    Di, Jianglei
    Zhao, Jianlin
    OPTICS EXPRESS, 2025, 33 (02): : 3414 - 3428
  • [5] Unpaired learning for digital holographic reconstruction and generation
    Xiong, Chencen
    Ren, Zhenbo
    Di, Jianglei
    Zhao, Jianlin
    INTERNATIONAL CONFERENCE ON OPTICAL AND PHOTONIC ENGINEERING, ICOPEN 2023, 2024, 13069
  • [6] Holographic reconstruction enhancement via unpaired image-to-image translation
    Scherrer, Romane
    Selmaoui-folcher, Nazha
    Quiniou, Thomas
    Jauffrais, Thierry
    Lemonnier, Hugues
    Bonnet, Sophie
    APPLIED OPTICS, 2022, 61 (33) : 9807 - 9816
  • [7] Image forgery detection: a survey of recent deep-learning approaches
    Zanardelli, Marcello
    Guerrini, Fabrizio
    Leonardi, Riccardo
    Adami, Nicola
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (12) : 17521 - 17566
  • [8] Image forgery detection: a survey of recent deep-learning approaches
    Marcello Zanardelli
    Fabrizio Guerrini
    Riccardo Leonardi
    Nicola Adami
    Multimedia Tools and Applications, 2023, 82 : 17521 - 17566
  • [9] Deep-Learning Image Reconstruction for Real-Time Photoacoustic System
    Kim, MinWoo
    Jeng, Geng-Shi
    Pelivanov, Ivan
    O'Donnell, Matthew
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (11) : 3379 - 3390
  • [10] HIGH-RESOLUTION HOLOGRAPHIC IMAGE RECONSTRUCTION BASED ON DEEP LEARNING
    Li, Fangju
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2024, 25 (05): : 3523 - 3530