Fourier-inspired neural module for real-time and high-fidelity computer-generated holography

被引:18
作者
Dong, Zhenxing [1 ]
Xu, Chao [1 ]
Ling, Yuye [1 ]
Li, Yan [1 ]
Su, Yikai [1 ,2 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Elect Engn, State Key Lab Adv Opt Commun Syst & Networks, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
PHASE; IMAGE;
D O I
10.1364/OL.477630
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Learning-based computer-generated holography (CGH) algorithms appear as novel alternatives to generate phase-only holograms. However, most existing learning-based approaches underperform their iterative peers regarding display quality. Here, we recognize that current convolu-tional neural networks have difficulty learning cross-domain tasks due to the limited receptive field. In order to over-come this limitation, we propose a Fourier-inspired neural module, which can be easily integrated into various CGH frameworks and significantly enhance the quality of recon-structed images. By explicitly leveraging Fourier transforms within the neural network architecture, the mesoscopic information within the phase-only hologram can be more handily extracted. Both simulation and experiment were performed to showcase its capability. By incorporating it into U-Net and HoloNet, the peak signal-to-noise ratio of reconstructed images is measured at 29.16 dB and 33.50 dB during the simulation, which is 4.97 dB and 1.52 dB higher than those by the baseline U-Net and HoloNet, respectively. Similar trends are observed in the experimental results. We also experimentally demonstrated that U-Net and HoloNet with the proposed module can generate a monochromatic 1080p hologram in 0.015 s and 0.020 s, respectively. (c) 2023 Optica Publishing Group
引用
收藏
页码:759 / 762
页数:4
相关论文
共 23 条
  • [1] NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study
    Agustsson, Eirikur
    Timofte, Radu
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1122 - 1131
  • [2] [Anonymous], 2015, P MEDICAL IMAGE COMP
  • [3] Toward the next-generation VR/AR optics: a review of holographic near-eye displays from a human-centric perspective
    Chang, Chenliang
    Bang, Kiseungg
    Wetzstein, Gordon
    Lee, Byoungho
    Gao, Liang
    [J]. OPTICA, 2020, 7 (11): : 1563 - 1578
  • [4] Fourier Imager Network (FIN): A deep neural network for hologram reconstruction with superior external generalization
    Chen, Hanlong
    Huang, Luzhe
    Liu, Tairan
    Ozcan, Aydogan
    [J]. LIGHT-SCIENCE & APPLICATIONS, 2022, 11 (01)
  • [5] Neural 3D Holography: Learning Accurate Wave Propagation Models for 3D Holographic Virtual and Augmented Reality Displays
    Choi, Suyeon
    Gopakumar, Manu
    Peng, Yifan
    Kim, Jonghyun
    Wetzstein, Gordon
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (06):
  • [6] DeepCGH: 3D computer-generated holography using deep learning
    Eybposh, M. Hossein
    Caira, Nicholas W.
    Atisa, Mathew
    Chakravarthula, Praneeth
    Pegard, Nicolas C.
    [J]. OPTICS EXPRESS, 2020, 28 (18): : 26636 - 26650
  • [7] GERCHBERG RW, 1972, OPTIK, V35, P237
  • [8] Three-dimensional display technologies of recent interest: principles, status, and issues [Invited]
    Hong, Jisoo
    Kim, Youngmin
    Choi, Hee-Jin
    Hahn, Joonku
    Park, Jae-Hyeung
    Kim, Hwi
    Min, Sung-Wook
    Chen, Ni
    Lee, Byoungho
    [J]. APPLIED OPTICS, 2011, 50 (34) : H87 - H115
  • [9] Deep-learning-generated holography
    Horisaki, Ryoichi
    Takagi, Ryosuke
    Tanida, Jun
    [J]. APPLIED OPTICS, 2018, 57 (14) : 3859 - 3863
  • [10] Perceptual Losses for Real-Time Style Transfer and Super-Resolution
    Johnson, Justin
    Alahi, Alexandre
    Li Fei-Fei
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 694 - 711