4K-DMDNet: diffraction model-driven network for 4K computer-generated holography

被引:68
|
作者
Liu, Kexuan [1 ]
Wu, Jiachen [1 ]
He, Zehao [1 ]
Cao, Liangcai [1 ]
机构
[1] Tsinghua Univ, Dept Precis Instruments, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
computer-generated holography; deep learning; model-driven neural network; sub-pixel convolution; oversampling; NEURAL-NETWORK; PHASE; IMAGE;
D O I
10.29026/oea.2023.220135
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Deep learning offers a novel opportunity to achieve both high-quality and high-speed computer-generated holography (CGH). Current data-driven deep learning algorithms face the challenge that the labeled training datasets limit the train-ing performance and generalization. The model-driven deep learning introduces the diffraction model into the neural net-work. It eliminates the need for the labeled training dataset and has been extensively applied to hologram generation. However, the existing model-driven deep learning algorithms face the problem of insufficient constraints. In this study, we propose a model-driven neural network capable of high-fidelity 4K computer-generated hologram generation, called 4K Diffraction Model-driven Network (4K-DMDNet). The constraint of the reconstructed images in the frequency domain is strengthened. And a network structure that combines the residual method and sub-pixel convolution method is built, which effectively enhances the fitting ability of the network for inverse problems. The generalization of the 4K-DMDNet is demonstrated with binary, grayscale and 3D images. High-quality full-color optical reconstructions of the 4K holograms have been achieved at the wavelengths of 450 nm, 520 nm, and 638 nm.
引用
收藏
页数:14
相关论文
共 10 条
  • [1] Diffraction model-driven neural network trained using hybrid domain loss for real-time and high-quality computer-generated holography
    Zheng, Huadong
    Peng, Junchang
    Wang, Zhen
    Shui, Xinghua
    Yu, Yingjie
    Xia, Xinxing
    OPTICS EXPRESS, 2023, 31 (12) : 19931 - 19944
  • [2] Advancing computer-generated holographic display thanks to diffraction model-driven deep nets
    Bianco, Vittorio
    Ferraro, Pietro
    OPTO-ELECTRONIC ADVANCES, 2024, 7 (01)
  • [3] Diffraction model-informed neural network for unsupervised layer-based computer-generated holography
    Shui, Xinghua
    Zheng, Huadong
    Xia, Inxing
    Yang, Furong
    Wang, Weisen
    Yu, Yingjie
    OPTICS EXPRESS, 2022, 30 (25) : 44814 - 44826
  • [4] Dataset enhancement training of diffraction model-driven neural networks and extension to generate multi-depth computer-generated holograms
    Peng, Junchang
    Zheng, Huadong
    Wang, Zhen
    Yu, Yingjie
    INTERNATIONAL CONFERENCE ON OPTICAL AND PHOTONIC ENGINEERING, ICOPEN 2023, 2024, 13069
  • [5] 4K Real Time Image to Image Translation Network With Transformers
    Shibasaki, Kei
    Fukuzaki, Shota
    Ikehara, Masaaki
    IEEE ACCESS, 2022, 10 : 73057 - 73067
  • [6] A Generative Adversarial Network Based Tone Mapping Operator for 4K HDR Images
    Zhang, Junbin
    Wang, Yixiao
    Tohidypour, Hamidreza
    Pourazad, Mahsa T.
    Nasiopoulos, Panos
    2023 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2023, : 473 - 477
  • [7] Deeplearning Convolutional Neural Network based QoE Assessment Module for 4K UHD Video Streaming
    Ashiquzzaman, Akm
    Oh, Sung M. M.
    Lee, Dongsu
    Jung, Hoehyeong
    Um, Tai-won
    Kim, Jinsul
    SIMULTECH: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON SIMULATION AND MODELING METHODOLOGIES, TECHNOLOGIES AND APPLICATIONS, 2019, 2019, : 392 - 397
  • [8] Ada4DIR: An adaptive model-driven all-in-one image restoration network for remote sensing images
    Lihe, Ziyang
    Yuan, Qiangqiang
    He, Jiang
    Jin, Xianyu
    Xiao, Yi
    Chen, Yuzeng
    Shen, Huanfeng
    Zhang, Liangpei
    INFORMATION FUSION, 2025, 118
  • [9] A Real-Time Convolutional Neural Network for Super-Resolution on FPGA With Applications to 4K UHD 60 fps Video Services
    Kim, Yongwoo
    Choi, Jae-Seok
    Kim, Munchurl
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (08) : 2521 - 2534
  • [10] Multi-Model Standard for Bitstream-, Pixel-Based and Hybrid Video Quality Assessment of UHD/4K: ITU-T P.1204
    Raake, Alexander
    Borer, Silvio
    Satti, Shahid M.
    Gustafsson, Jorgen
    Rao, Rakesh Rao Ramachandra
    Medagli, Stefano
    List, Peter
    Goering, Steve
    Lindero, David
    Robitza, Werner
    Heikkila, Gunnar
    Broom, Simon
    Schmidmer, Christian
    Feiten, Bernhard
    Wuestenhagen, Ulf
    Wittmann, Thomas
    Obermann, Matthias
    Bitto, Roland
    IEEE ACCESS, 2020, 8 : 193020 - 193049