Generating Multi-Depth 3D Holograms Using a Fully Convolutional Neural Network

被引:4
|
作者
Yan, Xingpeng [1 ]
Liu, Xinlei [1 ,2 ,3 ]
Li, Jiaqi [1 ]
Zhang, Yanan [1 ]
Chang, Hebin [1 ]
Jing, Tao [1 ]
Hu, Hairong [1 ]
Qu, Qiang [1 ]
Wang, Xi [1 ]
Jiang, Xiaoyu [1 ]
机构
[1] Army Acad Armored Forces, Dept Informat Commun, Beijing 100072, Peoples R China
[2] Natl Digital Switching Syst Engn & Technol Res Ctr, Zhengzhou 450001, Peoples R China
[3] Informat Engn Univ, Zhengzhou 450001, Peoples R China
基金
中国国家自然科学基金;
关键词
computer-generated hologram; fully convolutional neural network; multi-depth hologram; LIGHT; METASURFACE; DISPLAY; MODULATOR; OPTICS;
D O I
10.1002/advs.202308886
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Efficiently generating 3D holograms is one of the most challenging research topics in the field of holography. This work introduces a method for generating multi-depth phase-only holograms using a fully convolutional neural network (FCN). The method primarily involves a forward-backward-diffraction framework to compute multi-depth diffraction fields, along with a layer-by-layer replacement method (L2RM) to handle occlusion relationships. The diffraction fields computed by the former are fed into the carefully designed FCN, which leverages its powerful non-linear fitting capability to generate multi-depth holograms of 3D scenes. The latter can smooth the boundaries of different layers in scene reconstruction by complementing information of occluded objects, thus enhancing the reconstruction quality of holograms. The proposed method can generate a multi-depth 3D hologram with a PSNR of 31.8 dB in just 90 ms for a resolution of 2160 x 3840 on the NVIDIA Tesla A100 40G tensor core GPU. Additionally, numerical and experimental results indicate that the generated holograms accurately reconstruct clear 3D scenes with correct occlusion relationships and provide excellent depth focusing. This work introduces the forward-backward-diffraction framework for computing multi-depth diffraction fields and the layer-by-layer replacement method for handling occlusion relationships. When combined with a fully convolutional neural network, it generates multi-depth holograms with excellent depth focusing and corrects occlusion relationships. The reconstructed scene exhibits minimal speckle noise and few edge artifacts. image
引用
收藏
页数:15
相关论文
共 50 条
  • [1] A multi-depth convolutional neural network for SAR image classification
    Xia, Jingfan
    Yang, Xuezhi
    Jia, Lu
    REMOTE SENSING LETTERS, 2018, 9 (12) : 1138 - 1147
  • [2] 3D face recognition using depth filtering and deep convolutional neural network
    Dorofeev, Konstantin
    Ruchay, Alexey
    Kober, Anastasia
    Kober, Vitaly
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLII, 2019, 11137
  • [3] 3D Convolutional Neural Network for Falling Detection using Only Depth Information
    Luengo Sanchez, Sara
    de Lopez Diz, Sergio
    Fuentes-Jimenez, David
    Losada-Gutierrez, Cristina
    Marron-Romera, Marta
    Sarker, Ibrahim
    PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 5: VISAPP, 2020, : 590 - 597
  • [4] Reconstructing the 3D digital core with a fully convolutional neural network
    Li, Qiong
    Chen, Zheng
    He, Jian-Jun
    Hao, Si-Yu
    Wang, Rui
    Yang, Hao-Tao
    Sun, Hua-Jun
    APPLIED GEOPHYSICS, 2020, 17 (03) : 401 - 410
  • [5] Reconstructing the 3D digital core with a fully convolutional neural network
    Qiong Li
    Zheng Chen
    Jian-Jun He
    Si-Yu Hao
    Rui Wang
    Hao-Tao Yang
    Hua-Jun Sun
    Applied Geophysics, 2020, 17 : 401 - 410
  • [6] A 3D CONVOLUTIONAL NEURAL NETWORK FOR LIGHT FIELD DEPTH ESTIMATION
    Faluvegi, Agota
    Bolsee, Quentin
    Nedevschi, Sergiu
    Dadarlat, Vasile-Teodor
    Munteanu, Adrian
    2019 INTERNATIONAL CONFERENCE ON 3D IMMERSION (IC3D), 2019,
  • [7] Fully automated pelvic bone segmentation in multiparameteric MRI using a 3D convolutional neural network
    Liu, Xiang
    Han, Chao
    Wang, He
    Wu, Jingyun
    Cui, Yingpu
    Zhang, Xiaodong
    Wang, Xiaoying
    INSIGHTS INTO IMAGING, 2021, 12 (01)
  • [8] Reverberation Noise Suppression in Ultrasound Channel Signals Using a 3D Fully Convolutional Neural Network
    Brickson, Leandra L.
    Hyun, Dongwoon
    Jakovljevic, Marko
    Dahl, Jeremy J.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (04) : 1184 - 1195
  • [9] Fully automated pelvic bone segmentation in multiparameteric MRI using a 3D convolutional neural network
    Xiang Liu
    Chao Han
    He Wang
    Jingyun Wu
    Yingpu Cui
    Xiaodong Zhang
    Xiaoying Wang
    Insights into Imaging, 12
  • [10] 3D Map Optimization with Fully Convolutional Neural Network and Dynamic Local NDT
    Shen, Zebang
    Xu, Yichong
    Sun, Muchen
    Carballo, Alexander
    Zhou, Qingguo
    2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 4404 - 4411