DGE-CNN: 2D-to-3D holographic display based on a depth gradient extracting module and ZCNN network

被引:4
作者
Liu, Ninghe [1 ]
Huang, Zhengzhong [2 ]
He, Zehao [2 ]
Cao, Liangcai [1 ,2 ]
机构
[1] Tsinghua Univ, Weiyang Coll, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Precis Instruments, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning - Flexible displays - Holographic displays - Rendering (computer graphics) - Three dimensional computer graphics - Three dimensional displays;
D O I
10.1364/OE.489639
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Holography is a crucial technique for the ultimate three-dimensional (3D) display, because it renders all optical cues from the human visual system. However, the shortage of 3D contents strictly restricts the extensive application of holographic 3D displays. In this paper, a 2D-to-3D-display system by deep learning-based monocular depth estimation is proposed. By feeding a single RGB image of a 3D scene into our designed DGE-CNN network, a corresponding display-oriented 3D depth map can be accurately generated for layer-based computer-generated holography. With simple parameter adjustment, our system can adapt the distance range of holographic display according to specific requirements. The high-quality and flexible holographic 3D display can be achieved based on a single RGB image without 3D rendering devices, permitting potential human-display interactive applications such as remote education, navigation, and medical treatment.
引用
收藏
页码:23867 / 23876
页数:10
相关论文
共 35 条
[1]   Modeling the contrast-sensitivity function of the human visual system [J].
Bezzubik, V. V. ;
Belashenkov, N. R. .
JOURNAL OF OPTICAL TECHNOLOGY, 2015, 82 (10) :711-717
[2]   AdaBins: Depth Estimation Using Adaptive Bins [J].
Bhat, Shariq Farooq ;
Alhashim, Ibraheem ;
Wonka, Peter .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4008-4017
[3]   Holography, and the future of 3D display [J].
Blanche, Pierre-Alexandre .
LIGHT-ADVANCED MANUFACTURING, 2021, 2 (04)
[4]   Estimating Depth From Monocular Images as Classification Using Deep Fully Convolutional Residual Networks [J].
Cao, Yuanzhouhan ;
Wu, Zifeng ;
Shen, Chunhua .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (11) :3174-3182
[5]   From picture to 3D hologram: end-to-end learning of real-time 3D photorealistic hologram generation from 2D image input [J].
Chang, Chenliang ;
Dai, Bo ;
Zhu, Dongchen ;
LI, Jiamao ;
Xia, Jun ;
Zhang, Dawei ;
Hou, Lianping ;
Zhuang, Songlin .
OPTICS LETTERS, 2023, 48 (04) :851-854
[6]   Towards Real-Time Monocular Depth Estimation for Robotics: A Survey[-5pt] [J].
Dong, Xingshuai ;
Garratt, Matthew A. ;
Anavatti, Sreenatha G. ;
Abbass, Hussein A. .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) :16940-16961
[7]  
Eigen D, 2014, ADV NEUR IN, V27
[8]   Three-dimensional display technologies [J].
Geng, Jason .
ADVANCES IN OPTICS AND PHOTONICS, 2013, 5 (04) :456-535
[9]  
Goodman J. W., 2017, Introduction to Fourier Optics, V4th
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778