A study on depth map generation using a light field camera and a monocular RGB camera based on deep learning

被引:0
|
作者
Takamatsu, Makoto [1 ]
Hasegawa, Makoto [1 ]
机构
[1] Tokyo Denki Univ, Tokyo, Japan
来源
SEVENTH INTERNATIONAL CONFERENCE ON OPTICAL AND PHOTONIC ENGINEERING (ICOPEN 2019) | 2019年 / 11205卷
关键词
Light field camera; depth map; Depth from Focus; conditional generative adversarial network; and pix2pix;
D O I
10.1117/12.2542653
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
A depth map and an RGB image taken by a light field camera for training data are arranged in a dataset pair; the datasets are learnt through a deep learning method called pix2pix, which is a type of conditional generative adversarial network. We can generate depth maps using only a monocular mobile camera without the light field camera based on our proposed method. Low accuracy on depth is a technical issue for the light field camera; however, the proposed method improves the depth accuracy due to the generalization ability of neural networks.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Facial Expression Recognition Using Depth Map Estimation of Light Field Camera
    Shen, Tak-Wai
    Fu, Hong
    Chen, Junkai
    Yu, W. K.
    Lau, C. Y.
    Lo, W. L.
    Chi, Zheru
    2016 IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMMUNICATIONS AND COMPUTING (ICSPCC), 2016,
  • [2] A Machine Learning Based Method for Object Detection and Localization Using a Monocular RGB Camera Equipped Drone
    Javaid, Abdulrahman
    Syed, Miswar Akhtar
    Baroudi, Uthman
    2023 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC, 2023, : 144 - 149
  • [3] Adding polarimetric imaging to depth map using improved light field camera 2.0 structure
    Zhang, Xuanzhe
    Yang, Yi
    Du, Shaojun
    Cao, Yu
    DIGITAL OPTICAL TECHNOLOGIES 2017, 2017, 10335
  • [4] DISPARITY MAP GENERATION FOR COLOR IMAGE USING TOF DEPTH CAMERA
    Kang, Yun-Suk
    Ho, Yo-Sung
    2011 3DTV CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2011,
  • [5] Single Camera-based Algorithm for Depth Map Generation in UAV
    Xiong, Hao
    Zhang, Changlong
    Yang, Xuesong
    Li, Lizheng
    2015 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND INTELLIGENT CONTROL (ISIC 2015), 2015, : 441 - 447
  • [6] Improved Depth Estimation with the Light Field Camera
    Wang, Huachun
    Sang, Xinzhu
    Chen, Duo
    Guo, Nan
    Wang, Peng
    Yu, Xunbo
    Yan, Binbin
    Wang, Kuiru
    Yu, Chongxiu
    AOPC 2017: OPTICAL STORAGE AND DISPLAY TECHNOLOGY, 2017, 10459
  • [7] Depth Estimation of Semi-submerged Objects Using a Light-field Camera
    Fan, Juehui
    Yang, Yee-Hong
    2017 14TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV 2017), 2017, : 80 - 86
  • [8] Dense Depth Map Generation Using a Single Camera with Hybrid Auto-Focusing
    Jang, Jinbeum
    Paik, Joonki
    2015 IEEE 5TH INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - BERLIN (ICCE-BERLIN), 2015, : 277 - 278
  • [9] Vari-Focal Light Field Camera for Extended Depth of Field
    Kim, Hyun Myung
    Kim, Min Seok
    Chang, Sehui
    Jeong, Jiseong
    Jeon, Hae-Gon
    Song, Young Min
    MICROMACHINES, 2021, 12 (12)
  • [10] Velodyne LiDAR and monocular camera data fusion for depth map and 3D reconstruction
    Akhtar, M. Rayyan
    Qin, Huabiao
    Chen, Guancheng
    ELEVENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2019), 2019, 11179