Study of the depth accuracy and entropy characteristics of a ToF camera with coupled noise

被引:16
作者
Fang, YuJie [1 ,2 ]
Wang, Xia [1 ]
Sun, ZhiBin [3 ]
Zhang, Kai [2 ]
Su, BingHua [2 ]
机构
[1] Beijing Inst Technol, Sch Opt & Photon, Key Lab Optoelect Imaging Technol & Syst, Minist Educ, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Zhuhai 519000, Peoples R China
[3] Chinese Acad Sci, Natl Space Sci Ctr, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Depth accuracy; ToF camera; Differential entropy; MLP; Evaluation; INTERFERENCE; RESOLUTION; IMAGES; VIDEO;
D O I
10.1016/j.optlaseng.2020.106001
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
By illuminating targets with a modulated light signal, a time-of-flight (ToF) camera can calculate depth maps based on the phase shifts generated by the round-trip travel of the light from the targets back to the sensor. The accuracy of such depth imaging depends on the quality of the returned light. However, the calculation can be disturbed by various factors, including the external environment and the internal structure of the camera. Multiple coupled interferences can introduce noise into the depth data collected by a ToF camera in the spatial domain. It is difficult to express the relationship between the noise in depth maps and these mixed disturbances in a mathematical model. Based on the theory of differential entropy and a large amount of depth data from a ToF camera, this paper analyzes the characteristics of depth imaging entropy, proposes an evaluation method for depth image quality, and presents a multilayer perceptron model with information entropy (E-MLP) trained to optimize the accuracy of depth imaging. Experimental results show that this method can significantly improve the depth accuracy in the case of mixed noise.
引用
收藏
页数:9
相关论文
共 32 条
[1]   Resolving multipath interference in time-of-flight imaging via modulation frequency diversity and sparse regularization [J].
Bhandari, Ayush ;
Kadambi, Achuta ;
Whyte, Refael ;
Barsi, Christopher ;
Feigin, Micha ;
Dorrington, Adrian ;
Raskar, Ramesh .
OPTICS LETTERS, 2014, 39 (06) :1705-1708
[2]   Quantified, Interactive Simulation of AMCW ToF Camera Including Multipath Effects [J].
Bulczak, David ;
Lambers, Martin ;
Kolb, Andreas .
SENSORS, 2018, 18 (01)
[3]   Spatial Localization of EEG Electrodes in a TOF plus CCD Camera System [J].
Chen, Shengyong ;
He, Yu ;
Qiu, Huili ;
Yan, Xi ;
Zhao, Meng .
FRONTIERS IN NEUROINFORMATICS, 2019, 13
[4]   Camera Systems in Human Motion Analysis for Biomedical Applications [J].
Chin, Lim Chee ;
Basah, Shafriza Nisha ;
Yaacob, Sazali ;
Juan, Yeap Ewe ;
Ab Kadir, Aida Khairunnisaa .
INTERNATIONAL CONFERENCE ON MATHEMATICS, ENGINEERING AND INDUSTRIAL APPLICATIONS 2014 (ICOMEIA 2014), 2015, 1660
[5]   Estimating Tree Position, Diameter at Breast Height, and Tree Height in Real-Time Using a Mobile Phone with RGB-D SLAM [J].
Fan, Yongxiang ;
Feng, Zhongke ;
Mannan, Abdul ;
Khan, Tauheed Ullah ;
Shen, Chaoyong ;
Saeed, Sajjad .
REMOTE SENSING, 2018, 10 (11)
[6]   Modeling "wiggling" as a multi-path interference problem in AMCW ToF imaging [J].
Feigin, Micha ;
Whyte, Refael ;
Bhandari, Ayush ;
Dorington, Adrian ;
Raskar, Ramesh .
OPTICS EXPRESS, 2015, 23 (15) :19213-19225
[7]   Lock-in Time-of-Flight (ToF) Cameras: A Survey [J].
Foix, Sergi ;
Alenya, Guillem ;
Torras, Carme .
IEEE SENSORS JOURNAL, 2011, 11 (09) :1917-1926
[8]   Automatic graph based spatiotemporal extrinsic calibration of multiple Kinect V2 ToF cameras [J].
Fornaser, A. ;
Tomasin, P. ;
De Cecco, M. ;
Tavernini, M. ;
Zanetti, M. .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 98 :105-125
[9]   Theoretical and experimental error analysis of continuous-wave time-of-flight range cameras [J].
Frank, Mario ;
Plaue, Matthias ;
Rapp, Holger ;
Koethe, Ullrich ;
Jaehne, Bernd ;
Hamprecht, Fred A. .
OPTICAL ENGINEERING, 2009, 48 (01)
[10]   Time-of-Flight Sensor in a Book Reader System Design for Persons With Visual Impairment and Blindness [J].
Galarza, Luis ;
Martin, Harold ;
Adjouadi, Malek .
IEEE SENSORS JOURNAL, 2018, 18 (18) :7697-7707