3D Location and Trajectory Reconstruction of a Moving Object Behind Scattering Media

被引:7
|
作者
Deng, Rujia [1 ,2 ]
Jin, Xin [1 ]
Du, Dongyu [1 ,2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen Key Lab Broadband Network & Multimedia, Shenzhen 518055, Peoples R China
[2] Tsinghua Innovat Ctr Zhuhai, Zhuhai 519080, Peoples R China
基金
中国国家自然科学基金;
关键词
Scattering imaging; inverse problems; locating moving objects; TRACKING; TARGETS;
D O I
10.1109/TCI.2022.3170651
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Reconstructing an object's location and monitoring its movement through scattering media remains a significant challenge in applications. Existing methods suffer from the object motion limit, the prior of the object information, or the complex optical setup. Here, we focus on reconstructing the 3D location and trajectory of an object in motion behind scattering media by explicitly modeling and inverting the time-varying light transportation. A time-varying scattering imaging model is derived to encode the positions of the moving object in the intensity videos captured by a conventional RGB camera. Based on the model, we find that the object lies on 3D surfaces determined by point pairs on the scattering media. We then develop a back-projection method to build a 3D confidence map for the voxelized object space to find the voxel with the maximum confidence as the object position in the reconstructed trajectory at the corresponding video time. The effectiveness of the proposed method to locate moving self-illuminated and light-reflective objects in different shapes behind scattering media with different thicknesses using 2D intensity images is verified by simulated experiments and real scattering imaging systems. The reconstructions of multiple objects and different lighting conditions are discussed.
引用
收藏
页码:371 / 384
页数:14
相关论文
共 50 条
  • [41] 3DTRIP: A General Framework for 3D Trajectory Recovery Integrated With Prediction
    Ni, Yiyang
    Zhao, Xu
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (02) : 512 - 519
  • [42] A Survey of Indoor 3D Reconstruction Based on RGB-D Cameras
    Zhu, Jinlong
    Gao, Changbo
    Sun, Qiucheng
    Wang, Mingze
    Deng, Zhengkai
    IEEE ACCESS, 2024, 12 : 112742 - 112766
  • [43] A method of 3D light field imaging through single layer of weak scattering media based on deep learning
    Wang, Weihao
    Wang, Zichuan
    Wen, Ya
    Song, Lipei
    Zhao, Xing
    Yang, Jufeng
    2019 INTERNATIONAL CONFERENCE ON OPTICAL INSTRUMENTS AND TECHNOLOGY: OPTOELECTRONIC IMAGING/SPECTROSCOPY AND SIGNAL PROCESSING TECHNOLOGY, 2020, 11438
  • [44] Dense 3D reconstruction combining depth and RGB information
    Pan, Hailong
    Guan, Tao
    Luo, Yawei
    Duan, Liya
    Tian, Yuan
    Yi, Liu
    Zhao, Yizhu
    Yu, Junqing
    NEUROCOMPUTING, 2016, 175 : 644 - 651
  • [45] A short reader's guide to 3D tomographic reconstruction
    Defrise, M
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2001, 25 (02) : 113 - 116
  • [46] A Complete System for 3D Reconstruction of Roots for Phenotypic Analysis
    Kumar, Pankaj
    Cai, Jinhai
    Miklavcic, Stanley J.
    SIGNAL AND IMAGE ANALYSIS FOR BIOMEDICAL AND LIFE SCIENCES, 2015, 823 : 249 - 270
  • [47] Rapid 3D track reconstruction with the BABAR trigger upgrade
    Felt, N
    Bailey, SJ
    Brandenburg, GW
    Fries, T
    Harder, S
    Morii, M
    Oliver, JN
    Sinev, NB
    Won, E
    2003 IEEE NUCLEAR SCIENCE SYMPOSIUM, CONFERENCE RECORD, VOLS 1-5, 2004, : 1288 - 1291
  • [48] 3D human motion reconstruction using video processing
    Roodsarabi, Nadiya
    Behrad, Alireza
    IMAGE AND SIGNAL PROCESSING, 2008, 5099 : 386 - 395
  • [49] Track reconstruction by GPU in 3D particle tracking detectors
    Bozza, Cristiano
    De Sio, Chiara
    Kose, Umut
    Stellacci, Simona Maria
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2015, 794 : 80 - 89
  • [50] A 3D object model for wireless camera networks with network constraints
    Tan, Jindong
    Kong, Fanyu
    Liang, Wei
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2013, 35 (07) : 866 - 874