3D Location and Trajectory Reconstruction of a Moving Object Behind Scattering Media

被引:7
|
作者
Deng, Rujia [1 ,2 ]
Jin, Xin [1 ]
Du, Dongyu [1 ,2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen Key Lab Broadband Network & Multimedia, Shenzhen 518055, Peoples R China
[2] Tsinghua Innovat Ctr Zhuhai, Zhuhai 519080, Peoples R China
基金
中国国家自然科学基金;
关键词
Scattering imaging; inverse problems; locating moving objects; TRACKING; TARGETS;
D O I
10.1109/TCI.2022.3170651
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Reconstructing an object's location and monitoring its movement through scattering media remains a significant challenge in applications. Existing methods suffer from the object motion limit, the prior of the object information, or the complex optical setup. Here, we focus on reconstructing the 3D location and trajectory of an object in motion behind scattering media by explicitly modeling and inverting the time-varying light transportation. A time-varying scattering imaging model is derived to encode the positions of the moving object in the intensity videos captured by a conventional RGB camera. Based on the model, we find that the object lies on 3D surfaces determined by point pairs on the scattering media. We then develop a back-projection method to build a 3D confidence map for the voxelized object space to find the voxel with the maximum confidence as the object position in the reconstructed trajectory at the corresponding video time. The effectiveness of the proposed method to locate moving self-illuminated and light-reflective objects in different shapes behind scattering media with different thicknesses using 2D intensity images is verified by simulated experiments and real scattering imaging systems. The reconstructions of multiple objects and different lighting conditions are discussed.
引用
收藏
页码:371 / 384
页数:14
相关论文
共 50 条
  • [1] Binocular visual tracking and grasping of a moving object with a 3D trajectory predictor
    Fuentes-Pacheco, J.
    Ruiz-Ascencio, J.
    Rendon-Mancha, J. M.
    JOURNAL OF APPLIED RESEARCH AND TECHNOLOGY, 2009, 7 (03) : 259 - 274
  • [2] Object Detection and Depth Estimation for 3D Trajectory Extraction
    Boukhers, Zeyd
    Shirahama, Kimiaki
    Li, Frederic
    Grzegorzek, Marcin
    2015 13TH INTERNATIONAL WORKSHOP ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI), 2015,
  • [3] Moving Object Detection by 3D Flow Field Analysis
    Jiang, Cansen
    Paudel, Danda Pani
    Fofi, David
    Fougerolle, Yohan
    Demonceaux, Cedric
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (04) : 1950 - 1963
  • [4] Automated 3D trajectory measuring of large numbers of moving particles
    Wu, Hai Shan
    Zhao, Qi
    Zou, Danping
    Chen, Yan Qiu
    OPTICS EXPRESS, 2011, 19 (08): : 7646 - 7663
  • [5] Dense Reconstruction Using 3D Object Shape Priors
    Dame, Amaury
    Prisacariu, Victor A.
    Ren, Carl Y.
    Reid, Ian
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 1288 - 1295
  • [6] Simultaneous 3D Tracking and Reconstruction of Multiple Moving Rigid Objects
    Ozawa, Takehiro
    Nakajima, Yoshikatsu
    Saito, Hideo
    2019 12TH ASIA PACIFIC WORKSHOP ON MIXED AND AUGMENTED REALITY (APMAR), 2019, : 58 - 62
  • [7] 3D reconstruction of a concrete mixer truck for training object detectors
    Kim, Hongjo
    Kim, Hyoungkwan
    AUTOMATION IN CONSTRUCTION, 2018, 88 : 23 - 30
  • [8] Online Trajectory Generation of a MAV for Chasing a Moving Target in 3D Dense Environments
    Jeon, Boseong Felipe
    Kim, H. Jin
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 1115 - 1121
  • [9] Imaging through scattering media with dimensional measuring and 3D positioning
    Wang, Xin
    Liu, Honglin
    Shi, Junhui
    Han, Shensheng
    Chen, Ruimin
    Li, Chiye
    OPTICS AND LASER TECHNOLOGY, 2024, 176
  • [10] Moving Object Classification Using 3D Point Cloud in Urban Traffic Environment
    Zhang, MingFang
    Fu, Rui
    Guo, YingShi
    Wang, Li
    JOURNAL OF ADVANCED TRANSPORTATION, 2020, 2020