3D Location and Trajectory Reconstruction of a Moving Object Behind Scattering Media

被引:7
|
作者
Deng, Rujia [1 ,2 ]
Jin, Xin [1 ]
Du, Dongyu [1 ,2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen Key Lab Broadband Network & Multimedia, Shenzhen 518055, Peoples R China
[2] Tsinghua Innovat Ctr Zhuhai, Zhuhai 519080, Peoples R China
基金
中国国家自然科学基金;
关键词
Scattering imaging; inverse problems; locating moving objects; TRACKING; TARGETS;
D O I
10.1109/TCI.2022.3170651
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Reconstructing an object's location and monitoring its movement through scattering media remains a significant challenge in applications. Existing methods suffer from the object motion limit, the prior of the object information, or the complex optical setup. Here, we focus on reconstructing the 3D location and trajectory of an object in motion behind scattering media by explicitly modeling and inverting the time-varying light transportation. A time-varying scattering imaging model is derived to encode the positions of the moving object in the intensity videos captured by a conventional RGB camera. Based on the model, we find that the object lies on 3D surfaces determined by point pairs on the scattering media. We then develop a back-projection method to build a 3D confidence map for the voxelized object space to find the voxel with the maximum confidence as the object position in the reconstructed trajectory at the corresponding video time. The effectiveness of the proposed method to locate moving self-illuminated and light-reflective objects in different shapes behind scattering media with different thicknesses using 2D intensity images is verified by simulated experiments and real scattering imaging systems. The reconstructions of multiple objects and different lighting conditions are discussed.
引用
收藏
页码:371 / 384
页数:14
相关论文
共 50 条
  • [21] Occlusion Problem in 3D Object Detection: A Review
    Kandelkar, Apurva
    Batra, Isha
    Sharma, Shabnam
    Malik, Arun
    INTERNATIONAL CONFERENCE ON INNOVATIVE COMPUTING AND COMMUNICATIONS, ICICC 2022, VOL 1, 2023, 473 : 299 - 312
  • [22] A novel Kinect-based system for 3D moving object interception with a 5-DOF robotic arm
    Haselirad, Arad
    Neubert, Jeremiah
    2015 INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2015, : 117 - 124
  • [23] Multiple 3D Object Tracking for Augmented Reality
    Park, Youngmin
    Lepetit, Vincent
    Woo, Woontack
    7TH IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY 2008, PROCEEDINGS, 2008, : 117 - 120
  • [24] Detailed 3D Representations for Object Recognition and Modeling
    Zia, M. Zeeshan
    Stark, Michael
    Schiele, Bernt
    Schindler, Konrad
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (11) : 2608 - 2623
  • [25] 3D-Net: Monocular 3D object recognition for traffic monitoring
    Rezaei, Mahdi
    Azarmi, Mohsen
    Mir, Farzam Mohammad Pour
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 227
  • [26] 3D reconstruction framework via combining one 3D scanner and multiple stereo trackers
    Shi, Jinlong
    Sun, Zhengxing
    Bai, Suqin
    VISUAL COMPUTER, 2018, 34 (03) : 377 - 389
  • [27] A Comparison of Surgical Cavity 3D Reconstruction Methods
    Su, Yun-Hsuan
    Lindgren, Kyle
    Huang, Kevin
    Hannaford, Blake
    2020 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII), 2020, : 329 - 336
  • [28] COMPRESSIVE RECONSTRUCTION FOR 3D INCOHERENT HOLOGRAPHIC MICROSCOPY
    Cossairt, Oliver
    He, Kuan
    Shang, Ruibo
    Matsuda, Nathan
    Sharma, Manoj
    Huang, Xiang
    Katsaggelos, Aggelos
    Spinoulas, Leonidas
    Yoo, Seunghwan
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 958 - 962
  • [29] 3D reconstruction of elastin fibres in coronary adventitia
    Luo, T.
    Chen, H.
    Kassab, G. S.
    JOURNAL OF MICROSCOPY, 2017, 265 (01) : 121 - 131
  • [30] Visual control for robotic 3D printing on a moving platform
    Chaudhry, M. S.
    Czekanski, A.
    MECHATRONICS, 2024, 100