Dynamic Rigid Bodies Mining and Motion Estimation Based on Monocular Camera

被引:2
作者
Gao, Xuanchang [1 ,2 ]
Liu, Xilong [1 ]
Cao, Zhiqiang [1 ]
Tan, Min [1 ]
Yu, Junzhi [1 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Peking Univ, Coll Engn, BIC ESAT, Dept Adv Mfg & Robot,State Key Lab Turbulence & C, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Dynamics; Motion segmentation; Cameras; Manifolds; Estimation; Motion estimation; Simultaneous localization and mapping; Dynamic rigid bodies; monocular camera; motion estimation; probabilistic field; region confidence; SEGMENTATION; PERSPECTIVE;
D O I
10.1109/TCYB.2022.3163545
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Dynamic object perception is an important yet challenging direction in the field of robot navigation. Without any prior knowledge about motion and objects, a novel dynamic rigid bodies mining and motion estimation method based on monocular camera is proposed in this article. Different from the existing works based on sampling that associate feature points to motion hypotheses according to the reprojection errors, our work endeavors to find the intrinsic relevance among motion hypotheses. To represent this relevance, the concept of the probabilistic field on the Lie group Sim(3) manifold is introduced, which is established using random sampling. It provides a computable way for the regions on the manifold where rigid bodies possibly appear. The probability of a motion hypothesis falling on a region is expressed by its confidence. The regions with large confidences in the probabilistic field are selected as potential rigid bodies, whose corresponding feature points are further sampled for pose calculation. As a result, the randomness of sampling is reduced and the inliers for possible rigid bodies are enhanced, which guarantees the accuracy of motion estimation. On this basis, the tracking of rigid bodies is achieved. The proposed method distinguishes the feature points of dynamic objects with 3-D motion from those in the static background, thus enabling simultaneous localization and mapping (SLAM) to be initialized in dynamic environments. The experimental results on the KITTI, Hopkins 155, and MTPV62 datasets demonstrate the effectiveness. Comparison experiments indicate that our method outperforms the other methods in sensitivity of dynamic objects perception.
引用
收藏
页码:5655 / 5666
页数:12
相关论文
共 33 条
  • [1] GMS: Grid-based Motion Statistics for Fast, Ultra-robust Feature Correspondence
    Bian, JiaWang
    Lin, Wen-Yan
    Matsushita, Yasuyuki
    Yeung, Sai-Kit
    Nguyen, Tan-Dat
    Cheng, Ming-Ming
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2828 - 2837
  • [2] Direct Sparse Odometry
    Engel, Jakob
    Koltun, Vladlen
    Cremers, Daniel
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (03) : 611 - 625
  • [3] Faugeras O. D., 1988, International Journal of Pattern Recognition and Artificial Intelligence, V2, P485, DOI 10.1142/S0218001488000285
  • [4] RANDOM SAMPLE CONSENSUS - A PARADIGM FOR MODEL-FITTING WITH APPLICATIONS TO IMAGE-ANALYSIS AND AUTOMATED CARTOGRAPHY
    FISCHLER, MA
    BOLLES, RC
    [J]. COMMUNICATIONS OF THE ACM, 1981, 24 (06) : 381 - 395
  • [5] Geiger A., 2012, C COMP VIS PATT REC
  • [6] Track-Before-Detect Framework-Based Vehicle Monocular Vision Sensors
    Gonzalez, Hernan
    Rodriguez, Sergio
    Elouardi, Abdelhafid
    [J]. SENSORS, 2019, 19 (03)
  • [7] In defense of the eight-point algorithm
    Hartley, RI
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (06) : 580 - 593
  • [8] DETERMINING OPTICAL-FLOW
    HORN, BKP
    SCHUNCK, BG
    [J]. ARTIFICIAL INTELLIGENCE, 1981, 17 (1-3) : 185 - 203
  • [9] ClusterVO: Clustering Moving Instances and Estimating Visual Odometry for Self and Surroundings
    Huang, Jiahui
    Yang, Sheng
    Mu, Tai-Jiang
    Hu, Shi-Min
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2165 - 2174
  • [10] ClusterSLAM: A SLAM Backend for Simultaneous Rigid Body Clustering and Motion Estimation
    Huang, Jiahui
    Yang, Sheng
    Zhao, Zishuo
    Lai, Yu-Kun
    Hu, Shi-Min
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5874 - 5883