FuseNet: 3D Object Detection Network with Fused Information for Lidar Point Clouds

被引:2
|
作者
Liu, Biao [1 ]
Tian, Bihao [1 ]
Wang, Hengyang [1 ]
Qiao, Junchao [1 ]
Wang, Zhi [2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect Engn, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Sch Sci, Beijing 100044, Peoples R China
基金
北京市自然科学基金;
关键词
Computer vision; Point cloud; Neural networks; Object detection; Voxelization;
D O I
10.1007/s11063-022-10848-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D object detection from lidar point cloud has an important role in the environment sensing system of autonomous driving vehicles. In this paper, we propose two modules for object detection works by more detailed voxel initial information extraction and full fusion of context information. Additionally, we extract density information as the initial feature of the voxels and fully confuse the coordinate and density information with a point-based method to reduce the loss of original data caused by voxelization. Second, we extract the voxel features with a backbone neural network based on 3D sparse convolution. We propose a Cross-connected Region Proposal Network to integrate multiscale and multidepth regional features and to obtain high-quality 3D proposal regions. In addition, we extend the target generation strategy in the anchor-based 3D object detection algorithm, which stabilizes the network performance for multiple objections. Our modules can be flexibly applied to state-of-the-art models and effectively improves the network performance, which proves the effectiveness of the modules that we proposed.
引用
收藏
页码:5063 / 5078
页数:16
相关论文
共 50 条
  • [41] 3D Object Detection Based on LiDAR Data
    Sahba, Ramin
    Sahba, Amin
    Jamshidi, Mo
    Rad, Paul
    2019 IEEE 10TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2019, : 511 - 514
  • [42] MD3D: Mixture-Density-Based 3D Object Detection in Point Clouds
    Choi, Jaeseok
    Song, Yeji
    Kim, Yerim
    Yoo, Jaeyoung
    Kwak, Nojun
    IEEE ACCESS, 2022, 10 : 104011 - 104022
  • [43] Mobile LiDAR Scanner for the Generation of 3D Georeferenced Point Clouds
    Oria-Aguilera, Homero
    Alvarez-Perez, Hector
    Garcia-Garcia, Delvis
    2018 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION/XXIII CONGRESS OF THE CHILEAN ASSOCIATION OF AUTOMATIC CONTROL (ICA-ACCA), 2018,
  • [44] DIMENSIONALITY BASED SCALE SELECTION IN 3D LIDAR POINT CLOUDS
    Demantke, Jerome
    Mallet, Clement
    David, Nicolas
    Vallet, Bruno
    ISPRS WORKSHOP LASER SCANNING 2011, 2011, 38-5 (W12): : 97 - 102
  • [45] RETRACTED ARTICLE: Scale invariant point feature (SIPF) for 3D point clouds and 3D multi-scale object detection
    Baowei Lin
    Fasheng Wang
    Fangda Zhao
    Yi Sun
    Neural Computing and Applications, 2018, 29 : 1209 - 1224
  • [46] Point Transformer-Based Salient Object Detection Network for 3-D Measurement Point Clouds
    Wei, Zeyong
    Chen, Baian
    Wang, Weiming
    Chen, Honghua
    Wei, Mingqiang
    Li, Jonathan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 11
  • [47] Efficient and accurate object detection for 3D point clouds in intelligent visual internet of things
    Li, Hui
    Wang, Junyin
    Xu, Lingwei
    Zhang, Shujun
    Tao, Ye
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (20) : 31297 - 31334
  • [48] 3D urban object change detection from aerial and terrestrial point clouds: A review
    Xiao, Wen
    Cao, Hui
    Tang, Miao
    Zhang, Zhenchao
    Chen, Nengcheng
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 118
  • [49] Efficient and accurate object detection for 3D point clouds in intelligent visual internet of things
    Hui Li
    Junyin Wang
    Lingwei Xu
    Shujun Zhang
    Ye Tao
    Multimedia Tools and Applications, 2021, 80 : 31297 - 31334
  • [50] Localization- Based Active Learning (LOCAL) for Object Detection in 3D Point Clouds
    Moses, Aimee
    Jakkampudi, Srikanth
    Danner, Cheryl
    Biega, Derek
    GEOSPATIAL INFORMATICS XII, 2022, 12099