FuseNet: 3D Object Detection Network with Fused Information for Lidar Point Clouds

被引:2
|
作者
Liu, Biao [1 ]
Tian, Bihao [1 ]
Wang, Hengyang [1 ]
Qiao, Junchao [1 ]
Wang, Zhi [2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect Engn, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Sch Sci, Beijing 100044, Peoples R China
基金
北京市自然科学基金;
关键词
Computer vision; Point cloud; Neural networks; Object detection; Voxelization;
D O I
10.1007/s11063-022-10848-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D object detection from lidar point cloud has an important role in the environment sensing system of autonomous driving vehicles. In this paper, we propose two modules for object detection works by more detailed voxel initial information extraction and full fusion of context information. Additionally, we extract density information as the initial feature of the voxels and fully confuse the coordinate and density information with a point-based method to reduce the loss of original data caused by voxelization. Second, we extract the voxel features with a backbone neural network based on 3D sparse convolution. We propose a Cross-connected Region Proposal Network to integrate multiscale and multidepth regional features and to obtain high-quality 3D proposal regions. In addition, we extend the target generation strategy in the anchor-based 3D object detection algorithm, which stabilizes the network performance for multiple objections. Our modules can be flexibly applied to state-of-the-art models and effectively improves the network performance, which proves the effectiveness of the modules that we proposed.
引用
收藏
页码:5063 / 5078
页数:16
相关论文
共 50 条
  • [31] Sparse Sensor Fusion for 3D Object Detection with Symmetry-Aware Colored Point Clouds
    Wang, Lele
    Zhang, Peng
    Li, Ming
    Zhang, Faming
    SYMMETRY-BASEL, 2024, 16 (12):
  • [32] Adversarial Training on Point Clouds for Sim-to-Real 3D Object Detection
    DeBortoli, Robert
    Li Fuxin
    Kapoor, Ashish
    Hollinger, Geoffrey A.
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04): : 6662 - 6669
  • [33] Hybrid Attention-Based 3D Object Detection with Differential Point Clouds
    Han, Guangjie
    Zhu, Yintian
    Liao, Lyuchao
    Yao, Huiwen
    Zhao, Zhaolin
    Zheng, Qi
    ELECTRONICS, 2022, 11 (23)
  • [34] A Novel Interactive Fusion Method with Images and Point Clouds for 3D Object Detection
    Xu, Kai
    Yang, Zhile
    Xu, Yangjie
    Feng, Liangbing
    APPLIED SCIENCES-BASEL, 2019, 9 (06):
  • [35] Real LiDAR point cloud synthesis for 3D object detection in snowy weather
    Chen, Yuhao
    Li, Guanghe
    Zhang, Boxiang
    Zou, Xiaolin
    Wang, Ying
    Li, Ximing
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2025,
  • [36] 3DSAC: Size Adaptive Clustering for 3D object detection in point clouds
    Yu, Hang
    Su, Jinhe
    Cai, Guorong
    Piao, Yingchao
    Liu, Niansheng
    Huang, Min
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 118
  • [37] A Voxel-Based 3D Building Detection Algorithm for Airborne LIDAR Point Clouds
    Liying Wang
    Yan Xu
    Yu Li
    Journal of the Indian Society of Remote Sensing, 2019, 47 : 349 - 358
  • [38] A Voxel-Based 3D Building Detection Algorithm for Airborne LIDAR Point Clouds
    Wang, Liying
    Xu, Yan
    Li, Yu
    JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2019, 47 (02) : 349 - 358
  • [39] Multi-modal information fusion for LiDAR-based 3D object detection framework
    Ruixin Ma
    Yong Yin
    Jing Chen
    Rihao Chang
    Multimedia Tools and Applications, 2024, 83 : 7995 - 8012
  • [40] 3D Object Detection Using Frustums and Attention Modules for Images and Point Clouds
    Li, Yiran
    Xie, Han
    Shin, Hyunchul
    SIGNALS, 2021, 2 (01): : 98 - 107