FuseNet: 3D Object Detection Network with Fused Information for Lidar Point Clouds

被引:2
|
作者
Liu, Biao [1 ]
Tian, Bihao [1 ]
Wang, Hengyang [1 ]
Qiao, Junchao [1 ]
Wang, Zhi [2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect Engn, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Sch Sci, Beijing 100044, Peoples R China
基金
北京市自然科学基金;
关键词
Computer vision; Point cloud; Neural networks; Object detection; Voxelization;
D O I
10.1007/s11063-022-10848-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D object detection from lidar point cloud has an important role in the environment sensing system of autonomous driving vehicles. In this paper, we propose two modules for object detection works by more detailed voxel initial information extraction and full fusion of context information. Additionally, we extract density information as the initial feature of the voxels and fully confuse the coordinate and density information with a point-based method to reduce the loss of original data caused by voxelization. Second, we extract the voxel features with a backbone neural network based on 3D sparse convolution. We propose a Cross-connected Region Proposal Network to integrate multiscale and multidepth regional features and to obtain high-quality 3D proposal regions. In addition, we extend the target generation strategy in the anchor-based 3D object detection algorithm, which stabilizes the network performance for multiple objections. Our modules can be flexibly applied to state-of-the-art models and effectively improves the network performance, which proves the effectiveness of the modules that we proposed.
引用
收藏
页码:5063 / 5078
页数:16
相关论文
共 50 条
  • [21] Neural network for 3D point clouds alignment
    Voronin, Sergei
    Vasilyev, Alexander
    Kober, Vitaly
    Makovetskii, Artyom
    Voronin, Aleksei
    Zhernov, Dmitrii
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLV, 2022, 12226
  • [22] Attentional Keypoint Detection on Point Clouds for 3D Object Part Segmentation
    Zhou, Feng
    Zhang, Qi
    Zhu, He
    Liu, Shibo
    Jiang, Na
    Cai, Xingquan
    Qi, Qianfang
    Hu, Yong
    APPLIED SCIENCES-BASEL, 2023, 13 (23):
  • [23] SOA: Seed point offset attention for indoor 3D object detection in point clouds
    Shu, Jun
    Yu, Shiqi
    Shu, Xinyi
    Hu, Jiewen
    COMPUTERS & GRAPHICS-UK, 2024, 123
  • [24] 3D Object Detection Method Using LiDAR Information in Multiple Frames
    Kim, Jung-Un
    Min, Jihong
    Kang, Hang-Bong
    IMAGE ANALYSIS AND PROCESSING,(ICIAP 2017), PT I, 2017, 10484 : 276 - 286
  • [25] Scale invariant point feature (SIPF) for 3D point clouds and 3D multi-scale object detection
    Lin, Baowei
    Wang, Fasheng
    Zhao, Fangda
    Sun, Yi
    NEURAL COMPUTING & APPLICATIONS, 2018, 29 (05) : 1209 - 1224
  • [26] MENet: Map-enhanced 3D object detection in bird's-eye view for LiDAR point clouds
    Huang, Yuanxian
    Zhou, Jian
    Li, Xicheng
    Dong, Zhen
    Xiao, Jinsheng
    Wang, Shurui
    Zhang, Hongjuan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 120
  • [27] Multi-Scale Keypoints Feature Fusion Network for 3D Object Detection from Point Clouds
    Zhang, Xu
    Bai, Linjuan
    Zhang, Zuyu
    Li, Yan
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2022, 12
  • [28] A study on 3D LiDAR-based point cloud object detection using an enhanced PointPillars network
    Tao, Zeyu
    Su, Jianqiang
    Zhang, Jinjing
    Liu, Liqiang
    Fu, Yaxiong
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (10)
  • [29] Channel-Based Network for Fast Object Detection of 3D LiDAR
    Kwon, SoonSub
    Park, TaeHyoung
    ELECTRONICS, 2020, 9 (07) : 1 - 10
  • [30] Convolutional neural network for 3D point clouds matching
    Voronin, Sergei
    Makovetskii, Artyom
    Voronin, Aleksei
    Zhernov, Dmitrii
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLIV, 2021, 11842