Feature Aware Re-weighting (FAR) in Bird's Eye View for LiDAR-based 3D object detection in autonomous driving applications

被引:0
|
作者
Zamanakos, Georgios [1 ]
Tsochatzidis, Lazaros [1 ]
Amanatiadis, Angelos [2 ]
Pratikakis, Ioannis [1 ]
机构
[1] Democritus Univ Thrace, Dept Elect & Comp Engn, Xanthi 67100, Greece
[2] Democritus Univ Thrace, Dept Prod & Management Engn, Xanthi 67100, Greece
关键词
3D object detection; Deep learning; Bird's Eye View; Autonomous driving; LiDAR; Point cloud; CNN;
D O I
10.1016/j.robot.2024.104664
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D object detection is a key element for the perception of autonomous vehicles. LiDAR sensors are commonly used to perceive the surrounding area, producing a sparse representation of the scene in the form of a point cloud. The current trend is to use deep learning neural network architectures that predict 3D bounding boxes. The vast majority of architectures process the LiDAR point cloud directly but, due to computation and memory constraints, at some point they compress the input to a 2D Bird's Eye View (BEV) representation. In this work, we propose a novel 2D neural network architecture, namely the Feature Aware Re -weighting Network, for feature extraction in BEV using local context via an attention mechanism, to improve the 3D detection performance of LiDAR-based detectors. Extensive experiments on five state-of-the-art detectors and three benchmarking datasets, namely KITTI, Waymo and nuScenes, demonstrate the effectiveness of the proposed method in terms of both detection performance and minimal added computational burden. We release our code at https://github.com/grgzam/FAR.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Density Awareness and Neighborhood Attention for LiDAR-Based 3D Object Detection
    Qian, Hanxiang
    Wu, Peng
    Sun, Xiaoyong
    Guo, Xiaojun
    Su, Shaojing
    PHOTONICS, 2022, 9 (11)
  • [42] CluB: Cluster Meets BEV for LiDAR-Based 3D Object Detection
    Wang, Yingjie
    Deng, Jiajun
    Hou, Yuenan
    Li, Yao
    Zhang, Yu
    Ji, Jianmin
    Ouyang, Wanli
    Zhang, Yanyong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [43] SemanticBEVFusion: Rethinking LiDAR-Camera Fusion in Unified Bird's-Eye View Representation for 3D Object Detection
    Jiang, Qi
    Sun, Hao
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 5707 - 5714
  • [44] Enhanced Object Detection in Bird's Eye View Using 3D Global Context Inferred From Lidar Point Data
    Kim, Yecheol
    Kim, Jaekyum
    Koh, Junho
    Choi, Jun Won
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 2516 - 2521
  • [45] Residual MBConv Submanifold Module for 3D LiDAR-based Object Detection
    Guo, Lie
    Huang, Liang
    Zhao, Yibing
    2022 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2022, : 1720 - 1724
  • [46] Multi-View 3D Object Detection Network for Autonomous Driving
    Chen, Xiaozhi
    Ma, Huimin
    Wan, Ji
    Li, Bo
    Xia, Tian
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6526 - 6534
  • [47] Towards Efficient 3D Object Detection in Bird's-Eye-Space for Autonomous Driving: A Convolutional-Only Approach
    Li, Yuxin
    Han, Qiang
    Yu, Mengying
    Jiang, Yuxin
    Yeo, Chai Kiat
    Li, Yiheng
    Huang, Zihang
    Liu, Nini
    Chen, Hsuanhan
    Wu, Xiaojun
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 2170 - 2177
  • [48] Influence of Camera-LiDAR Configuration on 3D Object Detection for Autonomous Driving
    Li, Ye
    Hu, Hanjiang
    Liu, Zuxin
    Xu, Xiaohao
    Huang, Xiaonan
    Zhao, Ding
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024), 2024, : 9018 - 9025
  • [49] ARC-BEV: Attentive Radar-Camera Fusion 3D Object Detection in Bird-Eye-View Space for Autonomous Driving
    Shen, Lyuyu
    Li, Jianghao
    Lee, Christina Dao Wen
    Lee, Min Young
    Hartmannsgruber, Andreas
    Ang, Marcelo H., Jr.
    EXPERIMENTAL ROBOTICS, ISER 2023, 2024, 30 : 557 - 566
  • [50] Accurate and Real-time Object Detection based on Bird's Eye View on 3D Point Clouds
    Zhang, Yi
    Xiang, Zhiyu
    Qiao, Chengyu
    Chen, Shuya
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 214 - 221