Feature Aware Re-weighting (FAR) in Bird's Eye View for LiDAR-based 3D object detection in autonomous driving applications

被引:0
|
作者
Zamanakos, Georgios [1 ]
Tsochatzidis, Lazaros [1 ]
Amanatiadis, Angelos [2 ]
Pratikakis, Ioannis [1 ]
机构
[1] Democritus Univ Thrace, Dept Elect & Comp Engn, Xanthi 67100, Greece
[2] Democritus Univ Thrace, Dept Prod & Management Engn, Xanthi 67100, Greece
关键词
3D object detection; Deep learning; Bird's Eye View; Autonomous driving; LiDAR; Point cloud; CNN;
D O I
10.1016/j.robot.2024.104664
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D object detection is a key element for the perception of autonomous vehicles. LiDAR sensors are commonly used to perceive the surrounding area, producing a sparse representation of the scene in the form of a point cloud. The current trend is to use deep learning neural network architectures that predict 3D bounding boxes. The vast majority of architectures process the LiDAR point cloud directly but, due to computation and memory constraints, at some point they compress the input to a 2D Bird's Eye View (BEV) representation. In this work, we propose a novel 2D neural network architecture, namely the Feature Aware Re -weighting Network, for feature extraction in BEV using local context via an attention mechanism, to improve the 3D detection performance of LiDAR-based detectors. Extensive experiments on five state-of-the-art detectors and three benchmarking datasets, namely KITTI, Waymo and nuScenes, demonstrate the effectiveness of the proposed method in terms of both detection performance and minimal added computational burden. We release our code at https://github.com/grgzam/FAR.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] LiDAR-based 3D Object Detection for Autonomous Driving
    Li, Zirui
    2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 507 - 512
  • [2] BEVDetNet: Bird's Eye View LiDAR Point Cloud based Real-time 3D Object Detection for Autonomous Driving
    Mohapatra, Sambit
    Yogamani, Senthil
    Gotzig, Heinrich
    Milz, Stefan
    Maeder, Patrick
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 2809 - 2815
  • [3] TEMPORAL AXIAL ATTENTION FOR LIDAR-BASED 3D OBJECT DETECTION IN AUTONOMOUS DRIVING
    Carranza-Garcia, Manuel
    Riquelme, Jose C.
    Zakhor, Avideh
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 201 - 205
  • [4] Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Driving
    Zhu, Zijian
    Zhang, Yichi
    Chen, Hai
    Dong, Yinpeng
    Zhao, Shu
    Ding, Wenbo
    Zhong, Jiachen
    Zheng, Shibao
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21600 - 21610
  • [5] Stereo RGB and Deeper LIDAR-Based Network for 3D Object Detection in Autonomous Driving
    He, Qingdong
    Wang, Zhengning
    Zeng, Hao
    Zeng, Yi
    Liu, Yijun
    Liu, Shuaicheng
    Zeng, Bing
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (01) : 152 - 162
  • [6] LiDAR-Based 3D Temporal Object Detection via Motion-Aware LiDAR Feature Fusion
    Park, Gyuhee
    Koh, Junho
    Kim, Jisong
    Moon, Jun
    Choi, Jun Won
    SENSORS, 2024, 24 (14)
  • [7] A comprehensive survey of LIDAR-based 3D object detection methods with deep learning for autonomous driving
    Zamanakos, Georgios
    Tsochatzidis, Lazaros
    Amanatiadis, Angelos
    Pratikakis, Ioannis
    COMPUTERS & GRAPHICS-UK, 2021, 99 : 153 - 181
  • [8] Temporal-Channel Transformer for 3D Lidar-Based Video Object Detection for Autonomous Driving
    Yuan, Zhenxun
    Song, Xiao
    Bai, Lei
    Wang, Zhe
    Ouyang, Wanli
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (04) : 2068 - 2078
  • [9] LiDAR-Based Intensity-Aware Outdoor 3D Object Detection
    Naich, Ammar Yasir
    Carrion, Jesus Requena
    SENSORS, 2024, 24 (09)
  • [10] RangeDet: In Defense of Range View for LiDAR-based 3D Object Detection
    Fan, Lue
    Xiong, Xuan
    Wang, Feng
    Wang, Naiyan
    Zhang, Zhaoxiang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2898 - 2907