Feature Aware Re-weighting (FAR) in Bird's Eye View for LiDAR-based 3D object detection in autonomous driving applications

被引:0
|
作者
Zamanakos, Georgios [1 ]
Tsochatzidis, Lazaros [1 ]
Amanatiadis, Angelos [2 ]
Pratikakis, Ioannis [1 ]
机构
[1] Democritus Univ Thrace, Dept Elect & Comp Engn, Xanthi 67100, Greece
[2] Democritus Univ Thrace, Dept Prod & Management Engn, Xanthi 67100, Greece
关键词
3D object detection; Deep learning; Bird's Eye View; Autonomous driving; LiDAR; Point cloud; CNN;
D O I
10.1016/j.robot.2024.104664
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D object detection is a key element for the perception of autonomous vehicles. LiDAR sensors are commonly used to perceive the surrounding area, producing a sparse representation of the scene in the form of a point cloud. The current trend is to use deep learning neural network architectures that predict 3D bounding boxes. The vast majority of architectures process the LiDAR point cloud directly but, due to computation and memory constraints, at some point they compress the input to a 2D Bird's Eye View (BEV) representation. In this work, we propose a novel 2D neural network architecture, namely the Feature Aware Re -weighting Network, for feature extraction in BEV using local context via an attention mechanism, to improve the 3D detection performance of LiDAR-based detectors. Extensive experiments on five state-of-the-art detectors and three benchmarking datasets, namely KITTI, Waymo and nuScenes, demonstrate the effectiveness of the proposed method in terms of both detection performance and minimal added computational burden. We release our code at https://github.com/grgzam/FAR.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] SA-BEV: Generating Semantic-Aware Bird's-Eye-View Feature for Multi-view 3D Object Detection
    Zhang, Jinqing
    Zhang, Yanan
    Liu, Qingjie
    Wang, Yunhong
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 3325 - 3334
  • [22] Reinforcing LiDAR-Based 3D Object Detection with RGB and 3D Information
    Liu, Wenjian
    Zhou, Yue
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT II, 2019, 11954 : 199 - 209
  • [23] PLA-LiDAR: Physical Laser Attacks against LiDAR-based 3D Object Detection in Autonomous Vehicle
    Jin, Zizhi
    Ji, Xiaoyu
    Cheng, Yushi
    Yang, Bo
    Yan, Chen
    Xu, Wenyuan
    2023 IEEE SYMPOSIUM ON SECURITY AND PRIVACY, SP, 2023, : 1822 - 1839
  • [24] Out-of-Distribution Detection for LiDAR-based 3D Object Detection
    Huang, Chengjie
    Van Duong Nguyen
    Abdelzad, Vahdat
    Mannes, Christopher Gus
    Rowe, Luke
    Therien, Benjamin
    Salay, Rick
    Czarnecki, Krzysztof
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 4265 - 4271
  • [25] Adaptive Feature Fusion Based Cooperative 3D Object Detection for Autonomous Driving
    Wang, Junyong
    Zeng, Yuan
    Gong, Yi
    2022 3RD INFORMATION COMMUNICATION TECHNOLOGIES CONFERENCE (ICTC 2022), 2022, : 103 - 107
  • [26] MENet: Map-enhanced 3D object detection in bird's-eye view for LiDAR point clouds
    Huang, Yuanxian
    Zhou, Jian
    Li, Xicheng
    Dong, Zhen
    Xiao, Jinsheng
    Wang, Shurui
    Zhang, Hongjuan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 120
  • [27] Investigating 3D object detection using stereo camera and LiDAR fusion with bird's-eye view representation
    Nie, Xin
    Zhu, Lin
    He, Zhicheng
    Cheng, Aiguo
    Zhong, Shengshi
    Li, Eric
    NEUROCOMPUTING, 2025, 620
  • [28] CL-fusionBEV: 3D object detection method with camera-LiDAR fusion in Bird's Eye View
    Shi, Peicheng
    Liu, Zhiqiang
    Dong, Xinlong
    Yang, Aixi
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (06) : 7681 - 7696
  • [29] 3D vision object detection for autonomous driving in fog using LiDaR
    Tahir, Alishba
    Mumtaz, Rafia
    Irshad, Muhammad Saqib
    SIMULATION MODELLING PRACTICE AND THEORY, 2025, 140
  • [30] 3D OBJECT DETECTION FOR AUTONOMOUS DRIVING USING TEMPORAL LIDAR DATA
    McCrae, Scott
    Zakhor, Avideh
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2661 - 2665