Object Detection and Segmentation using LiDAR-Camera Fusion for Autonomous Vehicle

被引：2
|
作者：
Senapati, Mrinal [1 ]
Anand, Bhaskar [1 ]
Thakur, Abhishek [1 ]
Verma, Harshal [1 ]
Rajalakshmi, P. [1 ]
机构：
[1] Indian Inst Technol Hyderabad, Dept Elect Engn, Hyderabad, India
来源：
2021 FIFTH IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING (IRC 2021) | 2021年
关键词：
LiDAR; Point cloud; ROS; Camera; Image;
D O I：
10.1109/IRC52146.2021.00029
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
The Light detection and ranging (LiDAR) sensor plays a crucial role in perceiving the environment for an autonomous vehicle. But, in many scenarios LiDAR is unable to capture important information, for example, traffic light signals. This kind of scenario can be avoided by using camera images with LiDAR data. But, the system will not work effectively, if there is no proper calibration and synchronization between camera images and LiDAR data. In this paper, we have demonstrated a system, where objects are synchronously detected and segmented in both images and LiDAR data from KITTI datasets. Currently, the system is working in real-time using Robot Operating System (ROS) and can process up to 10 frames of image and point cloud data per second.
引用
收藏
页码：123 / 124
页数：2
相关论文
共 50 条
  • [1] Enhanced Object Detection in Autonomous Vehicles through LiDAR-Camera Sensor Fusion
    Dai, Zhongmou
    Guan, Zhiwei
    Chen, Qiang
    Xu, Yi
    Sun, Fengyi
    WORLD ELECTRIC VEHICLE JOURNAL, 2024, 15 (07):
  • [2] A LiDAR-camera fusion approach for automated detection and assessment of potholes using an autonomous vehicle platform
    Talha, Sk Abu
    Karasneh, Mohammad A.
    Manasreh, Dmitry
    Al Oide, Alfarooq
    Nazzal, Munir D.
    INNOVATIVE INFRASTRUCTURE SOLUTIONS, 2023, 8 (10)
  • [3] A LiDAR-camera fusion approach for automated detection and assessment of potholes using an autonomous vehicle platform
    Sk Abu Talha
    Mohammad A. Karasneh
    Dmitry Manasreh
    Alfarooq Al Oide
    Munir D. Nazzal
    Innovative Infrastructure Solutions, 2023, 8
  • [4] Fully convolutional neural networks for LIDAR-camera fusion for pedestrian detection in autonomous vehicle
    Daniel, J. Alfred
    Vignesh, C. Chandru
    Muthu, Bala Anand
    Kumar, R. Senthil
    Sivaparthipan, C. B.
    Marin, Carlos Enrique Montenegro
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (16) : 25107 - 25130
  • [5] A LiDAR-Camera Fusion 3D Object Detection Algorithm
    Liu, Leyuan
    He, Jian
    Ren, Keyan
    Xiao, Zhonghua
    Hou, Yibin
    INFORMATION, 2022, 13 (04)
  • [6] SupFusion: Supervised LiDAR-Camera Fusion for 3D Object Detection
    Qin, Yiran
    Wang, Chaoqun
    Kang, Zijian
    Ma, Ningning
    Li, Zhen
    Zhang, Ruimao
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 21957 - 21967
  • [7] Real time object detection using LiDAR and camera fusion for autonomous driving
    Liu, Haibin
    Wu, Chao
    Wang, Huanjie
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [8] Real time object detection using LiDAR and camera fusion for autonomous driving
    Haibin Liu
    Chao Wu
    Huanjie Wang
    Scientific Reports, 13
  • [9] LiDAR-camera fusion: dual-scale correction for vehicle multi-object detection and trajectory extraction
    Fu, Ting
    Xie, Shuke
    Hu, Weichao
    Wang, Junhua
    Cui, Zixuan
    JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2024,
  • [10] Fusion of 3D LIDAR and Camera Data for Object Detection in Autonomous Vehicle Applications
    Zhao, Xiangmo
    Sun, Pengpeng
    Xu, Zhigang
    Min, Haigen
    Yu, Hongkai
    IEEE SENSORS JOURNAL, 2020, 20 (09) : 4901 - 4913
12345