Object Detection and Segmentation using LiDAR-Camera Fusion for Autonomous Vehicle

被引：2
|
作者：
Senapati, Mrinal [1 ]
Anand, Bhaskar [1 ]
Thakur, Abhishek [1 ]
Verma, Harshal [1 ]
Rajalakshmi, P. [1 ]
机构：
[1] Indian Inst Technol Hyderabad, Dept Elect Engn, Hyderabad, India
来源：
2021 FIFTH IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING (IRC 2021) | 2021年
关键词：
LiDAR; Point cloud; ROS; Camera; Image;
D O I：
10.1109/IRC52146.2021.00029
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
The Light detection and ranging (LiDAR) sensor plays a crucial role in perceiving the environment for an autonomous vehicle. But, in many scenarios LiDAR is unable to capture important information, for example, traffic light signals. This kind of scenario can be avoided by using camera images with LiDAR data. But, the system will not work effectively, if there is no proper calibration and synchronization between camera images and LiDAR data. In this paper, we have demonstrated a system, where objects are synchronously detected and segmented in both images and LiDAR data from KITTI datasets. Currently, the system is working in real-time using Robot Operating System (ROS) and can process up to 10 frames of image and point cloud data per second.
引用
收藏
页码：123 / 124
页数：2
相关论文
共 50 条
  • [1] A LiDAR-camera fusion approach for automated detection and assessment of potholes using an autonomous vehicle platform
    Talha, Sk Abu
    Karasneh, Mohammad A.
    Manasreh, Dmitry
    Al Oide, Alfarooq
    Nazzal, Munir D.
    INNOVATIVE INFRASTRUCTURE SOLUTIONS, 2023, 8 (10)
  • [2] A LiDAR-camera fusion approach for automated detection and assessment of potholes using an autonomous vehicle platform
    Sk Abu Talha
    Mohammad A. Karasneh
    Dmitry Manasreh
    Alfarooq Al Oide
    Munir D. Nazzal
    Innovative Infrastructure Solutions, 2023, 8
  • [3] Multimodal Object Detection and Ranging Based on Camera and Lidar Sensor Fusion for Autonomous Driving
    Khan, Danish
    Baek, Minjin
    Kim, Min Young
    Han, Dong Seog
    2022 27TH ASIA PACIFIC CONFERENCE ON COMMUNICATIONS (APCC 2022): CREATING INNOVATIVE COMMUNICATION TECHNOLOGIES FOR POST-PANDEMIC ERA, 2022, : 342 - 343
  • [4] Object Detection for Autonomous Vehicle with LiDAR Using Deep Learning
    Yahya, Muhammad Azri
    Abdul-Rahman, Shuzlina
    Mutalib, Sofianita
    2020 IEEE 10TH INTERNATIONAL CONFERENCE ON SYSTEM ENGINEERING AND TECHNOLOGY (ICSET), 2020, : 207 - 212
  • [5] Minutely monitoring of swash zone processes using a lidar-camera fusion system
    Matsuba, Yoshinao
    Tajima, Yoshimitsu
    Shimozono, Takenori
    Martins, Kevin
    Banno, Masayuki
    COASTAL ENGINEERING, 2025, 199
  • [6] Intelligent Drivable Area Detection System using Camera and Lidar Sensor for Autonomous Vehicle
    Raguraman, Sriram Jayachandran
    Park, Jungme
    2020 IEEE INTERNATIONAL CONFERENCE ON ELECTRO INFORMATION TECHNOLOGY (EIT), 2020, : 429 - 436
  • [7] End-to-End Lidar-Camera Self-Calibration for Autonomous Vehicles
    Rachman, Arya
    Seiler, Jurgen
    Kaup, Andre
    2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [8] Dynamic Occupancy Grid Map Update Method using Camera and LiDAR Object Detection for Autonomous Driving
    Jang, Harin
    Kim, Taehyun
    Heo, Sejong
    Kang, Yeonsik
    2023 3RD INTERNATIONAL CONFERENCE ON ROBOTICS, AUTOMATION AND ARTIFICIAL INTELLIGENCE, RAAI 2023, 2023, : 27 - 32
  • [9] Camera-LiDAR Fusion for Object Detection，Tracking and Prediction
    Huang Y.
    Zhou J.
    Huang Q.
    Li B.
    Wang L.
    Zhu J.
    Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 2024, 49 (06): : 945 - 951
  • [10] Real-Time Object Classification for Autonomous Vehicle using LIDAR
    Yoshioka, Masaru
    Suganuma, Naoki
    Yoneda, Keisuke
    Aldibaja, Mohammad
    2017 2ND INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATICS AND BIOMEDICAL SCIENCES (ICIIBMS), 2017, : 210 - 211
12345