Road detection based on the fusion of Lidar and image data

被引:35
|
作者
Han, Xiaofeng [1 ]
Wang, Huan [1 ]
Lu, Jianfeng [1 ]
Zhao, Chunxia [1 ]
机构
[1] Nanjing Univ Sci & Technol, Inst Intelligent Robot, 200 Xiaolingwei St, Nanjing 210094, Jiangsu, Peoples R China
来源
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS | 2017年 / 14卷 / 06期
基金
中国国家自然科学基金;
关键词
Road detection; conditional random field; multi-sensor fusion; robotic vision; autonomous vehicles; TEXTURE;
D O I
10.1177/1729881417738102
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this article, we propose a road detection method based on the fusion of Lidar and image data under the framework of conditional random field. Firstly, Lidar point clouds are projected into the monocular images by cross calibration to get the sparse height images, and then we get high-resolution height images via a joint bilateral filter. Then, for all the training image pixels which have corresponding Lidar points, we extract their features from color image and Lidar point clouds, respectively, and use these features together with the location features to train an Adaboost classifier. After that, all the testing pixels are classified into road or non-road under a conditional random field framework. In this conditional random field framework, we use the scores computed from the Adaboost classifier as the unary potential and take the height value of each pixel and its color information into consideration together for the pairwise potential. Finally, experimental tests have been carried out on the KITTI Road data set, and the results show that our method performs well on this data set.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Road Detection of Remote Sensing Image Based on Convolutional Neural Network
    Zhu, Yuting
    Yan, Jingwen
    Wang, Cong
    Zhou, Yiqing
    IMAGE AND GRAPHICS, ICIG 2019, PT II, 2019, 11902 : 106 - 118
  • [32] FEATURE plus plus : CROSS DIMENSION FEATURE FUSION FOR ROAD DETECTION
    He, Wenli
    Cai, Guorong
    Zhong, Zhun
    Su, Songzhi
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 1662 - 1666
  • [33] Real-Time LIDAR-Based Urban Road and Sidewalk Detection for Autonomous Vehicles
    Horvath, Erno
    Pozna, Claudiu
    Unger, Miklos
    SENSORS, 2022, 22 (01)
  • [34] Road Centerline Extraction in Complex Urban Scenes From LiDAR Data Based on Multiple Features
    Hu, Xiangyun
    Li, Yijing
    Shan, Jie
    Zhang, Jianqing
    Zhang, Yongjun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (11): : 7448 - 7456
  • [35] A Fusion Model for Road Detection based on Deep Learning and Fully Connected CRF
    Yang, Fei
    Jin, Zhong
    Yang, Jian
    Wang, Huan
    2018 13TH ANNUAL CONFERENCE ON SYSTEM OF SYSTEMS ENGINEERING (SOSE), 2018, : 29 - 36
  • [36] Research on Moving Target Tracking Algorithm Based on Lidar and Visual Fusion
    Guo, Xiaoxiao
    Liu, Yuansheng
    Zhong, Qixue
    Chai, Mengna
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2018, 22 (05) : 593 - 601
  • [37] Road detection by using gradient magnitude image and adaptive thresholding based Watershed
    Li, Limin
    Wang, Weixing
    Khatoon, Amna
    Wang, Mengfei
    EGYPTIAN INFORMATICS JOURNAL, 2024, 25
  • [38] Road Detection Based on MS-RG Hybrid Image Segmentation Model
    Liu B.-S.
    Lv Y.-B.
    Lv W.-J.
    Li J.
    Ouyang Q.
    Jiaotong Yunshu Xitong Gongcheng Yu Xinxi/Journal of Transportation Systems Engineering and Information Technology, 2019, 19 (02): : 60 - 65
  • [39] Obstacle detection for intelligent robots based on the fusion of 2D lidar and depth camera
    Fan, Bailin
    Zhao, Hang
    Meng, Lingbei
    INTERNATIONAL JOURNAL OF HYDROMECHATRONICS, 2024, 7 (01) : 67 - 88
  • [40] Dictionary Learning-Based Hough Transform for Road Detection in Multispectral Image
    Liu, Weifeng
    Zhang, Zhenqing
    Chen, Xinghua
    Li, Shuying
    Zhou, Yicong
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (12) : 2330 - 2334