Automated Extrinsic Calibration of Multi-Cameras and LiDAR

被引:0
作者
Zhang, Xinyu [1 ,2 ]
Xiong, Yijin [1 ,3 ]
Qu, Qianxin [4 ]
Zhu, Shifan [4 ]
Guo, Shichun [4 ]
Jin, Dafeng [4 ]
Zhang, Guoying [3 ,5 ]
Ren, Haibing [5 ]
Li, Jun [2 ]
机构
[1] Tsinghua Univ, State Key Lab Intelligent Green Vehicleand Mobil, Beijing 100084, Peoples R China
[2] Beihang Univ, Sch Transportat Sci & Engn, Beijing 100191, Peoples R China
[3] China Univ Min & Technol Beijing, Sch Artificial Intelligence, Beijing 100083, Peoples R China
[4] Tsinghua Univ, State Key Lab Intelligent Green Vehicle & Mobil, Beijing 100084, Peoples R China
[5] Autonomous Delivery Grp Meituan, Beijing 100102, Peoples R China
基金
国家高技术研究发展计划(863计划);
关键词
Autonomous driving; extrinsic calibration; global optimization; multiple sensors system; SELF-CALIBRATION; VEHICLE; VISION;
D O I
10.1109/TIM.2023.3341122
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In intelligent driving systems, the multisensor fusion perception system comprising multiple cameras and LiDAR has become a crucial component. It is essential to have stable extrinsic parameters among devices in a multisensor fusion system to achieve all-weather sensing with no blind zones. However, prolonged vehicle usage can result in immeasurable sensor offsets that lead to perception deviations. To this end, we have studied multisensor unified calibration, rather than the calibration between a single pair of sensors as previously done. Benefiting from the mutually constrained pose between different sensor pairs, the method improves calibration accuracy by around 20% compared to calibration for a pair of sensors. The study can serve as a foundation for multisensor unified calibration, enabling the overall automatic optimization of all camera and LiDAR sensors onboard a vehicle within a single framework.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 48 条
[31]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[32]   Trajectory Tracking Control of an Autonomous Underwater Vehicle Using Lyapunov-Based Model Predictive Control [J].
Shen, Chao ;
Shi, Yang ;
Buckham, Brad .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2018, 65 (07) :5796-5805
[33]  
Soonhac Hong, 2014, 2014 World Automation Congress (WAC), P917, DOI 10.1109/WAC.2014.6936197
[34]   ATOP: An Attention-to-Optimization Approach for Automatic LiDAR-Camera Calibration via Cross-Modal Object Matching [J].
Sun, Yi ;
Li, Jian ;
Wang, Yuru ;
Xu, Xin ;
Yang, Xiaohui ;
Sun, Zhenping .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01) :696-708
[35]  
Taylor J., 2013, P IEEE INT C ROB AUT, P1
[36]  
Taylor Z., 2012, AUSTR C ROBOTICS AUT, P1
[37]  
Taylor Z, 2015, IEEE INT CONF ROBOT, P4843, DOI 10.1109/ICRA.2015.7139872
[38]  
Unnikrishnan M., 2005, CMURITR0509
[39]   LSD: a Line Segment Detector [J].
von Gioi, Rafael Grompone ;
Jakubowicz, Jeremie ;
Morel, Jean-Michel ;
Randall, Gregory .
IMAGE PROCESSING ON LINE, 2012, 2 :35-55
[40]   YOLOv5-Fog: A Multiobjective Visual Detection Algorithm for Fog Driving Scenes Based on Improved YOLOv5 [J].
Wang, Hai ;
Xu, Yansong ;
He, Youguo ;
Cai, Yingfeng ;
Chen, Long ;
Li, Yicheng ;
Sotelo, Miguel Angel ;
Li, Zhixiong .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71