LaneAF: Robust Multi-Lane Detection With Affinity Fields

被引:82
作者
Abualsaud, Hala [1 ]
Liu, Sean [1 ]
Lu, David B. [1 ]
Situ, Kenny [1 ]
Rangesh, Akshay [1 ]
Trivedi, Mohan M. [1 ]
机构
[1] Univ Calif San Diego, Lab Intelligent & Safe Automobiles, San Diego, CA 92092 USA
关键词
Object detection; segmentation and categorization; deep learning for visual perception;
D O I
10.1109/LRA.2021.3098066
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study presents an approach to lane detection involving the prediction of binary segmentation masks and per-pixel affinity fields. These affinity fields, along with the binary masks, can then be used to cluster lane pixels horizontally and vertically into corresponding lane instances in a post-processing step. This clustering is achieved through a simple row-by-row decoding process with little overhead; such an approach allows LaneAF to detect a variable number of lanes without assuming a fixed or maximum number of lanes. Moreover, this form of clustering is more interpretable in comparison to previous visual clustering approaches, and can be analyzed to identify and correct sources of error. Qualitative and quantitative results obtained on popular lane detection datasets demonstrate the model's ability to detect and cluster lanes effectively and robustly. Our proposed approach sets a new state-of-the-art on the challenging CULane dataset and the recently introduced Unsupervised LLAMAS dataset.
引用
收藏
页码:7477 / 7484
页数:8
相关论文
共 35 条
[1]  
Bai M, 2018, IEEE INT C INT ROBOT, P3102, DOI 10.1109/IROS.2018.8594388
[2]   Deep Watershed Transform for Instance Segmentation [J].
Bai, Min ;
Urtasun, Raquel .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2858-2866
[3]   Unsupervised Labeled Lane Markers Using Maps [J].
Behrendt, Karsten ;
Soussan, Ryan .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :832-839
[4]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[5]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[6]   Self-Driving Cars [J].
Daily, Mike ;
Medasani, Swarup ;
Behringer, Reinhold ;
Trivedi, Mohan .
COMPUTER, 2017, 50 (12) :18-23
[7]   How Would Surround Vehicles Move? A Unified Framework for Maneuver Classification and Motion Prediction [J].
Deo, Nachiket ;
Rangesh, Akshay ;
Trivedi, Mohan M. .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2018, 3 (02) :129-140
[8]   3D-LaneNet: End-to-End 3D Multiple Lane Detection [J].
Garnett, Noa ;
Cohen, Rafi ;
Pe'er, Tomer ;
Lahav, Roee ;
Levi, Dan .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :2921-2930
[9]   EL-GAN: Embedding Loss Driven Generative Adversarial Networks for Lane Detection [J].
Ghafoorian, Mohsen ;
Nugteren, Cedric ;
Baka, Nora ;
Booij, Olaf ;
Hofmann, Michael .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT I, 2019, 11129 :256-272
[10]  
Gupta T, 2018, IEEE INT VEH SYM, P1470, DOI 10.1109/IVS.2018.8500431