Point2Lane: Polyline-Based Reconstruction With Principal Points for Lane Detection

被引:3
作者
Chae, Yeon Jeong [1 ]
Park, So Jeong [1 ]
Kang, Eun Su [1 ]
Chae, Moon Ju [1 ]
Ngo, Ba Hung [1 ]
Cho, Sung In [1 ]
机构
[1] Dongguk Univ, Dept Multimedia Engn, Seoul 04620, South Korea
基金
新加坡国家研究基金会;
关键词
Autonomous driving; deep learning; lane detection;
D O I
10.1109/TITS.2023.3295807
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In this work, we observed that a nonlinear line could be expressed with a set of linear lines. We propose a novel lane detection method with polyline-based reconstruction based on this hypothesis. We define the optimal principal points with a new metric, the principal score, to generate the polyline. According to the principal score, we select principal points having a high influence on lane reconstruction and simply reproduce the target lane by connecting them. Additionally, conventional methods predict a fixed number of parameters to express each lane. However, this can limit an ability to represent a lane curvature and cause inaccurate detection results. Therefore, we set the number of principal points to be dynamically changed depending on the lane curvature to solve this problem. This allows the model to make flexible detection results reflecting the characteristics of each lane. We also propose a training strategy with a new piece-wise linear equation-based loss function. With this strategy, the model is fine-tuned to predict the principal points representing the curved parts of the lane well. Last, we propose a spatial context-aware feature flip fusion module to exploit the symmetric property of road images. This module helps the model selectively utilize the spatial context in the flipped feature map based on the lane density. We effectively reduce the adverse effects, especially the false positives of the existing feature flip fusion module misaligned on asymmetrical images. The experiments show that the proposed method provides competitive lane detection results compared to state-of-the-art methods.
引用
收藏
页码:14813 / 14829
页数:17
相关论文
共 58 条
[11]  
Hang Xu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12360), P689, DOI 10.1007/978-3-030-58555-6_41
[12]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[13]   Learning Lightweight Lane Detection CNNs by Self Attention Distillation [J].
Hou, Yuenan ;
Ma, Zheng ;
Liu, Chunxiao ;
Loy, Chen Change .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :1013-1021
[14]   SwiftLane: Towards Fast and Efficient Lane Detection [J].
Jayasinghe, Oshada ;
Anhettigama, Damith ;
Hemachandra, Sahan ;
Kariyawasam, Shenali ;
Rodrigo, Ranga ;
Jayasekara, Peshala .
20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, :859-864
[15]   Eigenlanes: Data-Driven Lane Descriptors for Structurally Diverse Lanes [J].
Jin, Dongkwon ;
Park, Wonhui ;
Jeong, Seong-Gyun ;
Kwon, Heeyeon ;
Kim, Chang-Su .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :17142-17150
[16]  
Jung H, 2013, IEEE INT VEH SYM, P976, DOI 10.1109/IVS.2013.6629593
[17]   Predicting Residential Energy Consumption by Explainable Deep Learning with Long-Term and Short-Term Latent Variables [J].
Kim, Jin-Young ;
Cho, Sung-Bae .
CYBERNETICS AND SYSTEMS, 2023, 54 (03) :270-285
[18]   Key Points Estimation and Point Instance Segmentation Approach for Lane Detection [J].
Ko, Yeongmin ;
Lee, Younkwan ;
Azam, Shoaib ;
Munir, Farzeen ;
Jeon, Moongu ;
Pedrycz, Witold .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :8949-8958
[19]   Robust Lane Detection via Expanded Self Attention [J].
Lee, Minhyeok ;
Lee, Junhyeop ;
Lee, Dogyoon ;
Kim, Woojin ;
Hwang, Sangwon ;
Lee, Sangyoun .
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, :1949-1958
[20]   VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition [J].
Lee, Seokju ;
Kim, Junsik ;
Yoon, Jae Shin ;
Shin, Seunghak ;
Bailo, Oleksandr ;
Kim, Namil ;
Lee, Tae-Hee ;
Hong, Hyun Seok ;
Han, Seung-Hoon ;
Kweon, In So .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1965-1973