Recurrent Cross Attention Mechanism for Improved Robustness and Real-Time Performance in Lane Detection

被引:0
作者
Huang, Bingqiang [1 ]
Wang, Shiqian [1 ]
Fei, Zhengshun [1 ]
Xiang, Xinjian [1 ]
Tian, Shaohua [2 ]
Tang, Fuying [1 ]
Yuan, Tianshun [1 ]
机构
[1] Zhejiang Univ Sci & Technol, Sch Automat & Elect Engn, Hangzhou 310023, Peoples R China
[2] Hangzhou Shenhao Technol, Key Lab Intelligent Robot Operat & Maintenance Zhe, Hangzhou 311121, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Lane detection; Feature extraction; Accuracy; Real-time systems; Autonomous vehicles; Computational modeling; Autonomous driving; Deep learning; attention mechanism; autonomous driving; deep learning; CNN;
D O I
10.1109/ACCESS.2024.3433398
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Lane detection is a key technical challenge in autonomous driving and advanced driving assistance systems. The current lane detection system has insufficient robustness and low detection accuracy problem in complex and harsh environmental conditions, and lacks research on visual cues without information. In order to accurately and effectively detect multiple lanes in challenging scenarios and meet the real-time requirements of actual driving, a lane detection method based on recurrent cross attention mechanism is proposed in this paper. Firstly, by embedding the recurrent cross attention module in the feature extraction module, the contextual information of surrounding pixels on the intersection path is obtained, and useful information is collected from other regions for accurate lane detection; Secondly, anchor point detection is selected based on the prior position of the designed lane starting position; Finally, combining mixed anchor points to represent lane coordinates, using row and column anchors to learn lane coordinates and improve the real-time performance of lane detection models. The detection model RCCLaneNet designed in this paper was evaluated on the TuSimple and CULane datasets. The experimental results showed that the F1 of this method can reach 97.05% on the TuSimple dataset, 78.5% on the CULane dataset, and the real-time inference speed index FPS can reach +150. The proposed model achieves advanced performance in lane detection tasks in complex scenes while maintaining real-time detection efficiency, and has good universality in actual driving scenarios.
引用
收藏
页码:126376 / 126388
页数:13
相关论文
共 30 条
  • [1] Rethinking Efficient Lane Detection via Curve Modeling
    Feng, Zhengyang
    Guo, Shaohua
    Tan, Xin
    Xu, Ke
    Wang, Min
    Ma, Lizhuang
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 17041 - 17049
  • [2] github, TuSimple Benchmark
  • [3] He KM, 2017, IEEE I CONF COMP VIS, P2980, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]
  • [4] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [5] A Review of Testing Object-Based Environment Perception for Safe Automated Driving
    Hoss, Michael
    Scholtes, Maike
    Eckstein, Lutz
    [J]. AUTOMOTIVE INNOVATION, 2022, 5 (03) : 223 - 250
  • [6] CCNet: Criss-Cross Attention for Semantic Segmentation
    Huang, Zilong
    Wang, Xinggang
    Huang, Lichao
    Huang, Chang
    Wei, Yunchao
    Liu, Wenyu
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 603 - 612
  • [7] Combining Low-Light Scene Enhancement for Fast and Accurate Lane Detection
    Ke, Changshuo
    Xu, Zhijie
    Zhang, Jianqin
    Zhang, Dongmei
    [J]. SENSORS, 2023, 23 (10)
  • [8] Deep embedded hybrid CNN-LSTM network for lane detection on NVIDIA Jetson Xavier NX
    Kortli, Yassin
    Gabsi, Souhir
    Voon, Lew F. C. Lew Yan
    Jridi, Maher
    Merzougui, Mehrez
    Atri, Mohamed
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 240
  • [9] Efficient Multi-Lane Detection Based on Large-Kernel Convolution and Location
    Li, Shoubiao
    Wu, Xin
    Wu, Zhifei
    [J]. IEEE ACCESS, 2023, 11 : 58125 - 58135
  • [10] Line-CNN: End-to-End Traffic Line Detection With Line Proposal Unit
    Li, Xiang
    Li, Jun
    Hu, Xiaolin
    Yang, Jian
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (01) : 248 - 258