Anchor Query based Transformer for Lane Detection

被引:0
作者
Xing, Yu [1 ]
Xu, Jinhua [1 ]
机构
[1] East China Normal Univ, Sch Comp Sci & Technol, Shanghai, Peoples R China
来源
2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024 | 2024年
关键词
lane detection; transformer detector; transformer; anchor-based detector; automatic driving;
D O I
10.1109/IJCNN60899.2024.10650577
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Lane detection is a significant task with applications such as adaptive cruise control, lane departure warning, and lane-keep assistance in autonomous driving. Convolutional neural networks (CNN) and transformers have been used for lane detection and achieved great performance. However, it is still challenging under complex scenarios, such as crowded or dazzling conditions. In this paper, a novel end-to-end transformer is proposed for lane detection, in which anchor queries (AQ) are used to provide the lane position priors. A coarse-to-fine (C2F) anchor refinement is implemented in the transformer decoder. In the decoder layer, a novel lane embedding is proposed which combines the features along the anchor and the features along the predicted lanes of the previous decoder layer, and the lane embeddings from different layers are fused through a novel cross-layer attention (CLA). We conducted extensive experiments on the CULane and TuSimple datasets. The results demonstrate that our method achieves state-of-the-art (SOTA) results in complex scenes.
引用
收藏
页数:8
相关论文
共 31 条
[1]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[2]  
Chen, 2023, ARXIV
[3]  
Chen ZP, 2019, IEEE INT VEH SYM, P2563, DOI [10.1109/IVS.2019.8813778, 10.1109/ivs.2019.8813778]
[4]  
Cheng Z., 2022, P AS C COMP VIS, P2075
[5]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[6]   Rethinking Efficient Lane Detection via Curve Modeling [J].
Feng, Zhengyang ;
Guo, Shaohua ;
Tan, Xin ;
Xu, Ke ;
Wang, Min ;
Ma, Lizhuang .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :17041-17049
[7]  
Han JH, 2022, AAAI CONF ARTIF INTE, P799
[8]   CLRerNet: Improving Confidence of Lane Detection with LaneIoU [J].
Honda, Hiroto ;
Uchida, Yusuke .
2024 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION, WACV 2024, 2024, :1165-1174
[9]   Key Points Estimation and Point Instance Segmentation Approach for Lane Detection [J].
Ko, Yeongmin ;
Lee, Younkwan ;
Azam, Shoaib ;
Munir, Farzeen ;
Jeon, Moongu ;
Pedrycz, Witold .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :8949-8958
[10]   Line-CNN: End-to-End Traffic Line Detection With Line Proposal Unit [J].
Li, Xiang ;
Li, Jun ;
Hu, Xiaolin ;
Yang, Jian .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (01) :248-258