Research on license plate location and recognition in complex environment

被引:5
作者
Yu, Hao [1 ]
Wang, Xingqi [1 ]
Shao, Yanli [1 ]
Qin, Feiwei [1 ]
Chen, Bin [1 ]
Gong, Senlin [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Key Lab Complex Syst Modeling & Simulat, Hangzhou, Peoples R China
基金
美国国家科学基金会;
关键词
Complex environment; License plate recognition; CycleGAN; U-Net; Attention mechanism;
D O I
10.1007/s11554-022-01225-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at the problems of license plate location difficulty and low character recognition accuracy in complex environments, such as a small number of license plate samples, illumination transformation, changeable weather and motion blur, this paper proposes an end-to-end license plate recognition method to improve the location and recognition accuracy in complex environments. First, the cyclic generative adversarial network is used to synthesize the approximate real license plate image to enrich the training set and solve the problem of data imbalance to facilitate subsequent model training. Second, a MF-RepUnet license plate location method is proposed, which integrates the improved VGG structure and feature pyramid into the U-Net model to improve the feature extraction capability of the network, and effectively solve the problem of missing detection of inclined license plate and small-scale license plate. Finally, the convolutional recurrent neural network is improved to accurately predict the feature sequence through the way of attention mechanism weighting, which solves the problem of blurred semantic structure sequence features caused by image degradation and further improves the accuracy of license plate character recognition. Experiments show that the proposed method can effectively improve the accuracy and efficiency of license plate location and character recognition, and can be applied to license plate recognition in various complex environments.
引用
收藏
页码:823 / 837
页数:15
相关论文
共 29 条
  • [1] An Iranian License Plate Recognition System Based on Color Features
    Ashtari, Amir Hossein
    Nordin, Md. Jan
    Fathy, Mahmood
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2014, 15 (04) : 1690 - 1705
  • [2] Bagi S. S., 2019, P 2019 INT C COMMUNI
  • [3] Beijing Zhiyun, 2018, HYPERLPR
  • [4] Multi-Label Image Recognition with Graph Convolutional Networks
    Chen, Zhao-Min
    Wei, Xiu-Shen
    Wang, Peng
    Guo, Yanwen
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 5172 - 5181
  • [5] ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data
    Diakogiannis, Foivos, I
    Waldner, Francois
    Caccetta, Peter
    Wu, Chen
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 162 (162) : 94 - 114
  • [6] RepVGG: Making VGG-style ConvNets Great Again
    Ding, Xiaohan
    Zhang, Xiangyu
    Ma, Ningning
    Han, Jungong
    Ding, Guiguang
    Sun, Jian
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 13728 - 13737
  • [7] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [8] Ha PS, 2016, 2016 ARTIFICIAL INTELLIGENCE AND ROBOTICS (IRANOPEN), P170, DOI 10.1109/RIOS.2016.7529509
  • [9] Graph Convolutional Networks for Hyperspectral Image Classification
    Hong, Danfeng
    Gao, Lianru
    Yao, Jing
    Zhang, Bing
    Plaza, Antonio
    Chanussot, Jocelyn
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07): : 5966 - 5978
  • [10] Kipf TN, 2016, ARXIV