Improving the Accuracy of License Plate Detection and Recognition in General Unconstrained Scenarios

被引:0
作者
Zhang, Zhongze [1 ]
Wan, Yi [1 ]
机构
[1] Lanzhou Univ, Sch Informat Sci & Engn, Lanzhou, Peoples R China
来源
2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019) | 2019年
关键词
license plate; Deep Learning; Convolutional Neural Networks;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays, Automatic License Plate Recognition (ALPR) is widely used in commercial applications. Some of the existing methods focus on the detection of license plate (LP) images with approximate frontage, while others deal with the unconstrained LP of images, but the result of LP recognition under some extreme conditions is unsatisfactory. This work mainly focuses on improving the existing unconstrained LP capturing method [1] to extract the LP and recognize it in several extreme cases as many LPs may be seriously distorted, even not parallelogram. Our main contributions are the following. First is to modify the loss function of the existing Convolutional Neural Networks (CNNs) so that the output parameters can form a parallelogram directly, then, LPs could be detected more accurate in a single input image first. Secondly, two parameters need to be estimated are added to the output of the networks' fully connected layer structure to make the corresponding output parameters form an arbitrary quadrilateral, which is closer to the LP shape of the actual imaging. In this way, it can detect and correct LPs with various shapes (LP may be deformed into irregular quadrilateral due to various reasons) in a single image. Thirdly, a feedback mechanism would be added to identify and process the LP images which are not detected correctly after the LP characters are recognized by Optical Character Recognition (OCR) network, then, return the processed image to the detection network for re-detection. In general, LP can be detected correctly. Compared to the other benchmark methods, the experimental results have demonstrated that the proposed method achieved the best performance, especially in the extreme conditions.
引用
收藏
页码:1194 / 1199
页数:6
相关论文
共 11 条
[1]  
[Anonymous], 2015, Arxiv.Org, DOI DOI 10.3389/FPSYG.2013.00124
[2]   Using Affective Computing to automatically adapt serious games for rehabilitation [J].
Aranha, Renan Vinicius ;
Silva, Leonardo Souza ;
Chaim, Marcos Lordello ;
Nunes, Fatima L. S. .
2017 IEEE 30TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), 2017, :55-60
[3]   Segmentation- and Annotation-Free License Plate Recognition With Deep Localization and Failure Identification [J].
Bulan, Orhan ;
Kozitsky, Vladimir ;
Ramesh, Palghat ;
Shreve, Matthew .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2017, 18 (09) :2351-2363
[4]  
He KM, 2017, IEEE I CONF COMP VIS, P2980, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]
[5]  
Joseph RK, 2016, CRIT POL ECON S ASIA, P1
[6]  
Kingma J., 2015, INT C LEARNING REPRE
[7]  
Kurpiel FD, 2017, IEEE IMAGE PROC, P3395, DOI 10.1109/ICIP.2017.8296912
[8]   Reading car license plates using deep neural networks [J].
Li, Hui ;
Wang, Peng ;
You, Mingyu ;
Shen, Chunhua .
IMAGE AND VISION COMPUTING, 2018, 72 :14-23
[9]  
REDMON J, 2016, PROC CVPR IEEE, P779, DOI [DOI 10.1109/CVPR.2016.91, 10.1109/CVPR.2016.91]
[10]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149