Deep Learning-Powered System for Real-Time Digital Meter Reading on Edge Devices

被引:5
作者
Carvalho, Rafaela [1 ]
Melo, Jorge [1 ]
Graca, Ricardo [1 ]
Santos, Goncalo [2 ]
Vasconcelos, Maria Joao M. [1 ]
机构
[1] Fraunhofer Portugal AICOS, Rua Alfredo Allen, P-4200135 Porto, Portugal
[2] Glarevision SA, P-2400441 Leiria, Portugal
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 04期
关键词
deep learning; automatic meter reading; autonomous measurement; edge computing; industrial intelligence;
D O I
10.3390/app13042315
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The ongoing reading process of digital meters is time-consuming and prone to errors, as operators capture images and manually update the system with the new readings. This work proposes to automate this operation through a deep learning-powered solution for universal controllers and flow meters that can be seamlessly incorporated into operators' existing workflow. Firstly, the digital display area of the equipment is extracted with a screen detection module, and a perspective correction step is performed. Subsequently, the text regions are identified with a fine-tuned EAST text detector, and the important readings are selected through template matching based on the expected graphical structure. Finally, a fine-tuned convolutional recurrent neural network model recognizes the text and registers it. Evaluation experiments confirm the robustness and potential for workload reduction of the proposed system, which correctly extracts 55.47% and 63.70% of the values for reading in universal controllers, and 73.08% of the values from flow meters. Furthermore, this pipeline performs in real time in a low-end mobile device, with an average execution time in preview of under 250 ms for screen detection and on an acquired photo of 1500 ms for the entire pipeline.
引用
收藏
页数:13
相关论文
共 22 条
[1]  
[Anonymous], 2014, WORKSHOP DEEP LEARNI
[2]   What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysis [J].
Baek, Jeonghun ;
Kim, Geewook ;
Lee, Junyeop ;
Park, Sungrae ;
Han, Dongyoon ;
Yun, Sangdoo ;
Oh, Seong Joon ;
Lee, Hwalsuk .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :4714-4722
[3]  
Bautista D, Scene text recognition with permuted autoregressive sequence models
[4]   Scene Text Recognition with Permuted Autoregressive Sequence Models [J].
Bautista, Darwin ;
Atienza, Rowel .
COMPUTER VISION - ECCV 2022, PT XXVIII, 2022, 13688 :178-196
[5]   Rosetta: Large Scale System for Text Detection and Recognition in Images [J].
Borisyuk, Fedor ;
Gordo, Albert ;
Sivakumar, Viswanath .
KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, :71-79
[6]   Cutting Sayre's Knot: Reading Scene Text without Segmentation. Application to Utility Meters. [J].
Gomez, Lluis ;
Rusinol, Marcal ;
Karatzas, Dimosthenis .
2018 13TH IAPR INTERNATIONAL WORKSHOP ON DOCUMENT ANALYSIS SYSTEMS (DAS), 2018, :97-102
[7]   Synthetic Data for Text Localisation in Natural Images [J].
Gupta, Ankush ;
Vedaldi, Andrea ;
Zisserman, Andrew .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2315-2324
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]  
Jocher Glenn, 2022, Zenodo, DOI 10.5281/ZENODO.3908559
[10]  
Karatzas D, 2015, PROC INT CONF DOC, P1156, DOI 10.1109/ICDAR.2015.7333942