Deep Learning-Powered System for Real-Time Digital Meter Reading on Edge Devices

被引:5
作者
Carvalho, Rafaela [1 ]
Melo, Jorge [1 ]
Graca, Ricardo [1 ]
Santos, Goncalo [2 ]
Vasconcelos, Maria Joao M. [1 ]
机构
[1] Fraunhofer Portugal AICOS, Rua Alfredo Allen, P-4200135 Porto, Portugal
[2] Glarevision SA, P-2400441 Leiria, Portugal
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 04期
关键词
deep learning; automatic meter reading; autonomous measurement; edge computing; industrial intelligence;
D O I
10.3390/app13042315
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The ongoing reading process of digital meters is time-consuming and prone to errors, as operators capture images and manually update the system with the new readings. This work proposes to automate this operation through a deep learning-powered solution for universal controllers and flow meters that can be seamlessly incorporated into operators' existing workflow. Firstly, the digital display area of the equipment is extracted with a screen detection module, and a perspective correction step is performed. Subsequently, the text regions are identified with a fine-tuned EAST text detector, and the important readings are selected through template matching based on the expected graphical structure. Finally, a fine-tuned convolutional recurrent neural network model recognizes the text and registers it. Evaluation experiments confirm the robustness and potential for workload reduction of the proposed system, which correctly extracts 55.47% and 63.70% of the values for reading in universal controllers, and 73.08% of the values from flow meters. Furthermore, this pipeline performs in real time in a low-end mobile device, with an average execution time in preview of under 250 ms for screen detection and on an acquired photo of 1500 ms for the entire pipeline.
引用
收藏
页数:13
相关论文
共 22 条
[11]   ICDAR 2013 Robust Reading Competition [J].
Karatzas, Dimosthenis ;
Shafait, Faisal ;
Uchida, Seiichi ;
Iwamura, Masakazu ;
Gomez i Bigorda, Lluis ;
Robles Mestre, Sergi ;
Mas, Joan ;
Fernandez Mota, David ;
Almazan Almazan, Jon ;
Pere de las Heras, Lluis .
2013 12TH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR), 2013, :1484-1493
[12]  
Kim K.-H, 2016, ARXIV
[13]   Towards Image-Based Automatic Meter Reading in Unconstrained Scenarios: A Robust and Efficient Approach [J].
Laroca, Rayson ;
Araujo, Alessandra B. ;
Zanlorensi, Luiz A. ;
De Almeida, Eduardo C. ;
Menotti, David .
IEEE ACCESS, 2021, 9 :67569-67584
[14]   Convolutional neural networks for automatic meter reading [J].
Laroca, Rayson ;
Barroso, Victor ;
Diniz, Matheus A. ;
Goncalves, Gabriel R. ;
Schwartz, William Robson ;
Menotti, David .
JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (01)
[15]   Microsoft COCO: Common Objects in Context [J].
Lin, Tsung-Yi ;
Maire, Michael ;
Belongie, Serge ;
Hays, James ;
Perona, Pietro ;
Ramanan, Deva ;
Dollar, Piotr ;
Zitnick, C. Lawrence .
COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 :740-755
[16]   Real-Time Brazilian License Plate Detection and Recognition Using Deep Convolutional Neural Networks [J].
Montazzolli, Sergio ;
Jung, Claudio .
2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2017, :55-62
[17]   You Only Look Once: Unified, Real-Time Object Detection [J].
Redmon, Joseph ;
Divvala, Santosh ;
Girshick, Ross ;
Farhadi, Ali .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :779-788
[18]  
Research C.A., WHAT IS WRONG SCENE
[19]   MobileNetV2: Inverted Residuals and Linear Bottlenecks [J].
Sandler, Mark ;
Howard, Andrew ;
Zhu, Menglong ;
Zhmoginov, Andrey ;
Chen, Liang-Chieh .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4510-4520
[20]   An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition [J].
Shi, Baoguang ;
Bai, Xiang ;
Yao, Cong .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (11) :2298-2304