A pooling based scene text proposal technique for scene text reading in the wild

被引:12
|
作者
Dinh NguyenVan [1 ,5 ]
Lu, Shijian [2 ]
Tian, Shangxuan [3 ]
Ouarti, Nizar [1 ,5 ]
Mokhtari, Mounir [4 ,5 ]
机构
[1] Univ Paris 06, Sorbonne Univ, 4 Pl Jussieu, F-75252 Paris 05, France
[2] Nanyang Technol Univ, Nanyang Ave, Singapore 639798, Singapore
[3] Tencent Co LTD, Gaoxinnanyi Ave,Southern Dist Hitech Pk, Shenzhen 518057, Peoples R China
[4] Inst Mines Telecom, 37-39 Rue Dareau, F-75014 Paris, France
[5] CNRS, Image & Pervas Access Lab, UMI 2955, I2R, 1 Fusionopolis Way,21-01 Connexis South Tower, Singapore 138632, Singapore
关键词
Scene text proposal; Pooling based grouping; Scene text detection; Scene text reading; Scene text spotting; NEURAL-NETWORK; RECOGNITION; LOCALIZATION;
D O I
10.1016/j.patcog.2018.10.012
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic reading texts in scenes has attracted increasing interest in recent years as texts often carry rich semantic information that is useful for scene understanding. In this paper, we propose a novel scene text proposal technique aiming for accurate reading texts in scenes. Inspired by the pooling layer in the deep neural network architecture, a pooling based scene text proposal technique is developed. A novel score function is designed which exploits the histogram of oriented gradients and is capable of ranking the proposals according to their probabilities of being text. An end-to-end scene text reading system has also been developed by incorporating the proposed scene text proposal technique where false alarms elimination and words recognition are performed simultaneously. Extensive experiments over several public datasets show that the proposed technique can handle multi-orientation and multi-language scene texts and obtains outstanding proposal performance. The developed end-to-end systems also achieve very competitive scene text spotting and reading performance. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:118 / 129
页数:12
相关论文
共 50 条
  • [1] FTPN: Scene Text Detection With Feature Pyramid Based Text Proposal Network
    Liu, Fagui
    Chen, Cheng
    Gu, Dian
    Zheng, Jingzhong
    IEEE ACCESS, 2019, 7 : 44219 - 44228
  • [2] Toward Integrated Scene Text Reading
    Weinman, Jerod J.
    Butler, Zachary
    Knoll, Dugan
    Feild, Jacqueline
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (02) : 375 - 387
  • [3] A Text-Specific Domain Adaptive Network for Scene Text Detection in the Wild
    He, Xuan
    Yuan, Jin
    Li, Mengyao
    Wang, Runmin
    Wang, Haidong
    Li, Zhiyong
    APPLIED INTELLIGENCE, 2023, 53 (22) : 26827 - 26839
  • [4] Scene Text Detection Based on Text Stroke Components
    Hou, Xinyue
    Cheng, Pengsen
    Gao, Hongyu
    Li, Xin
    Liu, Jiayong
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2025, 35 (05)
  • [5] Scene Text Telescope: Text-Focused Scene Image Super-Resolution
    Chen, Jingye
    Li, Bin
    Xue, Xiangyang
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12021 - 12030
  • [6] Could scene context be beneficial for scene text detection?
    Zhu, Anna
    Gao, Renwu
    Uchida, Seiichi
    PATTERN RECOGNITION, 2016, 58 : 204 - 215
  • [7] Reading scene text with fully convolutional sequence modeling
    Gao, Yunze
    Chen, Yingying
    Wang, Jinqiao
    Tang, Ming
    Lu, Hanqing
    NEUROCOMPUTING, 2019, 339 : 161 - 170
  • [8] Reading Scene Text with Aggregated Temporal Convolutional Encoder
    Ma, Tianlong
    Du, Xiangcheng
    Wu, Xingjiao
    Zhou, Zhao
    Zheng, Yingbin
    Jin, Cheng
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (11)
  • [9] Scene Text Dataset in Turkish
    Erdogmus, Nesli
    2017 25TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2017,
  • [10] A robust proposal generation method for text lines in natural scene images
    Fan, Kun
    Baek, Seung Jun
    NEUROCOMPUTING, 2018, 304 : 47 - 63