Progressive scene text erasing with self-supervision

被引:4
作者
Du, Xiangcheng [1 ]
Zhou, Zhao [1 ]
Zheng, Yingbin [2 ]
Wu, Xingjiao [1 ]
Ma, Tianlong [1 ]
Jin, Cheng [1 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[2] Videt Lab, Shanghai, Peoples R China
关键词
Scene text erasing; Progressive strategy; Self-supervision;
D O I
10.1016/j.cviu.2023.103712
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Scene text erasing seeks to erase text contents from scene images and current state-of-the-art text erasing models are trained on large-scale synthetic data. Although data synthetic engines can provide vast amounts of annotated training samples, there are differences between synthetic and real-world data. In this paper, we employ self-supervision for feature representation on unlabeled real-world scene text images. A novel pretext task is designed to keep consistent among text stroke masks of image variants. We design the Progressive Erasing Network in order to remove residual texts. The scene text is erased progressively by leveraging the intermediate generated results which provide the foundation for subsequent higher quality results. Experiments show that our method significantly improves the generalization of the text erasing task and achieves state-of-the-art performance on public benchmarks.
引用
收藏
页数:10
相关论文
共 50 条
[21]   Zero-shot learning with self-supervision by shuffling semantic embeddings [J].
Kim, Hoseong ;
Lee, Jewook ;
Byun, Hyeran .
NEUROCOMPUTING, 2021, 437 :1-8
[22]   Deep Attention-Guided Graph Clustering With Dual Self-Supervision [J].
Peng, Zhihao ;
Liu, Hui ;
Jia, Yuheng ;
Hou, Junhui .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (07) :3296-3307
[23]   Federated learning for machinery fault diagnosis with dynamic validation and self-supervision [J].
Zhang, Wei ;
Li, Xiang ;
Ma, Hui ;
Luo, Zhong ;
Li, Xu .
KNOWLEDGE-BASED SYSTEMS, 2021, 213
[24]   SELF-SUPERVISION BOOSTED RETINAL VESSEL SEGMENTATION FOR CROSS-DOMAIN DATA [J].
Li, Haojin ;
Li, Heng ;
Shu, Hai ;
Chen, Jianyu ;
Hu, Yan ;
Liu, Jiang .
2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
[25]   TTAPS: Test-Time Adaption by Aligning Prototypes using Self-Supervision [J].
Bartler, Alexander ;
Bender, Florian ;
Wiewel, Felix ;
Yang, Bin .
2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
[26]   Cervix type detection using a self-supervision boosted object detection technique [J].
Bijoy, M. B. ;
Akondi, Sai Manoj ;
Fathaah, S. Abdul ;
Raut, Akash ;
Pournami, P. N. ;
Jayaraj, P. B. .
INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2022, 32 (05) :1615-1630
[27]   Cross-layer self-representation enhanced deep subspace clustering with self-supervision [J].
Peng, Lifan ;
Zhang, Xiaoqian ;
He, Youdong ;
Chen, Siyu ;
Chen, Yufeng .
INFORMATION SCIENCES, 2024, 679
[28]   Deep Spatial Prediction via Heterogeneous Multi-source Self-supervision [J].
Zhang, Minxing ;
Yu, Dazhou ;
Li, Yun ;
Zhao, Liang .
ACM TRANSACTIONS ON SPATIAL ALGORITHMS AND SYSTEMS, 2023, 9 (03)
[29]   Training Networks in Null Space of Feature Covariance With Self-Supervision for Incremental Learning [J].
Wang, Shipeng ;
Li, Xiaorong ;
Sun, Jian ;
Xu, Zongben .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (04) :2563-2580
[30]   ON THE MARGINAL BENEFIT OF ACTIVE LEARNING: DOES SELF-SUPERVISION EAT ITS CAKE? [J].
Chan, Yao-Chun ;
Li, Mingchen ;
Oymak, Samet .
2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, :3455-3459