Enhancing Image Inpainting With Deep Learning Segmentation and Exemplar-Based Inpainting

被引:1
作者
Jirakipuwapat, Wachirapong [1 ]
Sombut, Kamonrat [2 ]
Yodjai, Petcharaporn [3 ]
Seangwattana, Thidaporn [1 ]
机构
[1] King Mongkuts Univ Technol North Bangkok KMUTNB, Fac Sci Energy & Environm, Rayong, Thailand
[2] Rajamangala Univ Technol Thanyaburi RMUTT, Fac Sci & Technol, Dept Math & Comp Sci, Pathum Thani, Thailand
[3] King Mongkuts Univ Technol Thonburi KMUTT, Fac Sci, Dept Math, KMUTTFixed Point Res Lab,Sci Lab Bldg, Bangkok, Thailand
关键词
deep learning; exemplar-based inpainting; image inpainting; Mann-Whitney U test; segmentation;
D O I
10.1002/mma.10827
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The technique of recreating faded or lost portions of an image is called image inpainting. A critical challenge in image inpainting is accurately identifying the areas that need reconstruction. This article explores the integration of deep learning segmentation to enhance the efficiency of image inpainting and exemplar-based inpainting methods using a two-stage structure tensor and image sparse representation to fill in missing areas. By leveraging advanced segmentation models, we can precisely delineate the areas requiring inpainting, allowing for more seamless and realistic restorations. Together, the exemplar-based inpainting method involves selecting filling order, maintaining structure, and blending candidate patches for natural results in object removal. Because we are using actual photographs, we do not compare between images after fill and solution. Therefore, we use the Mann-Whitney U test to compare efficiency approaches.
引用
收藏
页码:9610 / 9617
页数:8
相关论文
共 50 条
[41]   Exemplar-based image inpainting using angle-aware patch matching [J].
Zhang, Na ;
Ji, Hua ;
Liu, Li ;
Wang, Guanhua .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2019, 2019 (1)
[42]   Topological Data Analysis to improve Exemplar-based inpainting [J].
Al-Jaberi, Ahmed K. ;
Asaad, Aras ;
Jassim, Sabah A. ;
Al-Jawad, Naseer .
MOBILE MULTIMEDIA/IMAGE PROCESSING, SECURITY, AND APPLICATIONS 2018, 2018, 10668
[43]   Image inpainting based on deep learning: A review [J].
Zhang, Xiaobo ;
Zhai, Donghai ;
Li, Tianrui ;
Zhou, Yuxin ;
Lin, Yang .
INFORMATION FUSION, 2023, 90 :74-94
[44]   Damaged region filling and evaluation by symmetrical exemplar-based image inpainting for Thangka [J].
Wang, Weilan ;
Jia, Yanjun .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2017,
[45]   Exemplar-based image inpainting using angle-aware patch matching [J].
Na Zhang ;
Hua Ji ;
Li Liu ;
Guanhua Wang .
EURASIP Journal on Image and Video Processing, 2019
[46]   Image inpainting based on exemplar patch [J].
Tang, BL ;
Liu, X .
ISTM/2005: 6TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-9, CONFERENCE PROCEEDINGS, 2005, :6125-6128
[47]   Exemplar-Based Pixel by Pixel Inpainting Based on Patch Shift [J].
Qiang, Zhenping ;
He, Libo ;
Xu, Dan .
COMPUTER VISION, PT II, 2017, 772 :370-382
[48]   Image inpainting algorithm based on regional segmentation and adaptive window exemplar [J].
Yang, Liu ;
Xiao-jian, Tian ;
Qing, Wang ;
Shang-xin, Shao ;
Xiao-lin, Sun .
2ND IEEE INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER CONTROL (ICACC 2010), VOL. 5, 2010, :656-659
[49]   Exemplar-based image inpainting algorithm using adaptive sample and candidate patch system [J].
Fan Qian ;
Zhang Lifeng ;
Hu Xuelong .
PROCEEDINGS OF 2015 IEEE 12TH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS (ICEMI), VOL. 3, 2015, :1224-1228
[50]   Hybrid error concealment method combining exemplar-based image inpainting and spatial interpolation [J].
Chung, Byungjin ;
Yim, Changhoon .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2014, 29 (10) :1121-1137