Enhancing Image Inpainting With Deep Learning Segmentation and Exemplar-Based Inpainting

被引:1
作者
Jirakipuwapat, Wachirapong [1 ]
Sombut, Kamonrat [2 ]
Yodjai, Petcharaporn [3 ]
Seangwattana, Thidaporn [1 ]
机构
[1] King Mongkuts Univ Technol North Bangkok KMUTNB, Fac Sci Energy & Environm, Rayong, Thailand
[2] Rajamangala Univ Technol Thanyaburi RMUTT, Fac Sci & Technol, Dept Math & Comp Sci, Pathum Thani, Thailand
[3] King Mongkuts Univ Technol Thonburi KMUTT, Fac Sci, Dept Math, KMUTTFixed Point Res Lab,Sci Lab Bldg, Bangkok, Thailand
关键词
deep learning; exemplar-based inpainting; image inpainting; Mann-Whitney U test; segmentation;
D O I
10.1002/mma.10827
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The technique of recreating faded or lost portions of an image is called image inpainting. A critical challenge in image inpainting is accurately identifying the areas that need reconstruction. This article explores the integration of deep learning segmentation to enhance the efficiency of image inpainting and exemplar-based inpainting methods using a two-stage structure tensor and image sparse representation to fill in missing areas. By leveraging advanced segmentation models, we can precisely delineate the areas requiring inpainting, allowing for more seamless and realistic restorations. Together, the exemplar-based inpainting method involves selecting filling order, maintaining structure, and blending candidate patches for natural results in object removal. Because we are using actual photographs, we do not compare between images after fill and solution. Therefore, we use the Mann-Whitney U test to compare efficiency approaches.
引用
收藏
页码:9610 / 9617
页数:8
相关论文
共 50 条
[31]   A novel exemplar-based non-local algorithm for image inpainting [J].
Yang G. ;
Yang F. ;
Zhuang X. .
International Journal of Simulation: Systems, Science and Technology, 2016, 17 (31) :39.1-39.5
[32]   Image inpainting via modified exemplar-based inpainting with two-stage structure tensor and image sparse representation [J].
Yodjai, Petcharaporn ;
Kumam, Poom ;
Martinez-Moreno, Juan ;
Jirakitpuwapat, Wachirapong .
MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2024, 47 (11) :9027-9045
[33]   Efficient image inpainting based on region segmentation and varying exemplar [J].
Liu Y. ;
Wang H.-J. ;
Tian X.-J. ;
Yin Y.-M. .
Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2010, 18 (12) :2656-2664
[34]   An efficient forgery detection algorithm for object removal by exemplar-based image inpainting [J].
Liang, Zaoshan ;
Yang, Gaobo ;
Ding, Xiangling ;
Li, Leida .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 30 :75-85
[35]   Exemplar-based inpainting using local binary patterns [J].
Voronin, V. V. ;
Marchuk, V. I. ;
Gapon, N. V. ;
Sizyakin, R. A. ;
Sherstobitov, A. I. ;
Egiazarian, K. O. .
IMAGE PROCESSING: ALGORITHMS AND SYSTEMS XII, 2014, 9019
[36]   Introducing A New Fast Exemplar-Based Inpainting Algorithm [J].
Alilou, Vahid. K. ;
Yaghmaee, Farzin .
2014 22ND IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2014, :874-878
[37]   Exemplar-based inpainting with rotation invariant patch matching [J].
Boldys, Jiri ;
Besserer, Bernard .
VISAPP 2006: PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 1, 2006, :115-+
[38]   Damaged region filling and evaluation by symmetrical exemplar-based image inpainting for Thangka [J].
Weilan Wang ;
Yanjun Jia .
EURASIP Journal on Image and Video Processing, 2017
[39]   A NONLOCAL-MEANS APPROACH TO EXEMPLAR-BASED INPAINTING [J].
Wong, Alexander ;
Orchard, Jeff .
2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, :2600-2603
[40]   Exemplar-based image inpainting using angle-aware patch matching [J].
Zhang, Na ;
Ji, Hua ;
Liu, Li ;
Wang, Guanhua .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2019, 2019 (1)