Hybrid error concealment method combining exemplar-based image inpainting and spatial interpolation

被引:16
作者
Chung, Byungjin [1 ]
Yim, Changhoon [1 ]
机构
[1] Konkuk Univ, Dept Internet & Multimedia Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Image reconstruction; Error concealment; Image inpainting; Spatial interpolation; Video communication; OBJECT REMOVAL; VIDEO; FRAMEWORK;
D O I
10.1016/j.image.2014.09.009
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes an efficient error concealment method for the reconstruction of pixels that are lost in video communication. The proposed method is developed by combining exemplar-based image inpainting for patch reconstruction and spatial interpolation for pixel reconstruction using adaptive threshold by local complexity. By exemplar-based image inpainting, regions with regular structures are reconstructed. For complex regions with irregular structures, just one pixel is reconstructed using the proposed spatial interpolation method. The proposed spatial interpolation method performs reconstruction by selecting adaptively directional interpolation or neighbor interpolation based on gradient information. Simulation results show that the proposed hybrid method performs reconstruction with significantly improved subjective quality compared with the previous spatial error concealment and image inpainting methods. The proposed method also gives substantial improvements of PSNR compared with the previous methods. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:1121 / 1137
页数:17
相关论文
共 50 条
[41]   A NONLOCAL-MEANS APPROACH TO EXEMPLAR-BASED INPAINTING [J].
Wong, Alexander ;
Orchard, Jeff .
2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, :2600-2603
[42]   Exemplar-based image inpainting using svd-based approximation matrix and multi-scale analysis [J].
Alilou, Vahid K. ;
Yaghmaee, Farzin .
MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (05) :7213-7234
[43]   Exemplar-based image inpainting algorithm using adaptive sample and candidate patch system [J].
Fan Qian ;
Zhang Lifeng ;
Hu Xuelong .
PROCEEDINGS OF 2015 IEEE 12TH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS (ICEMI), VOL. 3, 2015, :1224-1228
[44]   Exemplar-based image inpainting using svd-based approximation matrix and multi-scale analysis [J].
Vahid K. Alilou ;
Farzin Yaghmaee .
Multimedia Tools and Applications, 2017, 76 :7213-7234
[45]   Improved Spatial Interpolation Error Concealment Based On Multiple Edges Detection [J].
Sun, Dawei ;
Zheng, Baoyu ;
Xu, Xiaorong .
2010 2ND INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2010), VOL 1, 2010, :648-652
[46]   A Detection Approach Using LSTM-CNN for Object Removal Caused by Exemplar-Based Image Inpainting [J].
Lu, Ming ;
Niu, Shaozhang .
ELECTRONICS, 2020, 9 (05)
[47]   Disparity Image Inpainting with Improved Method Based on Exemplar [J].
Yu, Shuchun ;
Yu, Xiaoyang ;
Fan, Jianying ;
Wu, Haibin ;
Wang, Yang ;
Feng, Qiaohua .
FRONTIERS OF MANUFACTURING AND DESIGN SCIENCE II, PTS 1-6, 2012, 121-126 :4431-4435
[48]   Spatial interpolation algorithm for error concealment [J].
Gharavi, Hamid ;
Gao, Shaoshuai .
2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, :1153-1156
[49]   Effective Exemplar-based Image Inpainting Using Low-rank Matrix Completion [J].
Lin, Xiangbo ;
Yang, Xinwei .
2015 IEEE 7TH INTERNATIONAL CONFERENCE ON AWARENESS SCIENCE & TECHNOLOGY (ICAST), 2015, :37-42
[50]   A Novel Approach to Exemplar Based Image Inpainting [J].
Patel, Kaushikkumar R. ;
Jain, Lalit .
2016 INTERNATIONAL CONFERENCE ON COMMUNICATION AND SIGNAL PROCESSING (ICCSP), VOL. 1, 2016, :810-814