Recursive Bayesian Filtering-Based Error Concealment Scheme for 3D Video Communication Over Severely Lossy Wireless Channels

被引:26
作者
El-Shafai, W. [1 ]
El-Rabaie, S. [1 ]
El-Halawany, M. M. [1 ]
Abd El-Samie, Fathi E. [1 ]
机构
[1] Menoufia Univ, Fac Elect Engn, Dept Elect & Elect Commun Engn, Menoufia 32952, Egypt
关键词
Error concealment; 3D video; Erroneous macro-blocks; Kalman filter; Wireless channel; Lossy networks; MULTIVIEW VIDEO; TRANSMISSION; ALGORITHMS; NETWORKS;
D O I
10.1007/s00034-018-0786-8
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The three-dimensional video (3DV) is composed of variable-length stream sequences captured via diversified cameras surrounding an object. Thus, it is an urgent task to accomplish sufficient encoding to be compatible with incoming bandwidth demands, while achieving a recommended 3DV reception performance. In the 3DV compression framework, the lost macro-blocks (MBs) might propagate into the following frames and the adjoining views. Therefore, it is obligatory to avoid error propagation by concealing the corrupted MBs at the decoder through the utilization of appropriate post-processing error concealment (EC) techniques. The existing EC algorithms fundamentally exploit the temporal, inter-view, and spatial matching within the 3DV frames and views to reconstruct the disparity vectors (DVs) and motion vectors (MVs) of the corrupted MBs. Unluckily, in the state of high severe corruptions and heavily erroneous MBs, these concealment algorithms are predominantly unreliable and might give unreliable 3DV quality. Thence, in this work, we suggest the utilization of the outer block boundary matching algorithm to estimate the MVs and the directional interpolation EC algorithm to estimate the DVs of the erroneous MBs. After that, the Bayesian Kalman filter (BKF) is employed because of its efficiency to filter out the inherent errors in the previously predicted DVs and MVs to accomplish better 3D video performance. Experimental results on standard 3DV sequences demonstrate that the suggested BKF-based EC scheme is more powerful with heavy losses. It subjectively and objectively outperforms the traditional concealment techniques at severely random and bursty packet loss rates (PLRs).
引用
收藏
页码:4810 / 4841
页数:32
相关论文
共 42 条
[1]  
[Anonymous], 2009, WD 4 REFERENCE SOFTW
[2]   Adaptive Multiview Video Streaming: Challenges and Opportunities [J].
Chakareski, Jacob .
IEEE COMMUNICATIONS MAGAZINE, 2013, 51 (05) :94-100
[3]   Motion Consistence and Textural Coherence based Error Concealment Algorithm for Corrupted Macroblock [J].
Chen, Jing ;
Cai, Canhui .
MANUFACTURING SCIENCE AND TECHNOLOGY, PTS 1-8, 2012, 383-390 :1605-1610
[4]   Next-Generation 3D Formats with Depth Map Support [J].
Chen, Ying ;
Vetro, Anthony .
IEEE MULTIMEDIA, 2014, 21 (02) :90-94
[5]   A Novel Intra-Fame Error Concealment Algorithm for H.264 AVC [J].
Chung, Yuk Ying ;
Chen, Leo Li Fan ;
Chen, Xiaoming ;
Yeh, Wei-Chang ;
Bae, Changseok .
THIRD 2008 INTERNATIONAL CONFERENCE ON CONVERGENCE AND HYBRID INFORMATION TECHNOLOGY, VOL 1, PROCEEDINGS, 2008, :881-+
[6]   An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering [J].
Cui, Shihua ;
Cui, Huijuan ;
Tang, Kun .
SIGNAL IMAGE AND VIDEO PROCESSING, 2014, 8 (08) :1533-1542
[7]  
Dhanalakshmi P., 2014, Proceedings of the 2014 International Conference on Recent Trends in Information Technology, P1
[8]   Encoder-independent decoder-dependent depth-assisted error concealment algorithm for wireless 3D video communication [J].
El-Shafai, W. ;
El-Rabaie, S. ;
El-Halawany, M. M. ;
Abd El-Samie, Fathi E. .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (11) :13145-13172
[9]   Enhancement of Wireless 3D Video Communication Using Color-Plus-Depth Error Restoration Algorithms and Bayesian Kalman Filtering [J].
El-Shafai, W. ;
El-Rabaie, S. ;
El-Halawany, M. ;
Abd El-Samie, F. E. .
WIRELESS PERSONAL COMMUNICATIONS, 2017, 97 (01) :245-268
[10]   Proposed adaptive joint error-resilience concealment algorithms for efficient colour-plus-depth 3D video transmission [J].
El-Shafai, Walid ;
El-Rabaie, El-Sayed M. ;
El-Halawany, Mohamed M. ;
Abd El-Samie, Fathi E. .
IET IMAGE PROCESSING, 2018, 12 (06) :967-984