Recursive Bayesian Filtering-Based Error Concealment Scheme for 3D Video Communication Over Severely Lossy Wireless Channels

被引:26
作者
El-Shafai, W. [1 ]
El-Rabaie, S. [1 ]
El-Halawany, M. M. [1 ]
Abd El-Samie, Fathi E. [1 ]
机构
[1] Menoufia Univ, Fac Elect Engn, Dept Elect & Elect Commun Engn, Menoufia 32952, Egypt
关键词
Error concealment; 3D video; Erroneous macro-blocks; Kalman filter; Wireless channel; Lossy networks; MULTIVIEW VIDEO; TRANSMISSION; ALGORITHMS; NETWORKS;
D O I
10.1007/s00034-018-0786-8
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The three-dimensional video (3DV) is composed of variable-length stream sequences captured via diversified cameras surrounding an object. Thus, it is an urgent task to accomplish sufficient encoding to be compatible with incoming bandwidth demands, while achieving a recommended 3DV reception performance. In the 3DV compression framework, the lost macro-blocks (MBs) might propagate into the following frames and the adjoining views. Therefore, it is obligatory to avoid error propagation by concealing the corrupted MBs at the decoder through the utilization of appropriate post-processing error concealment (EC) techniques. The existing EC algorithms fundamentally exploit the temporal, inter-view, and spatial matching within the 3DV frames and views to reconstruct the disparity vectors (DVs) and motion vectors (MVs) of the corrupted MBs. Unluckily, in the state of high severe corruptions and heavily erroneous MBs, these concealment algorithms are predominantly unreliable and might give unreliable 3DV quality. Thence, in this work, we suggest the utilization of the outer block boundary matching algorithm to estimate the MVs and the directional interpolation EC algorithm to estimate the DVs of the erroneous MBs. After that, the Bayesian Kalman filter (BKF) is employed because of its efficiency to filter out the inherent errors in the previously predicted DVs and MVs to accomplish better 3D video performance. Experimental results on standard 3DV sequences demonstrate that the suggested BKF-based EC scheme is more powerful with heavy losses. It subjectively and objectively outperforms the traditional concealment techniques at severely random and bursty packet loss rates (PLRs).
引用
收藏
页码:4810 / 4841
页数:32
相关论文
共 42 条
[11]   Joint Adaptive Pre-processing Resilience and Post-processing Concealment Schemes for 3D Video Transmission [J].
El-Shafai, Walid .
3D RESEARCH, 2015, 6 (01)
[12]   Pixel-level Matching Based Multi-hypothesis Error Concealment Modes for Wireless 3D H.264/MVC Communication [J].
El-Shafai, Walid .
3D RESEARCH, 2015, 6 (03)
[13]   Error-Resilient Multi-view Video Coding Based on End-to-End Rate-Distortion Optimization [J].
Gao Pan ;
Peng Qiang ;
Wang Qionghua .
CHINESE JOURNAL OF ELECTRONICS, 2016, 25 (02) :277-283
[14]  
Gao ZW, 2004, 2004 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 2, PROCEEDINGS, P69
[15]   Intra-/inter- View Correlation Based Multiple Description Coding for Multiview Transmission [J].
Guo, Jiansheng ;
Bai, Huihui ;
Lin, Chunyu ;
Zhang, Mengmeng ;
Zhao, Yao .
2015 DATA COMPRESSION CONFERENCE (DCC), 2015, :446-446
[16]  
Huang Hui, 2010, 2010 12th IEEE International Conference on Communication Technology (ICCT 2010), P576, DOI 10.1109/ICCT.2010.5688920
[17]   Inter-Layer FEC Aided Unequal Error Protection for Multilayer Video Transmission in Mobile TV [J].
Huo, Yongkai ;
El-Hajjar, Mohammed ;
Hanzo, Lajos .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2013, 23 (09) :1622-1634
[18]   Hybrid temporal error concealment methods for block-based compressed video transmission [J].
Hwang, Min-Cheol ;
Kim, Jun-Hyung ;
Duong, Dinh Trieu ;
Ko, Sung-Jea .
IEEE TRANSACTIONS ON BROADCASTING, 2008, 54 (02) :198-207
[19]  
*ISO IEC JTC1 SC29, 2006, JVTU207 ISOIEC JTC1S
[20]   Temporal and Inter-View Consistent Error Concealment Technique for Multiview Plus Depth Video [J].
Khattak, Shadan ;
Maugey, Thomas ;
Hamzaoui, Raouf ;
Ahmad, Shakeel ;
Frossard, Pascal .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (05) :829-840