Reconstruction of Compressed-Sensed Multiview Video With Disparity-and Motion-Compensated Total Variation Minimization

被引:5
作者
Liu, Ying [1 ]
Pados, Dimitris A. [1 ]
Kim, Joohee [2 ]
Zhang, Chen [2 ]
机构
[1] SUNY Buffalo, Dept Elect Engn, Buffalo, NY 14260 USA
[2] IIT, Dept Elect & Comp Engn, Chicago, IL 60616 USA
基金
美国国家科学基金会;
关键词
360 degrees video; compressed sensing (CS); disparity compensation; immersive video; motion compensation; multiview video; sparse representation; total variation (TV) minimization; JOINT RECONSTRUCTION; BIT ALLOCATION; VIEW; IMAGE; OPTIMIZATION; PREDICTION; INFORMATION; EXTENSIONS; ALGORITHM; RECOVERY;
D O I
10.1109/TCSVT.2017.2656920
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Compressed sensing (CS) is the theory and practice of sub-Nyquist sampling of sparse signals of interest. Exact reconstruction may then be possible with much fewer than the Nyquist-required number of data. In this paper, we consider a multiview video system in which multiple cameras at different locations perform independent CS to simultaneously capture different views of a scene. At the decoder, we propose a disparity- and motion-compensated total variation minimization algorithm to jointly reconstruct the multiview video sequence. The experimental results show that the proposed joint reconstruction algorithm successfully exploits simultaneously intra-frame, interframe, and inter-view sparsity and significantly outperforms existing independent-view reconstruction, residue-view reconstruction, and motion-adaptive reconstruction algorithms.
引用
收藏
页码:1288 / 1302
页数:15
相关论文
共 72 条
  • [1] [Anonymous], FOUND TRENDS MACH LE
  • [2] [Anonymous], JTC1SC29WG11 ISOIEC
  • [3] [Anonymous], 2009, THESIS
  • [4] [Anonymous], 2009, Ph.D. dissertation
  • [5] Asif MS, 2013, CONF REC ASILOMAR C, P579, DOI 10.1109/ACSSC.2013.6810345
  • [6] Motion-adaptive spatio-temporal regularization for accelerated dynamic MRI
    Asif, M. Salman
    Hamilton, Lei
    Brummer, Marijn
    Romberg, Justin
    [J]. MAGNETIC RESONANCE IN MEDICINE, 2013, 70 (03) : 800 - 812
  • [7] High accuracy optical flow estimation based on a theory for warping
    Brox, T
    Bruhn, A
    Papenberg, N
    Weickert, J
    [J]. COMPUTER VISION - ECCV 2004, PT 4, 2004, 2034 : 25 - 36
  • [8] Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation
    Brox, Thomas
    Malik, Jitendra
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (03) : 500 - 513
  • [9] Candes E.J., 2005, l1-MAGIC: Recovery of sparse signals via convex programming
  • [10] Candès EJ, 2008, IEEE SIGNAL PROC MAG, V25, P21, DOI 10.1109/MSP.2007.914731