Graph-Based Compression of Dynamic 3D Point Cloud Sequences

被引:198
作者
Thanou, Dorina [1 ]
Chou, Philip A. [2 ]
Frossard, Pascal [1 ]
机构
[1] Ecole Polytech Fed Lausanne, Signal Proc Lab LTS4, CH-1015 Lausanne, Switzerland
[2] Microsoft Res, Redmond, WA 98052 USA
关键词
3D sequences; voxels; graph-based features; spectral graph wavelets; motion compensation; MESH COMPRESSION; REAL-TIME; SIGNALS;
D O I
10.1109/TIP.2016.2529506
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper addresses the problem of compression of 3D point cloud sequences that are characterized by moving 3D positions and color attributes. As temporally successive point cloud frames share some similarities, motion estimation is key to effective compression of these sequences. It, however, remains a challenging problem as the point cloud frames have varying numbers of points without explicit correspondence information. We represent the time-varying geometry of these sequences with a set of graphs, and consider 3D positions and color attributes of the point clouds as signals on the vertices of the graphs. We then cast motion estimation as a feature-matching problem between successive graphs. The motion is estimated on a sparse set of representative vertices using new spectral graph wavelet descriptors. A dense motion field is eventually interpolated by solving a graph-based regularization problem. The estimated motion is finally used for removing the temporal redundancy in the predictive coding of the 3D positions and the color characteristics of the point cloud sequences. Experimental results demonstrate that our method is able to accurately estimate the motion between consecutive frames. Moreover, motion estimation is shown to bring a significant improvement in terms of the overall compression performance of the sequence. To the best of our knowledge, this is the first paper that exploits both the spatial correlation inside each frame (through the graph) and the temporal correlation between the frames (through the motion estimation) to compress the color and the geometry of 3D point cloud sequences in an efficient way.
引用
收藏
页码:1765 / 1778
页数:14
相关论文
共 55 条
[1]   Large-Scale 3D Point Cloud Compression Using Adaptive Radial Distance Prediction in Hybrid Coordinate Domains [J].
Ahn, Jae-Kyun ;
Lee, Kyu-Yul ;
Sim, Jae-Young ;
Kim, Chang-Su .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2015, 9 (03) :422-434
[2]  
Alexa M, 2000, COMPUT GRAPH FORUM, V19, pC411, DOI 10.1111/1467-8659.00433
[3]  
Alexandre L.A., 2012, WORKSH COL DEPTH CAM, V1, P7, DOI DOI 10.1109/TPAMI.2011.263
[4]  
[Anonymous], 2013, Proceedings of High Performance Graphics (HPG)
[5]  
[Anonymous], 2006, S POINT BAS GRAPH 20
[6]  
[Anonymous], 2002, ACM Transactions on Graphics (TOG), DOI 10.1145/566654.566589
[7]  
Aubry M, 2011, IEEE I CONF COMP VIS, P1411, DOI 10.1109/ICCV.2011.6126396
[8]   Speeded-Up Robust Features (SURF) [J].
Bay, Herbert ;
Ess, Andreas ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 110 (03) :346-359
[9]  
Briceno H. M., 2003, ACM SIGGRAPH/Eurographics Symposium on Computer Animation, P136
[10]   Scale-invariant heat kernel signatures for non-rigid shape recognition [J].
Bronstein, Michael M. ;
Kokkinos, Iasonas .
2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, :1704-1711