Motion Compression Using Structurally Connected Neural Network

被引:0
作者
Xia, Guiyu [1 ,2 ]
Ye, Wenkai [3 ]
Xue, Peng [3 ]
Sun, Yubao [4 ]
Liu, Qingshan [4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Automat, Jiangsu Key Lab Big Data Anal Technol, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Nanjing 210044, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Informat & Syst Sci Inst, Sch Automat, Nanjing 210044, Peoples R China
[4] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
关键词
Skeleton; Correlation; Data models; Principal component analysis; Neurons; Artificial neural networks; Dimensionality reduction; Motion data; motion compression; structurally connected network; spherical polar coordinate; human skeleton;
D O I
10.1109/TCSVT.2023.3332911
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Motion compression technologies can significantly reduce the redundant information of motion data and increase the efficiency of storage and transmission. Current methods mainly utilize some ready-made universal algorithms, such as signal processing and dimensionality reduction, to model the statistical characteristics of motion data, while the individual structure of motion data is ignored. In this paper, we propose to use a deep neural network with specially designed architecture to represent motion data considering the similarity between the articulated structure of a human skeleton and the architecture of neural networks. The network parameters are then taken as the compressed data. We design a structurally connected network which just looks like a human skeleton. Within the network, only the neurons corresponding to the joints connected to each other in a human skeleton are connected. It effectively exploits the correlations between connected joints to cut down the unnecessary connections between the neurons, which leads to the significant improvement of compression efficiency. Additionally, we extract the two inherent DOFs instead of the original three DOFs of each joint by representing its movement on a sphere according to the rigidity of the articulated human skeleton. This actually achieves the theoretically lossless pre-compression with the ratio of 3:2. Extensive experiment results demonstrate the superior performances of the proposed model at the high compression ratios over other state-of-the-art methods.
引用
收藏
页码:4299 / 4310
页数:12
相关论文
共 41 条
[1]   3D Human Body Models Compression and Decompression Algorithm Based on Graph Convolutional Networks for Holographic communication [J].
Bozhilov, Ivaylo ;
Tonchev, Krasimir ;
Manolova, Agata ;
Petkova, Radostina .
2022 25TH INTERNATIONAL SYMPOSIUM ON WIRELESS PERSONAL MULTIMEDIA COMMUNICATIONS (WPMC), 2022,
[2]  
Chen HB, 2021, ADV NEUR IN, V34
[3]   Learning for Video Compression [J].
Chen, Zhibo ;
He, Tianyu ;
Jin, Xin ;
Wu, Feng .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (02) :566-576
[4]   Nonlinear wavelet transforms for image coding via lifting [J].
Claypoole, RL ;
Davis, GM ;
Sweldens, W ;
Baraniuk, RG .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (12) :1449-1459
[5]   Touch and Beyond: Comparing Physical and Virtual Reality Visualizations [J].
Danyluk, Kurtis ;
Ulusoy, Teoman ;
Wei, Wei ;
Willett, Wesley .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (04) :1930-1940
[6]  
Davies T, 2021, Arxiv, DOI arXiv:2009.09808
[7]   Towards More Realistic Human Motion Prediction With Attention to Motion Coordination [J].
Ding, Pengxiang ;
Yin, Jianqin .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (09) :5846-5858
[8]  
Dupont E, 2021, Arxiv, DOI arXiv:2103.03123
[9]   Perceptually Guided Fast Compression of 3-D Motion Capture Data [J].
Firouzmanesh, A. ;
Cheng, I. ;
Basu, A. .
IEEE TRANSACTIONS ON MULTIMEDIA, 2011, 13 (04) :829-+
[10]   Constrained Probabilistic Movement Primitives for Robot Trajectory Adaptation [J].
Frank, Felix ;
Paraschos, Alexandros ;
van der Smagt, Patrick ;
Cseke, Botond .
IEEE TRANSACTIONS ON ROBOTICS, 2022, 38 (04) :2276-2294