3D mesh pose transfer based on skeletal deformation

被引:2
|
作者
Yang, Shigeng [1 ]
Yin, Mengxiao [1 ,2 ,4 ]
Li, Ming [1 ]
Li, Guiqing [3 ]
Chang, Kan [1 ,2 ]
Yang, Feng [1 ,2 ]
机构
[1] Guangxi Univ, Sch Comp Elect & Informat, Nanning, Guangxi, Peoples R China
[2] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Nanning, Guangxi, Peoples R China
[3] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[4] Guangxi Univ, Sch Comp Elect & Informat, Nanning 530004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; pose transfer; skeleton extraction; skinning deformation;
D O I
10.1002/cav.2156
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
For 3D mesh pose transfer, the target model is obtained by transferring the pose of the reference mesh to the source mesh, where the shape and pose of the source are usually different from that of the reference. In this paper, pose transfer is considered as a deformation process of the source mesh, and we propose a 3D mesh pose transfer method based on skeletal deformation. First, we design a neural network based on the edge convolution operator to extract the skeleton of the 3D mesh and bind the rigid weights; then, we calculate the bone transformations between the two skeletons with different poses and use the diffusion equation to smooth the rigid weights; finally, the source mesh is deformed according to the bone transformations and the smooth weights to get the target mesh. Experiment results on different datasets show that the pose of the reference mesh can be effectively transferred to the source one while maintaining the shape and high-quality geometric details of the source mesh by using our method.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Deep 3D human pose estimation: A review
    Wang, Jinbao
    Tan, Shujie
    Zhen, Xiantong
    Xu, Shuo
    Zheng, Feng
    He, Zhenyu
    Shao, Ling
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 210
  • [22] 3D human pose estimation by depth map
    Wu, Jianzhai
    Hu, Dewen
    Xiang, Fengtao
    Yuan, Xingsheng
    Su, Jiongming
    VISUAL COMPUTER, 2020, 36 (07): : 1401 - 1410
  • [23] 3D human pose estimation by depth map
    Jianzhai Wu
    Dewen Hu
    Fengtao Xiang
    Xingsheng Yuan
    Jiongming Su
    The Visual Computer, 2020, 36 : 1401 - 1410
  • [24] Wi-Mesh: A WiFi Vision-based Approach for 3D Human Mesh Construction
    Wang, Yichao
    Ren, Yili
    Chen, Yingying
    Yang, Jie
    PROCEEDINGS OF THE TWENTIETH ACM CONFERENCE ON EMBEDDED NETWORKED SENSOR SYSTEMS, SENSYS 2022, 2022, : 362 - 376
  • [25] 3D Head Pose Estimation via Normal Maps: A Generalized Solution for Depth Image, Point Cloud, and Mesh
    Wu, Jiang
    Chen, Hua
    ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (11)
  • [26] 3D TOOTH MESH SEGMENTATION WITH SIMPLIFIED MESH CELL REPRESENTATION
    Jana, Ananya
    Subhash, Hrebesh Molly
    Metaxas, Dimitris
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [27] CVML-Pose: Convolutional VAE Based Multi-Level Network for Object 3D Pose Estimation
    Zhao, Jianyu
    Sanderson, Edward
    Matuszewski, Bogdan J. J.
    IEEE ACCESS, 2023, 11 : 13830 - 13845
  • [28] Monocular 3D hand pose estimation based on high-resolution network
    Shengling Li
    Wanjuan Su
    Guansheng Luo
    Jinshan Tian
    Yifei Han
    Liman Liu
    Wenbing Tao
    Advances in Continuous and Discrete Models, 2025 (1):
  • [29] Consensus-Based Optimization for 3D Human Pose Estimation in Camera Coordinates
    Luvizon, Diogo C.
    Picard, David
    Tabia, Hedi
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (03) : 869 - 882
  • [30] Hypergraph regularized autoencoder for image-based 3D human pose recovery
    Hong, Chaoqun
    Chen, Xuhui
    Wang, Xiaodong
    Tang, Chaohui
    SIGNAL PROCESSING, 2016, 124 : 132 - 140