3D mesh pose transfer based on skeletal deformation

被引:2
作者
Yang, Shigeng [1 ]
Yin, Mengxiao [1 ,2 ,4 ]
Li, Ming [1 ]
Li, Guiqing [3 ]
Chang, Kan [1 ,2 ]
Yang, Feng [1 ,2 ]
机构
[1] Guangxi Univ, Sch Comp Elect & Informat, Nanning, Guangxi, Peoples R China
[2] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Nanning, Guangxi, Peoples R China
[3] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[4] Guangxi Univ, Sch Comp Elect & Informat, Nanning 530004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; pose transfer; skeleton extraction; skinning deformation;
D O I
10.1002/cav.2156
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
For 3D mesh pose transfer, the target model is obtained by transferring the pose of the reference mesh to the source mesh, where the shape and pose of the source are usually different from that of the reference. In this paper, pose transfer is considered as a deformation process of the source mesh, and we propose a 3D mesh pose transfer method based on skeletal deformation. First, we design a neural network based on the edge convolution operator to extract the skeleton of the 3D mesh and bind the rigid weights; then, we calculate the bone transformations between the two skeletons with different poses and use the diffusion equation to smooth the rigid weights; finally, the source mesh is deformed according to the bone transformations and the smooth weights to get the target mesh. Experiment results on different datasets show that the pose of the reference mesh can be effectively transferred to the source one while maintaining the shape and high-quality geometric details of the source mesh by using our method.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Edge Computing-based 3D Pose Estimation and Calibration for Robot Arms
    Ma, Qun
    Niu, Jianwei
    Ouyang, Zhenchao
    Li, Mo
    Ren, Tao
    Li, QingFeng
    2020 7TH IEEE INTERNATIONAL CONFERENCE ON CYBER SECURITY AND CLOUD COMPUTING (CSCLOUD 2020)/2020 6TH IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING AND SCALABLE CLOUD (EDGECOM 2020), 2020, : 246 - 251
  • [32] Transformer-based 3D Human pose estimation and action achievement evaluation
    Yang, Aolei
    Zhou, Yinghong
    Yang, Banghua
    Xu, Yulin
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2024, 45 (04): : 136 - 144
  • [33] 3D Pose Estimation of Robot Arm with RGB Images Based on Deep Learning
    Zhou, Fan
    Chi, Zijing
    Zhuang, Chungang
    Ding, Han
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT IV, 2019, 11743 : 541 - 553
  • [34] Consensus-Based Optimization for 3D Human Pose Estimation in Camera Coordinates
    Diogo C. Luvizon
    David Picard
    Hedi Tabia
    International Journal of Computer Vision, 2022, 130 : 869 - 882
  • [35] Monocular 3D hand pose estimation based on high-resolution network
    Shengling Li
    Wanjuan Su
    Guansheng Luo
    Jinshan Tian
    Yifei Han
    Liman Liu
    Wenbing Tao
    Advances in Continuous and Discrete Models, 2025 (1):
  • [36] Real-Time 3D Hand Pose Estimation with 3D Convolutional Neural Networks
    Ge, Liuhao
    Liang, Hui
    Yuan, Junsong
    Thalmann, Daniel
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (04) : 956 - 970
  • [37] SMS3D: 3D Synthetic Mushroom Scenes Dataset for 3D Object Detection and Pose Estimation
    Zakeri, Abdollah
    Koirala, Bikram
    Kang, Jiming
    Balan, Venkatesh
    Zhu, Weihang
    Benhaddou, Driss
    Merchant, Fatima A.
    COMPUTERS, 2025, 14 (04)
  • [38] Deep 3D Pose Dictionary: 3D Human Pose Estimation from Single RGB Image Using Deep Convolutional Neural Network
    Elbasiony, Reda
    Gomaa, Walid
    Ogata, Tetsuya
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT III, 2018, 11141 : 310 - 320
  • [39] Deformation-Graph-Driven and Deformation Aware Spectral Pose Transfer
    Zou X.
    Li G.
    Yin M.
    Liu Y.
    Wang Y.
    Li, Guiqing (ligq@scut.edu.cn), 1600, Institute of Computing Technology (33): : 1234 - 1245
  • [40] Hypergraph Regularized Autoencoder for 3D Human Pose Recovery
    Hong, Chaoqun
    Yu, Jun
    Jane, You
    Chen, Xuhui
    COMPUTER VISION, CCCV 2015, PT I, 2015, 546 : 66 - 75