3D mesh pose transfer based on skeletal deformation

被引:2
|
作者
Yang, Shigeng [1 ]
Yin, Mengxiao [1 ,2 ,4 ]
Li, Ming [1 ]
Li, Guiqing [3 ]
Chang, Kan [1 ,2 ]
Yang, Feng [1 ,2 ]
机构
[1] Guangxi Univ, Sch Comp Elect & Informat, Nanning, Guangxi, Peoples R China
[2] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Nanning, Guangxi, Peoples R China
[3] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[4] Guangxi Univ, Sch Comp Elect & Informat, Nanning 530004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; pose transfer; skeleton extraction; skinning deformation;
D O I
10.1002/cav.2156
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
For 3D mesh pose transfer, the target model is obtained by transferring the pose of the reference mesh to the source mesh, where the shape and pose of the source are usually different from that of the reference. In this paper, pose transfer is considered as a deformation process of the source mesh, and we propose a 3D mesh pose transfer method based on skeletal deformation. First, we design a neural network based on the edge convolution operator to extract the skeleton of the 3D mesh and bind the rigid weights; then, we calculate the bone transformations between the two skeletons with different poses and use the diffusion equation to smooth the rigid weights; finally, the source mesh is deformed according to the bone transformations and the smooth weights to get the target mesh. Experiment results on different datasets show that the pose of the reference mesh can be effectively transferred to the source one while maintaining the shape and high-quality geometric details of the source mesh by using our method.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Deep learning for 3D human pose estimation and mesh recovery: A survey
    Liu, Yang
    Qiu, Changzhen
    Zhang, Zhiyong
    NEUROCOMPUTING, 2024, 596
  • [2] Point-Cloud Self-Adaptive Pose Transfer Based on Skinning Deformation
    Li M.
    Yin M.
    Li G.
    Zhao M.
    Yang F.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (11): : 1673 - 1683
  • [3] Enhanced real-time motion transfer to 3D avatars using RGB-based human 3D pose estimation
    Poulios, Ilias
    Pistola, Theodora
    Symeonidis, Spyridon
    Diplaris, Sotiris
    Ioannidis, Konstantinos
    Vrochidis, Stefanos
    Kompatsiaris, Ioannis
    PROCEEDINGS OF THE 2024 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE MEDIA EXPERIENCES WORKSHOPS, IMXW 2024, 2024, : 88 - 99
  • [4] 2D-3D pose consistency-based conditional random fields for 3D human pose estimation
    Chang, Ju Yong
    Lee, Kyoung Mu
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2018, 169 : 52 - 61
  • [5] Face 2D to 3D Reconstruction Network Based on Head Pose and 3D Facial Landmarks
    Xu, Yuanquan
    Jung, Cheolkon
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [6] POSE GUIDED PERSON IMAGE GENERATION BASED ON POSE SKELETON SEQUENCE AND 3D CONVOLUTION
    Zhao, Wenbin
    Xie, Qing
    Ma, Yanchun
    Liu, Yongjian
    Xiong, Shengwu
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1561 - 1565
  • [7] 3D mesh model segmentation based on skeleton extraction
    Han, Huiyan
    Han, Xie
    Gao, Tianyi
    IMAGING SCIENCE JOURNAL, 2021, 69 (1-4): : 153 - 163
  • [8] 3D Mesh Skeleton Extraction Based on Feature Points
    Gong, Faming
    Kang, Cui
    2009 INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND TECHNOLOGY, VOL I, PROCEEDINGS, 2009, : 326 - 329
  • [9] Video-Based 3D pose estimation for residential roofing
    Wang, Ruochen
    Zheng, Liying
    Hawke, Ashley L.
    Carey, Robert E.
    Breloff, Scott P.
    Li, Kang
    Peng, Xi
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2023, 11 (03): : 369 - 377
  • [10] 3D Human Pose Estimation Based on Volumetric Joint Coordinates
    Wan Y.
    Song Y.
    Liu L.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (09): : 1411 - 1419