Lightweight Explicit 3D Human Digitization via Normal Integration

被引:0
|
作者
Liu, Jiaxuan [1 ,2 ]
Wu, Jingyi [1 ]
Jing, Ruiyang [1 ]
Yu, Han [1 ]
Liu, Jing [1 ]
Song, Liang [1 ,2 ]
机构
[1] Fudan Univ, Acad Engn & Technol, Shanghai 200433, Peoples R China
[2] Innovat Platform Academicians Hainan Prov, Haikou 570228, Peoples R China
关键词
three-dimensional human reconstruction; normal map estimation; a skinned multi-person linear model; deep learning; MODEL;
D O I
10.3390/s25051513
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In recent years, generating 3D human models from images has gained significant attention in 3D human reconstruction. However, deploying large neural network models in practical applications remains challenging, particularly on resource-constrained edge devices. This problem is primarily because large neural network models require significantly higher computational power, which imposes greater demands on hardware capabilities and inference time. To address this issue, we can optimize the network architecture to reduce the number of model parameters, thereby alleviating the heavy reliance on hardware resources. We propose a lightweight and efficient 3D human reconstruction model that balances reconstruction accuracy and computational cost. Specifically, our model integrates Dilated Convolutions and the Cross-Covariance Attention mechanism into its architecture to construct a lightweight generative network. This design effectively captures multi-scale information while significantly reducing model complexity. Additionally, we introduce an innovative loss function tailored to the geometric properties of normal maps. This loss function provides a more accurate measure of surface reconstruction quality and enhances the overall reconstruction performance. Experimental results show that, compared with existing methods, our approach reduces the number of training parameters by approximately 80% while maintaining the generated model's quality.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] Integration of the 3D Environment for UAV Onboard Visual Object Tracking
    Vujasinovic, Stephane
    Becker, Stefan
    Breuer, Timo
    Bullinger, Sebastian
    Scherer-Negenborn, Norbert
    Arens, Michael
    APPLIED SCIENCES-BASEL, 2020, 10 (21): : 1 - 22
  • [42] Investigating 3D holoscopic visual content upsampling using super-resolution for cultural heritage digitization
    Belhi, Abdelhak
    Bouras, Abdelaziz
    Alfaqheri, Taha
    Aondoakaa, Akuha Solomon
    Sadka, Abdul Hamid
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 75 : 188 - 198
  • [43] Workflow for 3D digitization using photogrammetry of polychrome wood carvings of the Holy Christ of Blood and his angel
    Melendreras Ruiz, Rafael
    Marin Torres, Maria Teresa
    Sanchez Allegue, Paloma
    E-RPH-REVISTA ELECTRONICA DE PATRIMONIO HISTORICO, 2020, (27): : 52 - 83
  • [44] 3D Head Pose Estimation via Normal Maps: A Generalized Solution for Depth Image, Point Cloud, and Mesh
    Wu, Jiang
    Chen, Hua
    ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (11)
  • [45] Improvement of PM2.5 and O3 forecasting by integration of 3D numerical simulation with deep learning techniques
    Sun, Haochen
    Fung, Jimmy C. H.
    Chen, Yiang
    Chen, Wanying
    Li, Zhenning
    Huang, Yeqi
    Lin, Changqing
    Hu, Mingyun
    Lu, Xingcheng
    SUSTAINABLE CITIES AND SOCIETY, 2021, 75
  • [46] 3D Object Detection with Normal-map on Point Clouds
    Miao, Jishu
    Hirakawa, Tsubasa
    Yamashita, Takayoshi
    Fujiyoshi, Hironobu
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 569 - 576
  • [47] Deep 3D human pose estimation: A review
    Wang, Jinbao
    Tan, Shujie
    Zhen, Xiantong
    Xu, Shuo
    Zheng, Feng
    He, Zhenyu
    Shao, Ling
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 210
  • [48] Estimating 3D human shapes from measurements
    Wuhrer, Stefanie
    Shu, Chang
    MACHINE VISION AND APPLICATIONS, 2013, 24 (06) : 1133 - 1147
  • [49] Simulation of Effects of Ischemia in 3D Human Ventricle
    Lu, W. G.
    Wang, K. Q.
    Zuo, W. M.
    Liu, T. J.
    Zhang, H. G.
    CINC: 2009 36TH ANNUAL COMPUTERS IN CARDIOLOGY CONFERENCE, 2009, 36 : 477 - +
  • [50] 3D human pose estimation by depth map
    Jianzhai Wu
    Dewen Hu
    Fengtao Xiang
    Xingsheng Yuan
    Jiongming Su
    The Visual Computer, 2020, 36 : 1401 - 1410