Lightweight Explicit 3D Human Digitization via Normal Integration

被引:0
|
作者
Liu, Jiaxuan [1 ,2 ]
Wu, Jingyi [1 ]
Jing, Ruiyang [1 ]
Yu, Han [1 ]
Liu, Jing [1 ]
Song, Liang [1 ,2 ]
机构
[1] Fudan Univ, Acad Engn & Technol, Shanghai 200433, Peoples R China
[2] Innovat Platform Academicians Hainan Prov, Haikou 570228, Peoples R China
关键词
three-dimensional human reconstruction; normal map estimation; a skinned multi-person linear model; deep learning; MODEL;
D O I
10.3390/s25051513
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In recent years, generating 3D human models from images has gained significant attention in 3D human reconstruction. However, deploying large neural network models in practical applications remains challenging, particularly on resource-constrained edge devices. This problem is primarily because large neural network models require significantly higher computational power, which imposes greater demands on hardware capabilities and inference time. To address this issue, we can optimize the network architecture to reduce the number of model parameters, thereby alleviating the heavy reliance on hardware resources. We propose a lightweight and efficient 3D human reconstruction model that balances reconstruction accuracy and computational cost. Specifically, our model integrates Dilated Convolutions and the Cross-Covariance Attention mechanism into its architecture to construct a lightweight generative network. This design effectively captures multi-scale information while significantly reducing model complexity. Additionally, we introduce an innovative loss function tailored to the geometric properties of normal maps. This loss function provides a more accurate measure of surface reconstruction quality and enhances the overall reconstruction performance. Experimental results show that, compared with existing methods, our approach reduces the number of training parameters by approximately 80% while maintaining the generated model's quality.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] 3D average human corneal models
    Laliberté, JF
    Brunette, I
    Meunier, J
    PROCEEDINGS OF THE 26TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-7, 2004, 26 : 1573 - 1576
  • [32] Early Recognition of 3D Human Actions
    Li, Sheng
    Li, Kang
    Fu, Yun
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2018, 14 (01)
  • [33] 3D Mitral Valve Surface Reconstruction from 3D TEE via Graph Neural Networks
    Ivantsits, Matthias
    Pfahringer, Boris
    Huellebrand, Markus
    Walczak, Lars
    Tautz, Lennart
    Nemchyna, Olena
    Akansel, Serdar
    Kempfert, Joerg
    Suendermann, Simon
    Hennemuth, Anja
    STATISTICAL ATLASES AND COMPUTATIONAL MODELS OF THE HEART: REGULAR AND CMRXMOTION CHALLENGE PAPERS, STACOM 2022, 2022, 13593 : 330 - 339
  • [34] STEP RING BASED 3D PATH PLANNING VIA GPU SIMULATION FOR SUBTRACTIVE 3D PRINTING
    Wu, Zhengkai
    Tucker, Thomas M.
    Nath, Chandra
    Kurfess, Thomas R.
    Vuduc, Richard W.
    PROCEEDINGS OF THE ASME 11TH INTERNATIONAL MANUFACTURING SCIENCE AND ENGINEERING CONFERENCE, 2016, VOL 2, 2016,
  • [35] Manipulating a Whip in 3D via Dynamic Primitives
    Nah, Moses C.
    Krotov, Aleksei
    Russo, Marta
    Sternad, Dagmar
    Hogan, Neville
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 2803 - 2808
  • [36] A LIGHTWEIGHT NETWORK WITH MULTI-STAGE FEATURE FUSION MODULE FOR SINGLE-VIEW 3D FACE RECONSTRUCTION
    Wang, Jing
    Zhang, Shikun
    Song, Fengyi
    Song, Ge
    Yang, Ming
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1801 - 1805
  • [37] Explicit Incorporation of Spatial Autocorrelation in 3D Deep Learning for Geospatial Object Detection
    Chen, Tianyang
    Tang, Wenwu
    Allan, Craig
    Chen, Shen-En
    ANNALS OF THE AMERICAN ASSOCIATION OF GEOGRAPHERS, 2024, 114 (10) : 2297 - 2316
  • [38] Lightweight brain MR image super-resolution using 3D convolution
    Kim, Young Beom
    Van Le, The
    Lee, Jin Young
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) : 8785 - 8795
  • [39] Lightweight 3D Dense Autoencoder Network for Hyperspectral Remote Sensing Image Classification
    Bai, Yang
    Sun, Xiyan
    Ji, Yuanfa
    Fu, Wentao
    Duan, Xiaoyu
    SENSORS, 2023, 23 (20)
  • [40] Lightweight brain MR image super-resolution using 3D convolution
    Young Beom Kim
    The Van Le
    Jin Young Lee
    Multimedia Tools and Applications, 2024, 83 : 8785 - 8795