Lightweight Explicit 3D Human Digitization via Normal Integration

被引:0
|
作者
Liu, Jiaxuan [1 ,2 ]
Wu, Jingyi [1 ]
Jing, Ruiyang [1 ]
Yu, Han [1 ]
Liu, Jing [1 ]
Song, Liang [1 ,2 ]
机构
[1] Fudan Univ, Acad Engn & Technol, Shanghai 200433, Peoples R China
[2] Innovat Platform Academicians Hainan Prov, Haikou 570228, Peoples R China
关键词
three-dimensional human reconstruction; normal map estimation; a skinned multi-person linear model; deep learning; MODEL;
D O I
10.3390/s25051513
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In recent years, generating 3D human models from images has gained significant attention in 3D human reconstruction. However, deploying large neural network models in practical applications remains challenging, particularly on resource-constrained edge devices. This problem is primarily because large neural network models require significantly higher computational power, which imposes greater demands on hardware capabilities and inference time. To address this issue, we can optimize the network architecture to reduce the number of model parameters, thereby alleviating the heavy reliance on hardware resources. We propose a lightweight and efficient 3D human reconstruction model that balances reconstruction accuracy and computational cost. Specifically, our model integrates Dilated Convolutions and the Cross-Covariance Attention mechanism into its architecture to construct a lightweight generative network. This design effectively captures multi-scale information while significantly reducing model complexity. Additionally, we introduce an innovative loss function tailored to the geometric properties of normal maps. This loss function provides a more accurate measure of surface reconstruction quality and enhances the overall reconstruction performance. Experimental results show that, compared with existing methods, our approach reduces the number of training parameters by approximately 80% while maintaining the generated model's quality.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Monocular 3D Head Reconstruction via Prediction and Integration of Normal Vector Field
    Bouafif, Oussema
    Khomutenko, Bogdan
    Daoudi, Mohamed
    PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 5: VISAPP, 2020, : 359 - 369
  • [2] 3D Human Avatar Digitization from a Single Image
    Li, Zhong
    Chen, Lele
    Liu, Celong
    Gao, Yu
    Ha, Yuanzhou
    Xu, Chenliang
    Quan, Shuxue
    Xu, Yi
    17TH ACM SIGGRAPH INTERNATIONAL CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY (VRCAI 2019), 2019,
  • [3] Lightweight integration of 3D features to improve 2D image segmentation
    Pradelle, Olivier
    Chaine, Raphaelle
    Wendland, David
    Digne, Julie
    COMPUTERS & GRAPHICS-UK, 2023, 114 : 326 - 336
  • [4] ECON: Explicit Clothed humans Optimized via Normal integration
    Xiu, Yuliang
    Yang, Jinlong
    Cao, Xu
    Tzionas, Dimitrios
    Black, Michael J.
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 512 - 523
  • [5] 3D LVCN: A Lightweight Volumetric ConvNet
    Lu, Xiaoyun
    Zhou, Chunjie
    Liu, Shengjie
    Li, Jialong
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2025, 37 (01)
  • [6] Role of Through Silicon Via in 3D Integration: Impact on Delay and Power
    Chandrakar, Shivangi
    Gupta, Deepika
    Majumder, Manoj Kumar
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2021, 30 (03)
  • [7] Lightweight 3D Point Cloud Classification Network
    Xin, Zihao
    Wang, Hongyuan
    Zhang, Ji
    ARTIFICIAL INTELLIGENCE AND ROBOTICS, ISAIR 2022, PT II, 2022, 1701 : 95 - 105
  • [8] Lightweight 3D cellular composites inspired by balsa
    Malek, Sardar
    Raney, Jordan R.
    Lewis, Jennifer A.
    Gibson, Lorna J.
    BIOINSPIRATION & BIOMIMETICS, 2017, 12 (02)
  • [9] 3D Medical Axial Transformer: A Lightweight Transformer Model for 3D Brain Tumor Segmentation
    Liu, Cheng
    Kiryu, Hisanori
    MEDICAL IMAGING WITH DEEP LEARNING, VOL 227, 2023, 227 : 799 - 813
  • [10] Overview of 3D Human Pose Estimation
    Lin, Jianchu
    Li, Shuang
    Qin, Hong
    Wang, Hongchang
    Cui, Ning
    Jiang, Qian
    Jian, Haifang
    Wang, Gongming
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 134 (03): : 1621 - 1651