Lightweight Explicit 3D Human Digitization via Normal Integration

被引:0
|
作者
Liu, Jiaxuan [1 ,2 ]
Wu, Jingyi [1 ]
Jing, Ruiyang [1 ]
Yu, Han [1 ]
Liu, Jing [1 ]
Song, Liang [1 ,2 ]
机构
[1] Fudan Univ, Acad Engn & Technol, Shanghai 200433, Peoples R China
[2] Innovat Platform Academicians Hainan Prov, Haikou 570228, Peoples R China
关键词
three-dimensional human reconstruction; normal map estimation; a skinned multi-person linear model; deep learning; MODEL;
D O I
10.3390/s25051513
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In recent years, generating 3D human models from images has gained significant attention in 3D human reconstruction. However, deploying large neural network models in practical applications remains challenging, particularly on resource-constrained edge devices. This problem is primarily because large neural network models require significantly higher computational power, which imposes greater demands on hardware capabilities and inference time. To address this issue, we can optimize the network architecture to reduce the number of model parameters, thereby alleviating the heavy reliance on hardware resources. We propose a lightweight and efficient 3D human reconstruction model that balances reconstruction accuracy and computational cost. Specifically, our model integrates Dilated Convolutions and the Cross-Covariance Attention mechanism into its architecture to construct a lightweight generative network. This design effectively captures multi-scale information while significantly reducing model complexity. Additionally, we introduce an innovative loss function tailored to the geometric properties of normal maps. This loss function provides a more accurate measure of surface reconstruction quality and enhances the overall reconstruction performance. Experimental results show that, compared with existing methods, our approach reduces the number of training parameters by approximately 80% while maintaining the generated model's quality.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Design of 3d clothing digitization system based on distributed data and image recognition algorithm
    Jin, Yu
    Lu, Zhenbang
    Yi, Zhiwei
    SOFT COMPUTING, 2023,
  • [22] Point-Sim: A Lightweight Network for 3D Point Cloud Classification
    Guo, Jiachen
    Luo, Wenjie
    ALGORITHMS, 2024, 17 (04)
  • [23] GSNet: Generating 3D garment animation via graph skinning network
    Peng, Tao
    Kuang, Jiewen
    Liang, Jinxing
    Hu, Xinrong
    Miao, Jiazhe
    Zhu, Ping
    Li, Lijiun
    Yu, Feng
    Jiang, Minghua
    GRAPHICAL MODELS, 2023, 129
  • [24] Packet routing in 3D nanonetworks: A lightweight, linear-path scheme
    Tsioliaridou, A.
    Liaskos, C.
    Dedu, E.
    Ioannidis, S.
    NANO COMMUNICATION NETWORKS, 2017, 12 : 63 - 71
  • [25] Recovering 3D Human Mesh From Monocular Images: A Survey
    Tian, Yating
    Zhang, Hongwen
    Liu, Yebin
    Wang, Limin
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 15406 - 15425
  • [26] Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenes
    Wang, Jiashun
    Xu, Huazhe
    Xu, Jingwei
    Liu, Sifei
    Wang, Xiaolong
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9396 - 9406
  • [27] Enhanced Myogenic Differentiation of Human Adipose-Derived Stem Cells via Integration of 3D Bioprinting and In Situ Shear-Based Blade Coating
    Kim, WonJin
    Hwangbo, Hanjun
    Heo, GaEun
    Ryu, Dongryeol
    Kim, GeunHyung
    ADVANCED FUNCTIONAL MATERIALS, 2025, 35 (01)
  • [28] 3D CNN for Human Action Recognition
    Boualia, Sameh Neili
    Ben Amara, Najoua Essoukri
    2021 18TH INTERNATIONAL MULTI-CONFERENCE ON SYSTEMS, SIGNALS & DEVICES (SSD), 2021, : 276 - 282
  • [29] 3D human motion prediction: A survey
    Lyu, Kedi
    Chen, Haipeng
    Liu, Zhenguang
    Zhang, Beiqi
    Wang, Ruili
    NEUROCOMPUTING, 2022, 489 (345-365) : 345 - 365
  • [30] The Indiana University-Uffizi project Metrological challenges and workflow for massive 3D digitization of sculptures
    Guidi, Gabriele
    Malik, Umair Shafqat
    Frischer, Bernard
    Barandoni, Cristiana
    Paolucci, Fabrizio
    PROCEEDINGS OF THE 2017 23RD INTERNATIONAL CONFERENCE ON VIRTUAL SYSTEM AND MULTIMEDIA (VSMM), 2017, : 165 - 172