4DHumanOutfit: A multi-subject 4D dataset of human motion sequences in varying outfits exhibiting large displacements

被引:6
作者
Armando, Matthieu [1 ]
Boissieux, Laurence [2 ]
Boyer, Edmond [2 ]
Franco, Jean-Sebastien [2 ]
Humenberger, Martin [1 ]
Legras, Christophe [1 ]
Leroy, Vincent [1 ]
Marsot, Mathieu [2 ]
Pansiot, Julien [2 ]
Pujades, Sergi [2 ]
Rekik, Rim [2 ]
Rogez, Gregory [1 ]
Swamy, Anilkumar [1 ,2 ]
Wuhrer, Stefanie [2 ]
机构
[1] NAVER LABS Europe, Meylan, France
[2] Univ Grenoble Alpes, Inria Ctr, Grenoble, France
关键词
Digital human modeling; Multi-view reconstruction; Human motion database;
D O I
10.1016/j.cviu.2023.103836
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a new dataset of densely sampled spatio-temporal 4D human motion data of different actors, outfits and motions. The dataset contains different actors wearing different outfits while performing different motions in each outfit. It samples the space of 4D human motion along 3 axes with identity, outfit and motion, therefore providing a cube of data where each identity is represented by a planar slice of the cube with all outfits and for all motions. The dataset has numerous potential applications for the processing and creation of digital humans including augmented reality, avatar creation and virtual try on. 4DHumanOutfit is released for research purposes at https://kinovis.inria.fr/4dhumanoutfit/. In addition to image data and 4D reconstructions, the dataset includes reference solutions for each axis. We present independent baselines along each axis that demonstrate the value of these reference solutions for evaluation tasks.
引用
收藏
页数:11
相关论文
共 70 条
[1]  
4dviews, 2023, 4DViews 4DVManager software
[2]   Video Based Reconstruction of 3D People Models [J].
Alldieck, Thiemo ;
Magnor, Marcus ;
Xu, Weipeng ;
Theobalt, Christian ;
Pons-Moll, Gerard .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8387-8397
[3]   SCAPE: Shape Completion and Animation of People [J].
Anguelov, D ;
Srinivasan, P ;
Koller, D ;
Thrun, S ;
Rodgers, J ;
Davis, J .
ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03) :408-416
[4]  
[Anonymous], 1999, C 3D DIG IM MOD
[5]  
Berndt D.J., 1994, KDD Workshop, P359
[6]   CLOTH3D: Clothed 3D Humans [J].
Bertiche, Hugo ;
Madadi, Meysam ;
Escalera, Sergio .
COMPUTER VISION - ECCV 2020, PT XX, 2020, 12365 :344-359
[7]   Dynamic FAUST: Registering Human Bodies in Motion [J].
Bogo, Federica ;
Romero, Javier ;
Pons-Moll, Gerard ;
Black, Michael J. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5573-5582
[8]   Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image [J].
Bogo, Federica ;
Kanazawa, Angjoo ;
Lassner, Christoph ;
Gehler, Peter ;
Romero, Javier ;
Black, Michael J. .
COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 :561-578
[9]   FAUST: Dataset and evaluation for 3D mesh registration [J].
Bogo, Federica ;
Romero, Javier ;
Loper, Matthew ;
Black, Michael J. .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3794-3801
[10]   HuMMan: Multi-modal 4D Human Dataset for Versatile Sensing and Modeling [J].
Cai, Zhongang ;
Ren, Daxuan ;
Zeng, Ailing ;
Lin, Zhengyu ;
Yu, Tao ;
Wang, Wenjia ;
Fan, Xiangyu ;
Gao, Yang ;
Yu, Yifan ;
Pan, Liang ;
Hong, Fangzhou ;
Zhang, Mingyuan ;
Loy, Chen Change ;
Yang, Lei ;
Liu, Ziwei .
COMPUTER VISION, ECCV 2022, PT VII, 2022, 13667 :557-577