CWIPC-SXR: Point Cloud dynamic human dataset for Social XR

被引:21
作者
Reimat, Ignacio [1 ]
Alexiou, Evangelos [1 ]
Jansen, Jack [1 ]
Viola, Irene [1 ]
Subramanyam, Shishir [1 ]
Cesar, Pablo [1 ,2 ]
机构
[1] Ctr Wiskunde & Informat CWI, Amsterdam, Netherlands
[2] Delft Univ Technol, Delft, Netherlands
来源
MMSYS '21: PROCEEDINGS OF THE 2021 MULTIMEDIA SYSTEMS CONFERENCE | 2021年
关键词
point cloud; volumetric videos; dynamic sequences; social XR;
D O I
10.1145/3458305.3478452
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Real-time, immersive telecommunication systems are quickly becoming a reality, thanks to the advances in acquisition, transmission, and rendering technologies. Point clouds in particular serve as a promising representation in these type of systems, offering photorealistic rendering capabilities with low complexity. Further development of transmission, coding, and quality evaluation algorithms, though, is currently hindered by the lack of publicly available datasets that represent realistic scenarios of remote communication between people in real-time. In this paper, we release a dynamic point cloud dataset that depicts humans interacting in social XR settings. Using commodity hardware, we capture a total of 45 unique sequences, according to several use cases for social XR. As part of our release, we provide annotated raw material, resulting point cloud sequences, and an auxiliary software toolbox to acquire, process, encode, and visualize data, suitable for real-time applications. The dataset can be accessed via the following link: https://www.dis.cwi.nl/cwipc-sxr- dataset/.
引用
收藏
页码:300 / 306
页数:7
相关论文
共 17 条
[1]   Dynamic FAUST: Registering Human Bodies in Motion [J].
Bogo, Federica ;
Romero, Javier ;
Pons-Moll, Gerard ;
Black, Michael J. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5573-5582
[2]   HUMAN4D: A Human-Centric Multimodal Dataset for Motions and Immersive Media [J].
Chatzitofis, Anargyros ;
Saroglou, Leonidas ;
Boutis, Prodromos ;
Drakoulis, Petros ;
Zioulis, Nikolaos ;
Subramanyam, Shishir ;
Kevelham, Bart ;
Charbonnier, Caecilia ;
Cesar, Pablo ;
Zarpalas, Dimitrios ;
Kollias, Stefanos ;
Daras, Petros .
IEEE ACCESS, 2020, 8 :176241-176262
[3]  
Ebner T, 2018, M42921 ISOIECJTC1SC2
[4]   Experiencing Virtual Reality Together: Social VR Use Case Study [J].
Gunkel, Simon ;
Stokking, Hans ;
Prins, Martin ;
Niamut, Omar ;
Siahaan, Ernestasia ;
Cesar, Pablo .
TVX 2018: PROCEEDINGS OF THE 2018 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE EXPERIENCES FOR TV AND ONLINE VIDEO, 2018, :233-238
[5]   Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments [J].
Ionescu, Catalin ;
Papava, Dragos ;
Olaru, Vlad ;
Sminchisescu, Cristian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (07) :1325-1339
[6]   A Pipeline for Multiparty Volumetric Video Conferencing: Transmission of Point Clouds over Low Latency DASH [J].
Jansen, Jack ;
Subramanyam, Shishir ;
Bouqueau, Romain ;
Cernigliaro, Gianluca ;
Cabre, Marc Martos ;
Perez, Fernando ;
Cesar, Pablo .
MMSYS'20: PROCEEDINGS OF THE 2020 MULTIMEDIA SYSTEMS CONFERENCE, 2020, :341-344
[7]   Panoptic Studio: A Massively Multiview System for Social Interaction Capture [J].
Joo, Hanbyul ;
Simon, Tomas ;
Li, Xulong ;
Liu, Hao ;
Tan, Lei ;
Gui, Lin ;
Banerjee, Sean ;
Godisart, Timothy ;
Nabbe, Bart ;
Matthews, Iain ;
Kanade, Takeo ;
Nobuhara, Shohei ;
Sheikh, Yaser .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (01) :190-204
[8]  
Krivokuca M., 2018, ISO/IEC JTC1/ SC29/WG11 MPEG, Input Document M42914
[9]  
LLP Perkins Coie, 2020, 4 LLP
[10]  
Loop C., 2016, ISO/IEC JTC1/SC29 Standard m38673/M72012