Unsupervised continuous camera network pose estimation through human mesh recovery

被引:1
作者
Garau, Nicola [1 ]
Conci, Nicola [1 ]
机构
[1] Univ Trento, Trento, Italy
来源
ICDSC 2019: 13TH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS | 2019年
关键词
pose estimation; camera calibration; skeleton matching; depth estimation; CALIBRATION;
D O I
10.1145/3349801.3349803
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Camera resectioning is essential in computer vision and 3D reconstruction to estimate the position of matching pinhole cameras in 3D worlds. While the internal camera parameters are usually known or can be easily computed offline, in camera networks extrinsic parameters need to be computed each time a camera changes position, thus not allowing for smooth and dynamic network reconfiguration. In this work we propose a fully markerless, unsupervised, and automatic tool for the estimation of the extrinsic parameters of a camera network, based on 3D human mesh recovery from RGB videos. We show how it is possible to retrieve, from monocular images and with just a weak prior knowledge of the intrinsic parameters, the real-world position of the cameras in the network, together with the floor plane. Our solution also works with a single RGB camera and allows the user to dynamically add, re-position, or remove cameras from the network.
引用
收藏
页数:6
相关论文
共 24 条
[1]   OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields [J].
Cao, Zhe ;
Hidalgo, Gines ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) :172-186
[2]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[3]  
Coughlan JM, 2001, ADV NEUR IN, V13, P845
[4]   Skeleton-based Continuous Extrinsic Calibration of Multiple RGB-D Kinect Cameras [J].
Desai, Kevin ;
Prabhakaran, Balakrishnan ;
Raghuraman, Suraj .
PROCEEDINGS OF THE 9TH ACM MULTIMEDIA SYSTEMS CONFERENCE (MMSYS'18), 2018, :250-257
[5]   Simultaneous localization and mapping: Part I [J].
Durrant-Whyte, Hugh ;
Bailey, Tim .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2006, 13 (02) :99-108
[6]   A Perceptual Measure for Deep Single Image Camera Calibration [J].
Hold-Geoffroy, Yannick ;
Sunkavalli, Kalyan ;
Eisenmann, Jonathan ;
Fisher, Matt ;
Gambaretto, Emiliano ;
Hadap, Sunil ;
Lalonde, Jean-Francois .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2354-2363
[7]  
Inomata Ryo, 2011, Advances in Visual Computing. Proceedings 7th International Symposium, ISVC 2011, P325
[8]   Panoptic Studio: A Massively Multiview System for Social Motion Capture [J].
Joo, Hanbyul ;
Liu, Hao ;
Tan, Lei ;
Gui, Lin ;
Nabbe, Bart ;
Matthews, Iain ;
Kanade, Takeo ;
Nobuhara, Shohei ;
Sheikh, Yaser .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :3334-3342
[9]   End-to-end Recovery of Human Shape and Pose [J].
Kanazawa, Angjoo ;
Black, Michael J. ;
Jacobs, David W. ;
Malik, Jitendra .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7122-7131
[10]   SMPL: A Skinned Multi-Person Linear Model [J].
Loper, Matthew ;
Mahmood, Naureen ;
Romero, Javier ;
Pons-Moll, Gerard ;
Black, Michael J. .
ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (06)