Real-time camera pose estimation for sports fields

被引:33
作者
Citraro, Leonardo [1 ]
Marquez-Neila, Pablo [2 ]
Savare, Stefano [1 ]
Jayaram, Vivek [3 ]
Dubout, Charles [3 ]
Renaut, Felix [3 ]
Hasfura, Andres [3 ]
Ben Shitrit, Horesh [3 ]
Fua, Pascal [1 ]
机构
[1] Ecole Polytech Fed Lausanne, Comp Vis Lab, Lausanne, Switzerland
[2] Univ Bern, ARTORG Ctr Comp Aided Surg, Bern, Switzerland
[3] Second Spectrum Inc, Los Angeles, CA USA
关键词
Camera Pose Estimation; Camera Registration; Keypoints detection; Augmented Reality; Sport;
D O I
10.1007/s00138-020-01064-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Given an image sequence featuring a portion of a sports field filmed by a moving and uncalibrated camera, such as the one of the smartphones, our goal is to compute automatically in real time the focal length and extrinsic camera parameters for each image in the sequence without using a priori knowledges of the position and orientation of the camera.To this end, we propose a novel framework that combines accurate localization and robust identification of specific keypoints in the image by using a fully convolutional deep architecture.Our algorithm exploits both the field lines and the players' image locations, assuming their ground plane positions to be given, to achieve accuracy and robustness that is beyond the current state of the art.We will demonstrate its effectiveness on challenging soccer, basketball, and volleyball benchmark datasets.
引用
收藏
页数:13
相关论文
共 25 条
[1]  
Alvarez L, 2014, IEEE IMAGE PROC, P4842, DOI 10.1109/ICIP.2014.7025981
[2]  
[Anonymous], MULTIPLE VIEW GEOMET
[3]  
[Anonymous], 2 SPECTRUM
[4]  
Ba J., 2015, INT C LEARNING REPRE
[5]   SURF: Speeded up robust features [J].
Bay, Herbert ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2006 , PT 1, PROCEEDINGS, 2006, 3951 :404-417
[6]   BRIEF: Binary Robust Independent Elementary Features [J].
Calonder, Michael ;
Lepetit, Vincent ;
Strecha, Christoph ;
Fua, Pascal .
COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 :778-792
[7]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[8]   A Two-point Method for PTZ Camera Calibration in Sports [J].
Chen, Jianhui ;
Zhu, Fangrui ;
Little, James J. .
2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :287-295
[9]  
Chen Jianhui, 2019, C COMP VIS PATT REC
[10]   SoftPOSIT: Simultaneous pose and correspondence determination [J].
David, P ;
Dementhon, D ;
Duraiswami, R ;
Samet, H .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 59 (03) :259-284