Scaling up SoccerNet with multi-view spatial localization and re-identification

被引:32
作者
Cioppa, Anthony [1 ]
Deliege, Adrien [1 ]
Giancola, Silvio [2 ]
Ghanem, Bernard [2 ]
Van Droogenbroeck, Marc [1 ]
机构
[1] Univ Liege, Inst Montefiore, Quartier Polytech 1, Allee Decouverte 1, B-4000 Liege, Belgium
[2] King Abdullah Univ Sci & Technol, Image & Video Understanding Lab, Thuwal 23955, Saudi Arabia
关键词
D O I
10.1038/s41597-022-01469-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Soccer videos are a rich playground for computer vision, involving many elements, such as players, lines, and specific objects. Hence, to capture the richness of this sport and allow for fine automated analyses, we release SoccerNet-v3, a major extension of the SoccerNet dataset, providing a wide variety of spatial annotations and cross-view correspondences. SoccerNet's broadcast videos contain replays of important actions, allowing us to retrieve a same action from different viewpoints. We annotate those live and replay action frames showing same moments with exhaustive local information. Specifically, we label lines, goal parts, players, referees, teams, salient objects, jersey numbers, and we establish player correspondences between the views. This yields 1,324,732 annotations on 33,986 soccer images, making SoccerNet-v3 the largest dataset for multi-view soccer analysis. Derived tasks may benefit from these annotations, like camera calibration, player localization, team discrimination and multi-view re-identification, which can further sustain practical applications in augmented reality and soccer analytics. Finally, we provide Python codes to easily download our data and access our annotations.
引用
收藏
页数:9
相关论文
共 40 条
[1]   Soccer Video Summarization using Deep Learning [J].
Agyeman, Rockson ;
Muhammad, Rafiq ;
Choi, Gyu Sang .
2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, :270-273
[2]  
Arbues Sanguesa A., 2020, IEEE INT C COMPUT VI, P3875, DOI [10.1109/CVPRW50498.2020.00451, DOI 10.1109/CVPRW50498.2020.00451]
[3]  
Biermann H., 2021, PREPRINT, DOI [10.48550/arXiv.2108.11149, DOI 10.48550/ARXIV.2108.11149]
[4]   ARTHuS: Adaptive Real-Time Human Segmentation in Sports through Online Distillation [J].
Cioppa, A. ;
Deliege, A. ;
Istasse, M. ;
De Vleeschouwer, C. ;
Van Droogenbroeck, M. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :2505-2514
[5]   A bottom-up approach based on semantics for the interpretation of the main camera stream in soccer games [J].
Cioppa, A. ;
Deliege, A. ;
Van Droogenbroeck, M. .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :1846-1855
[6]  
Cioppa A., 2022, SOCCERNET V3 SCALING, DOI [10.6084/m9.figshare.c.5668645, DOI 10.6084/M9.FIGSHARE.C.5668645]
[7]   Camera Calibration and Player Localization in SoccerNet-v2 and Investigation of their Representations for Action Spotting [J].
Cioppa, Anthony ;
Deliege, Adrien ;
Magera, Floriane ;
Giancola, Silvio ;
Barnich, Olivier ;
Ghanem, Bernard ;
Van Droogenbroeck, Marc .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :4532-4541
[8]   A Context-Aware Loss Function for Action Spotting in Soccer Videos [J].
Cioppa, Anthony ;
Deliege, Adrien ;
Giancola, Silvio ;
Ghanem, Bernard ;
Van Droogenbroeck, Marc ;
Gade, Rikke ;
Moeslund, Thomas B. .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :13123-13133
[9]   Multimodal and multiview distillation for real-time player detection on a football field [J].
Cioppa, Anthony ;
Deliege, Adrien ;
Ul Huda, Noor ;
Gade, Rikke ;
Van Droogenbroeck, Marc ;
Moeslund, Thomas B. .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :3837-3846
[10]   Actions Speak Louder than Goals: Valuing Player Actions in Soccer [J].
Decroos, Tom ;
Bransen, Lotte ;
Van Haaren, Jan ;
Davis, Jesse .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :1851-1861