Soccer match broadcast video analysis method based on detection and tracking

被引:11
作者
Li, Hongyu [1 ]
Yang, Meng [1 ,2 ]
Yang, Chao [1 ]
Kang, Jianglang [1 ]
Suo, Xiang [3 ]
Meng, Weiliang [4 ,5 ]
Li, Zhen [3 ]
Mao, Lijuan [3 ]
Sheng, Bin [6 ]
Qi, Jun [7 ]
机构
[1] Beijing Forestry Univ, Sch Informat Sci & Technol, Beijing, Peoples R China
[2] Natl Forestry & Grassland Adm, Engn Res Ctr Forestry Oriented Intelligent Informa, Beijing, Peoples R China
[3] Shanghai Univ Sport, Sch Athlet Performance, Shanghai, Peoples R China
[4] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing, Peoples R China
[5] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[6] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
[7] Xian JiaoTong Liverpool Univ, Dept Comp, Suzhou, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
field localization; player tracking; soccer ball detection; video analysis; visualizations;
D O I
10.1002/cav.2259
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We propose a comprehensive soccer match video analysis pipeline tailored for broadcast footage, which encompasses three pivotal stages: soccer field localization, player tracking, and soccer ball detection. Firstly, we introduce sports camera calibration to seamlessly map soccer field images from match videos onto a standardized two-dimensional soccer field template. This addresses the challenge of consistent analysis across video frames amid continuous camera angle changes. Secondly, given challenges such as occlusions, high-speed movements, and dynamic camera perspectives, obtaining accurate position data for players and the soccer ball is non-trivial. To mitigate this, we curate a large-scale, high-precision soccer ball detection dataset and devise a robust detection model, which achieved the mAP50-95$$ mA{P}_{50-95} $$ of 80.9%. Additionally, we develop a high-speed, efficient, and lightweight tracking model to ensure precise player tracking. Through the integration of these modules, our pipeline focuses on real-time analysis of the current camera lens content during matches, facilitating rapid and accurate computation and analysis while offering intuitive visualizations.
引用
收藏
页数:17
相关论文
共 38 条
[1]  
Aharon N, 2022, Arxiv, DOI arXiv:2206.14651
[2]   Use of deep learning in soccer videos analysis: survey [J].
Akan, Sara ;
Varli, Songuel .
MULTIMEDIA SYSTEMS, 2023, 29 (03) :897-915
[3]  
Akyon FC., 2022, SLICING AIDED HYPERI
[4]  
Alvarez L., 2014, Homography estimation using one ellipse correspondence and minimal additional information. 2014 IEEE international conference on image processing (ICIP). IEEE
[5]   Lucas-Kanade 20 years on: A unifying framework [J].
Baker, S ;
Matthews, I .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 56 (03) :221-255
[6]   An Improved Faster R-CNN for Small Object Detection [J].
Cao, Changqing ;
Wang, Bo ;
Zhang, Wenrui ;
Zeng, Xiaodong ;
Yan, Xu ;
Feng, Zhejun ;
Liu, Yutao ;
Wu, Zengyan .
IEEE ACCESS, 2019, 7 :106838-106846
[7]  
Chen J., 2019, Sports camera calibration via synthetic data. 2019 IEEE/CVF conference on computer vision and pattern recognition workshops (CVPRW)
[8]   Towards Large-Scale Small Object Detection: Survey and Benchmarks [J].
Cheng, Gong ;
Yuan, Xiang ;
Yao, Xiwen ;
Yan, Kebing ;
Zeng, Qinghua ;
Xie, Xingxing ;
Han, Junwei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) :13467-13488
[9]  
Cioppa A., 2022, Soccernettracking: multiple object tracking dataset and benchmark in soccer videos. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
[10]   Automatic soccer field of play registration [J].
Cuevas, Carlos ;
Quilon, Daniel ;
Garcia, Narciso .
PATTERN RECOGNITION, 2020, 103