FootApp: An AI-powered system for football match annotation

被引:4
作者
Barra, Silvio [1 ]
Carta, Salvatore M. [2 ]
Giuliani, Alessandro [2 ]
Pisu, Alessia [2 ]
Podda, Alessandro Sebastian [2 ]
Riboni, Daniele [2 ]
机构
[1] Univ Naples Federico II, Dept Informat Technol & Elect Engn, Via Claudio 21, I-80125 Naples, Italy
[2] Univ Cagliari, Dept Math & Comp Sci, Via Osped 72, I-09124 Cagliari, Italy
关键词
Intelligent user interfaces; Pattern recognition; Artificial intelligence; SOCCER; VIDEOS;
D O I
10.1007/s11042-022-13359-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the last years, scientific and industrial research has experienced a growing interest in acquiring large annotated data sets to train artificial intelligence algorithms for tackling problems in different domains. In this context, we have observed that even the market for football data has substantially grown. The analysis of football matches relies on the annotation of both individual players' and team actions, as well as the athletic performance of players. Consequently, annotating football events at a fine-grained level is a very expensive and error-prone task. Most existing semi-automatic tools for football match annotation rely on cameras and computer vision. However, those tools fall short in capturing team dynamics and in extracting data of players who are not visible in the camera frame. To address these issues, in this manuscript we present FootApp, an AI-based system for football match annotation. First, our system relies on an advanced and mixed user interface that exploits both vocal and touch interaction. Second, the motor performance of players is captured and processed by applying machine learning algorithms to data collected from inertial sensors worn by players. Artificial intelligence techniques are then used to check the consistency of generated labels, including those regarding the physical activity of players, to automatically recognize annotation errors. Notably, we implemented a full prototype of the proposed system, performing experiments to show its effectiveness in a real-world adoption scenario.
引用
收藏
页码:5547 / 5567
页数:21
相关论文
共 38 条
[1]  
Alan O, 2008, 2008 23 INT S COMPUT, P1, DOI [10.1109/ISCIS.2008.4717936, DOI 10.1109/ISCIS.2008.4717936]
[2]   Comparative study on classifying human activities with miniature inertial and magnetic sensors [J].
Altun, Kerem ;
Barshan, Billur ;
Tuncel, Orkun .
PATTERN RECOGNITION, 2010, 43 (10) :3605-3620
[3]  
[Anonymous], 2013, Web Speech API
[4]  
[Anonymous], 2008, Performance assessment for field sports, DOI DOI 10.4324/9780203890691
[5]   Semantic annotation of soccer videos: automatic highlights identification [J].
Assfalg, E ;
Bertini, M ;
Colombo, C ;
Del Bimbo, A ;
Nunziati, W .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2003, 92 (2-3) :285-305
[6]   Semantic annotation of soccer videos by visual instance clustering and spatial/temporal reasoning in ontologies [J].
Ballan, Lamberto ;
Bertini, Marco ;
Del Bimbo, Alberto ;
Serra, Giuseppe .
MULTIMEDIA TOOLS AND APPLICATIONS, 2010, 48 (02) :313-337
[7]   A Voice User Interface for football event tagging applications [J].
Barra, Silvio ;
Carcangiu, Alessandro ;
Carta, Salvatore ;
Podda, Alessandro Sebastian ;
Riboni, Daniele .
PROCEEDINGS OF THE WORKING CONFERENCE ON ADVANCED VISUAL INTERFACES AVI 2020, 2020,
[8]   Deep learning and time series-to-image encoding for financial forecasting [J].
Barra, Silvio ;
Carta, Salvatore Mario ;
Corriga, Andrea ;
Podda, Alessandro Sebastian ;
Recupero, Diego Reforgiato .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (03) :683-692
[9]  
Borgelt C, 2002, COMPSTAT 2002: PROCEEDINGS IN COMPUTATIONAL STATISTICS, P395
[10]   Sensor-Based Activity Recognition [J].
Chen, Liming ;
Hoey, Jesse ;
Nugent, Chris D. ;
Cook, Diane J. ;
Yu, Zhiwen .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2012, 42 (06) :790-808