A computer vision-based method for spatial-temporal action recognition of tail-biting behaviour in group-housed pigs

被引:79
|
作者
Liu, Dong [1 ,2 ]
Oczak, Maciej [3 ,4 ]
Maschat, Kristina [3 ,5 ]
Baumgartner, Johannes [3 ]
Pletzer, Bernadette [3 ]
He, Dongjian [1 ,6 ]
Norton, Tomas [2 ]
机构
[1] Northwest A&F Univ, Coll Mech & Elect Engn, Yangling 712100, Shaanxi, Peoples R China
[2] Katholieke Univ Leuven, M3 BIORES, Leuven, Belgium
[3] Univ Vet Med Vienna Vetmeduni Vienna, Inst Anim Welf Sci, Vet Pl 1, A-1210 Vienna, Austria
[4] Univ Vet Med Vienna Vetmeduni Vienna, Precis Livestock Farming Hub, Vet Pl 1, A-1210 Vienna, Austria
[5] FFoQSI GmbH, Technopk 1C, A-3430 Tulln, Austria
[6] Minist Agr & Rural Affairs, Key Lab Agr Internet Things, Yangling 712100, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Action recognition; Computer vision; Pig behaviour; Precision livestock farming; Tail biting; AGGRESSIVE BEHAVIORS; FEATURE-EXTRACTION; CLASSIFICATION;
D O I
10.1016/j.biosystemseng.2020.04.007
中图分类号
S2 [农业工程];
学科分类号
0828 ;
摘要
As a typical harmful social behaviour, tail biting is considered to be a welfare-reducing problem with economic consequences for pig production. Taking a computer-vision based approach, in this study, we have developed a novel method to automatically identify and locate tail-biting interactions in group-housed pigs. The method employs a tracking-by-detection algorithm to simplify the group-level behaviour to pairwise interactions. Then, a convolution neural network (CNN) and a recurrent neural network (RNN) are combined to extract the spatial-temporal features and classify behaviour categories. The performance of the proposed method was evaluated by quantifying the localisation accuracy and behaviour classification accuracy. The results demonstrate that the tracking-by-detection approach is capable of obtaining the trajectories of biters and victims with a localisation accuracy of 92.71%. The spatial-temporal features trained by CNN and RNN are robust and effective with a category accuracy of 96.25%. In total, our proposed method is capable to identify and locate 89.23% of tail-biting behaviour in group-housed pigs. (C) 2020 IAgrE. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:27 / 41
页数:15
相关论文
共 10 条
  • [1] Extraction of spatial-temporal features for vision-based gesture recognition
    Huang, Y
    Xu, GY
    Zhu, YX
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2000, 15 (01) : 64 - 72
  • [2] Extraction of spatial-temporal features for vision-based gesture recognition
    Yu Huang
    Guangyou Xu
    Yuanxin Zhu
    Journal of Computer Science and Technology, 2000, 15 : 64 - 72
  • [3] A computer vision-based approach for respiration rate monitoring of group housed pigs
    Wang, Meiqing
    Li, Xue
    Larsen, Mona L. V.
    Liu, Dong
    Rault, Jean-Loup
    Norton, Tomas
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 210
  • [4] A kinetic energy model based on machine vision for recognition of aggressive behaviours among group-housed pigs
    Chen Chen
    Zhu Weixing
    Guo Yizheng
    Ma Changhua
    Huang Weijia
    Ruan Chengzhi
    LIVESTOCK SCIENCE, 2018, 218 : 70 - 78
  • [5] A SPATIAL-TEMPORAL CONSTRAINT-BASED ACTION RECOGNITION METHOD
    Han, Tingting
    Yao, Hongxun
    Zhang, Yanhao
    Xu, Pengfei
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 2767 - 2771
  • [6] Evaluation of a novel computer vision-based livestock monitoring system to identify and track specific behaviors of individual nursery pigs within a group-housed environment
    Schmidt, Ty B.
    Lancaster, Jessica M.
    Psota, Eric
    Mote, Benny E.
    Hulbert, Lindsey E.
    Holliday, Aaron
    Woiwode, Ruth
    Perez, Lance C.
    TRANSLATIONAL ANIMAL SCIENCE, 2022, 6 (03)
  • [7] Head and Tail Identification Method for Group-housed Pigs Based on YOLO v3 and Pictorial Structure Model
    Li B.
    Shen M.
    Liu L.
    Lu M.
    Sun Y.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2020, 51 (07): : 44 - 51
  • [8] Recognition of aggressive behavior of group-housed pigs based on CNN-GRU hybrid model with spatio-temporal attention mechanism
    Gao, Yue
    Yan, Kai
    Dai, Baisheng
    Sun, Hongmin
    Yin, Yanling
    Liu, Runze
    Shen, Weizheng
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 205
  • [9] Vision-based dual network using spatial-temporal geometric features for effective resolution of fish behavior recognition with fish overlap
    Zhao, Haixiang
    Wu, Yuankai
    Qu, Keming
    Cui, Zhengguo
    Zhu, Jianxin
    Li, Hao
    Cui, Hongwu
    AQUACULTURAL ENGINEERING, 2024, 105
  • [10] Machine Vision-Based Human Action Recognition Using Spatio-Temporal Motion Features (STMF) with Difference Intensity Distance Group Pattern (DIDGP)
    Arunnehru, Jawaharlalnehru
    Thalapathiraj, Sambandham
    Dhanasekar, Ravikumar
    Vijayaraja, Loganathan
    Kannadasan, Raju
    Khan, Arfat Ahmad
    Haq, Mohd Anul
    Alshehri, Mohammed
    Alwanain, Mohamed Ibrahim
    Keshta, Ismail
    ELECTRONICS, 2022, 11 (15)