Pig Movement Estimation by Integrating Optical Flow with a Multi-Object Tracking Model

被引:1
作者
Zhou, Heng [1 ,2 ]
Chung, Seyeon [2 ]
Kakar, Junaid Khan [1 ,2 ]
Kim, Sang Cheol [2 ]
Kim, Hyongsuk [2 ,3 ]
机构
[1] Jeonbuk Natl Univ, Dept Elect & Informat Engn, Jeonju 54896, South Korea
[2] Jeonbuk Natl Univ, Core Res Inst Intelligent Robots, Jeonju 54896, South Korea
[3] Jeonbuk Natl Univ, Dept Elect Engn, Jeonju 54896, South Korea
基金
新加坡国家研究基金会;
关键词
pig movement estimation; multi-object tracking; optical flow; livestock farming;
D O I
10.3390/s23239499
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Pig husbandry constitutes a significant segment within the broader framework of livestock farming, with porcine well-being emerging as a paramount concern due to its direct implications on pig breeding and production. An easily observable proxy for assessing the health of pigs lies in their daily patterns of movement. The daily movement patterns of pigs can be used as an indicator of their health, in which more active pigs are usually healthier than those who are not active, providing farmers with knowledge of identifying pigs' health state before they become sick or their condition becomes life-threatening. However, the conventional means of estimating pig mobility largely rely on manual observations by farmers, which is impractical in the context of contemporary centralized and extensive pig farming operations. In response to these challenges, multi-object tracking and pig behavior methods are adopted to monitor pig health and welfare closely. Regrettably, these existing methods frequently fall short of providing precise and quantified measurements of movement distance, thereby yielding a rudimentary metric for assessing pig health. This paper proposes a novel approach that integrates optical flow and a multi-object tracking algorithm to more accurately gauge pig movement based on both qualitative and quantitative analyses of the shortcomings of solely relying on tracking algorithms. The optical flow records accurate movement between two consecutive frames and the multi-object tracking algorithm offers individual tracks for each pig. By combining optical flow and the tracking algorithm, our approach can accurately estimate each pig's movement. Moreover, the incorporation of optical flow affords the capacity to discern partial movements, such as instances where only the pig's head is in motion while the remainder of its body remains stationary. The experimental results show that the proposed method has superiority over the method of solely using tracking results, i.e., bounding boxes. The reason is that the movement calculated based on bounding boxes is easily affected by the size fluctuation while the optical flow data can avoid these drawbacks and even provide more fine-grained motion information. The virtues inherent in the proposed method culminate in the provision of more accurate and comprehensive information, thus enhancing the efficacy of decision-making and management processes within the realm of pig farming.
引用
收藏
页数:20
相关论文
共 39 条
  • [1] Tracking without bells and whistles
    Bergmann, Philipp
    Meinhardt, Tim
    Leal-Taixe, Laura
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 941 - 951
  • [2] Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
    Bernardin, Keni
    Stiefelhagen, Rainer
    [J]. EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2008, 2008 (1)
  • [3] Bewley A, 2016, IEEE IMAGE PROC, P3464, DOI 10.1109/ICIP.2016.7533003
  • [4] GAN-Based Video Denoising with Attention Mechanism for Field-Applicable Pig Detection System
    Bo, Zhao
    Atif, Othmane
    Lee, Jonguk
    Park, Daihee
    Chung, Yongwha
    [J]. SENSORS, 2022, 22 (10)
  • [5] Behaviour recognition of pigs and cattle: Journey from computer vision to deep learning
    Chen, Chen
    Zhu, Weixing
    Norton, Tomas
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 187 (187)
  • [6] Recognition of aggressive episodes of pigs based on convolutional neural network and long short-term memory
    Chen, Chen
    Zhu, Weixing
    Steibel, Juan
    Siegford, Janice
    Wurtz, Kaitlin
    Han, Junjie
    Norton, Tomas
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 169
  • [7] VTag: a semi-supervised pipeline for tracking pig activity with a single top-view camera
    Chen, Chun-Peng J.
    Morota, Gota
    Lee, Kiho
    Zhang, Zhiwu
    Cheng, Hao
    [J]. JOURNAL OF ANIMAL SCIENCE, 2022, 100 (06)
  • [8] Review: Smart agri-systems for the pig industry
    Collins, L. M.
    Smith, L. M.
    [J]. ANIMAL, 2022, 16
  • [9] Automated Individual Pig Localisation, Tracking and Behaviour Metric Extraction Using Deep Learning
    Cowton, Jake
    Kyriazakis, Ilias
    Bacardit, Jaume
    [J]. IEEE ACCESS, 2019, 7 : 108049 - 108060
  • [10] Activity detection of suckling piglets based on motion area analysis using frame differences in combination with convolution neural network
    Ding, Qi-an
    Chen, Jia
    Shen, Ming-xia
    Liu, Long-shen
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 194