GANPose: Pose estimation of grouped pigs using a generative adversarial network

被引:5
作者
Wang, Zehua [1 ]
Zhou, Suyin [1 ]
Yin, Ping [1 ]
Xu, Aijun [1 ,2 ]
Ye, Junhua [2 ]
机构
[1] Zhejiang Agr & Forestry Univ, Sch Math & Comp Sci, Hangzhou 311300, Peoples R China
[2] Zhejiang Agr & Forestry Univ, Sch Environm & Resource Sci, Hangzhou 311300, Peoples R China
关键词
Grouped pigs; Pose estimation; Generative adversarial network; Occlusion; BEHAVIOR;
D O I
10.1016/j.compag.2023.108119
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
Pose estimation as an effective method for behaviour detection has attracted wide attention in the field of animal health and welfare detection in recent years. Consequently, we can monitor individual pig behaviour changes over time, which will assist in the early detection of disease, allowing for earlier and more effective intervention. However, a real farming scenario with occlusions and opaque pig clustering may be a challenging computer vision problem. Inspired by human vision, we propose GANPose, a grouped pig pose estimation model based on a generative adversarial network (GAN). This model uses the adversarial game to induce the model to learn prior information about the pig's body structure and output a pose with a reasonable skeleton structure. In addition, we also established a new pig pose estimation dataset, which not only included the basic back keypoints but also small keypoints, such as leg, elbow, and tail, as well as challenging occluded keypoints. This work is the study to tackle the occlusion problem, with a finely tuned GAN structure. Experiments and quantitative results on our dataset show that GANPose can detect keypoints of herd pigs with 74.09 % mAP, and the accuracy of the percentage of correct keypoint (PCK) is 11.37 % higher than the benchmark for occluded keypoints, achieving excellent performance in a real pigsty environment.
引用
收藏
页数:12
相关论文
共 44 条
  • [1] Cao Z., 2017, P IEEE C COMPUTER VI
  • [2] Detection of aggressive behaviours in pigs using a RealSence depth sensor
    Chen, Chen
    Zhu, Weixing
    Liu, Dong
    Steibel, Juan
    Siegford, Janice
    Wurtz, Kaitlin
    Han, Junjie
    Norton, Tomas
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2019, 166
  • [3] Cascaded Pyramid Network for Multi-Person Pose Estimation
    Chen, Yilun
    Wang, Zhicheng
    Peng, Yuxiang
    Zhang, Zhiqiang
    Yu, Gang
    Sun, Jian
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7103 - 7112
  • [4] Adversarial PoseNet: A Structure-aware Convolutional Network for Human Pose Estimation
    Chen, Yu
    Shen, Chunhua
    Wei, Xiu-Shen
    Liu, Lingqiao
    Yang, Jian
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1221 - 1230
  • [5] StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation
    Choi, Yunjey
    Choi, Minje
    Kim, Munyoung
    Ha, Jung-Woo
    Kim, Sunghun
    Choo, Jaegul
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8789 - 8797
  • [6] Chou CJ, 2018, ASIAPAC SIGN INFO PR, P17, DOI 10.23919/APSIPA.2018.8659538
  • [7] Automated Individual Pig Localisation, Tracking and Behaviour Metric Extraction Using Deep Learning
    Cowton, Jake
    Kyriazakis, Ilias
    Bacardit, Jaume
    [J]. IEEE ACCESS, 2019, 7 : 108049 - 108060
  • [8] Dai P., 2018, Cross-modality Person Re-identification with Generative Adversarial Training
  • [9] Pose estimation and behavior classification of broiler chickens based on deep neural networks
    Fang, Cheng
    Zhang, Tiemin
    Zheng, Haikun
    Huang, Junduan
    Cuan, Kaixuan
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 180
  • [10] RMPE: Regional Multi-Person Pose Estimation
    Fang, Hao-Shu
    Xie, Shuqin
    Tai, Yu-Wing
    Lu, Cewu
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2353 - 2362