Automated Cow Body Condition Scoring Using Multiple 3D Cameras and Convolutional Neural Networks

被引:3
作者
Summerfield, Gary I. [1 ]
De Freitas, Allan [1 ]
van Marle-Koster, Este [2 ]
Myburgh, Herman C. [1 ]
机构
[1] Univ Pretoria, Dept Elect Elect & Comp Engn, ZA-0028 Pretoria, South Africa
[2] Univ Pretoria, Dept Anim Sci, ZA-0028 Pretoria, South Africa
关键词
automated cow body condition scoring; convolutional neural network; computer vision; ensemble modelling; sensor fusion; precision livestock; data augmentation; DAIRY-CATTLE; DEPTH;
D O I
10.3390/s23229051
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Body condition scoring is an objective scoring method used to evaluate the health of a cow by determining the amount of subcutaneous fat in a cow. Automated body condition scoring is becoming vital to large commercial dairy farms as it helps farmers score their cows more often and more consistently compared to manual scoring. A common approach to automated body condition scoring is to utilise a CNN-based model trained with data from a depth camera. The approaches presented in this paper make use of three depth cameras placed at different positions near the rear of a cow to train three independent CNNs. Ensemble modelling is used to combine the estimations of the three individual CNN models. The paper aims to test the performance impact of using ensemble modelling with the data from three separate depth cameras. The paper also looks at which of these three cameras and combinations thereof provide a good balance between computational cost and performance. The results of this study show that utilising the data from three depth cameras to train three separate models merged through ensemble modelling yields significantly improved automated body condition scoring accuracy compared to a single-depth camera and CNN model approach. This paper also explored the real-world performance of these models on embedded platforms by comparing the computational cost to the performance of the various models.
引用
收藏
页数:24
相关论文
共 36 条
[21]   Invited review: Body condition score and its association with dairy cow productivity, health, and welfare [J].
Roche, J. R. ;
Friggens, N. C. ;
Kay, J. K. ;
Fisher, M. W. ;
Stafford, K. J. ;
Berry, D. P. .
JOURNAL OF DAIRY SCIENCE, 2009, 92 (12) :5769-5801
[22]   Estimating Body Condition Score in Dairy Cows From Depth Images Using Convolutional Neural Networks, Transfer Learning and Model Ensembling Techniques [J].
Rodriguez Alvarez, Juan ;
Arroqui, Mauricio ;
Mangudo, Pablo ;
Toloza, Juan ;
Jatip, Daniel ;
Rodriguez, Juan M. ;
Teyseyre, Alfredo ;
Sanz, Carlos ;
Zunino, Alejandro ;
Machado, Claudio ;
Mateos, Cristian .
AGRONOMY-BASEL, 2019, 9 (02)
[23]   Body condition estimation on cows from depth images using Convolutional Neural Networks [J].
Rodriguez Alvarez, Juan ;
Arroqui, Mauricio ;
Mangudo, Pablo ;
Toloza, Juan ;
Jatip, Daniel ;
Rodriguez, Juan M. ;
Teyseyre, Alfredo ;
Sanz, Carlos ;
Zunino, Alejandro ;
Machado, Claudio ;
Mateos, Cristian .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2018, 155 :12-22
[24]   Accurate body measurement of live cattle using three depth cameras and non-rigid 3-D shape recovery [J].
Ruchay, Alexey ;
Kober, Vitaly ;
Dorofeev, Konstantin ;
Kolpakov, Vladimir ;
Miroshnikov, Sergei .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 179
[25]   Automated calculation of udder depth and rear leg angle in Holstein-Friesian cows using a multi-Kinect cow scanning system [J].
Salau, Jennifer ;
Haas, Jan H. ;
Junge, Wolfgang ;
Thaller, Georg .
BIOSYSTEMS ENGINEERING, 2017, 160 :154-169
[26]   A multi-Kinect cow scanning system: Calculating linear traits from manually marked recordings of Holstein-Friesian dairy cows [J].
Salau, Jennifer ;
Haas, Jan H. ;
Junge, Wolfgang ;
Thaller, Georg .
BIOSYSTEMS ENGINEERING, 2017, 157 :92-98
[27]   Feasibility of automated body trait determination using the SR4K time-of-flight camera in cow barns [J].
Salau, Jennifer ;
Haas, Jan H. ;
Junge, Wolfgang ;
Bauer, Ulrike ;
Harms, Jan ;
Bieletzki, Sascha .
SPRINGERPLUS, 2014, 3
[28]   Automatic estimation of dairy cow body condition score based on attention-guided 3D point cloud feature extraction [J].
Shi, Wei ;
Dai, Baisheng ;
Shen, Weizheng ;
Sun, Yukun ;
Zhao, Kaixuan ;
Zhang, Yonggen .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 206
[29]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
[30]   Automated body condition scoring of dairy cows using 3-dimensional feature extraction from multiple body regions [J].
Song, X. ;
Bokkers, E. A. M. ;
van Mourik, S. ;
Koerkamp, P. W. G. Groot ;
van der Tol, P. P. J. .
JOURNAL OF DAIRY SCIENCE, 2019, 102 (05) :4294-4308