Robust node detection and tracking in fruit-vegetable crops using deep learning and multi-view imaging

被引:43
作者
Boogaard, Frans P. [1 ]
Rongen, Kamiel S. A. H. [1 ]
Kootstra, Gert W. [1 ]
机构
[1] Wageningen Univ & Res, Farm Technol Grp, POB 16, NL-6700 AA Wageningen, Netherlands
关键词
Digital plant phenotyping; Internode length; Tracking node development; Deep learning; Multi-view imaging;
D O I
10.1016/j.biosystemseng.2020.01.023
中图分类号
S2 [农业工程];
学科分类号
0828 ;
摘要
Obtaining high-quality phenotypic data that can be used to study the relationship between genotype, phenotype and environment is still labour-intensive. Digital plant phenotyping can assist in collecting these data by replacing human vision by computer vision. However, for complex traits, such as plant architecture, robust and generic digital phenotyping methods have not yet been developed. This study focusses on internode length in cucumber plants. A method for estimating internode length and internode development over time is proposed. The proposed method firstly applies a robust node-detection algorithm based on a deep convolutional neural network. In tests, the algorithm had a precision of 0.95 and a recall of 0.92. The nodes are detected in images from multiple viewpoints around the plant in order to deal with the complex and cluttered plant environment and to solve the occlusion of nodes by other plant parts. The nodes detected in the multiple viewpoint images are then clustered using affinity propagation. The predicted clusters had a homogeneity of 0.98 and a completeness of 0.99. Finally, a linear function is fitted, which allows to study internode development over time. The presented method was able to measure internode length in cucumber plants with a higher accuracy and a larger temporal resolution than other methods proposed in literature and without the time investment needed to obtain the measurements manually. The relative error of our complete method was 5.8%. The proposed method provides many opportunities for robust phenotyping of fruitvegetable crops grown under greenhouse conditions. (C) 2020 IAgrE. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:117 / 132
页数:16
相关论文
共 41 条
  • [1] Alexey A.B., 2018, Darknet
  • [2] [Anonymous], 13 INT C PREC AGR
  • [3] [Anonymous], THESIS
  • [4] [Anonymous], 2010, INT J COMPUT VISION, DOI DOI 10.1007/s11263-009-0275-4
  • [5] [Anonymous], COCO COMM OBJ CONT D
  • [6] [Anonymous], IMPERX IND CAM IM SY
  • [7] [Anonymous], CUDA TOOLK
  • [8] [Anonymous], NVIDIA CUDNN
  • [9] [Anonymous], GEFORCE GTX 1080 TI
  • [10] [Anonymous], BRIT MACH VIS BMVC