Table grape inflorescence detection and clamping point localisation based on channel pruned YOLOV7-TP

被引:9
作者
Du, Wensheng [1 ,2 ]
Jia, Zihang [1 ]
Sui, Shunshun [1 ]
Liu, Ping [1 ]
机构
[1] Shandong Agr Univ, Coll Mech & Elect Engn, Shandong Agr Equipment Intelligent Engn Lab, Shandong Prov Key Lab Hort Machinery & Equipment, Tai An 271000, Peoples R China
[2] Shandong Jiaotong Univ, Sch Construct Machinery, Jinan 250357, Peoples R China
关键词
YOLOV7-TP; Channel pruning; Deep learning; Thinning; Table grape; PICKING POINT; NUMBER;
D O I
10.1016/j.biosystemseng.2023.09.014
中图分类号
S2 [农业工程];
学科分类号
0828 ;
摘要
Inflorescence thinning is one of the most critical techniques for producing high-quality table grapes. Currently, manual thinning of grape inflorescences is still adopted in most vineyards, and it is hard to reach the demands of large-scale and mechanical planting, which easily misses the best season for thinning inflorescences. It is urgent to design a machine for inflorescence thinning to avoid repetitive labour. The thinning machine re-quires the detection of table grape inflorescences and the location of stem clamping point. A lightweight channel pruned YOLOV7-TP that can be deployed in the consumer-grade vision system of the thinning machine was proposed. First, grape inflorescences and stems with different numbers of clamping points were stacked as labels and fed into the YOLOV7-TP for training. Then an optimal model was obtained after studying the factors impacting the detection and localisation performance. Finally, channel pruning was applied to YOLOV7-TP to compress the model, and some factors affecting the results were analysed for balancing detection accuracy and speed. Experiments were conducted to evaluate the effectiveness of YOLOV7-TP and the optimal combination of hyperparameters was determined. Furthermore, when the sparsity rate was 0.00025 and the pruning rate was 0.4, the channel pruned YOLOV7-TP performed optimally. The model achieves 91.5% mAP0.5, 2.3M parameters, 8.7 GFLOPS, and 29.4 fps detection speed. The channel pruned YOLOV7-TP has demonstrated excellent detection accuracy and speed in detecting grape inflorescence and location stem clamping points simultaneously, which supports a powerful technology for the vision system of grape inflorescence thinning machine. (c) 2023 IAgrE. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:100 / 115
页数:16
相关论文
共 37 条
  • [1] Grape Bunch Detection at Different Growth Stages Using Deep Learning Quantized Models
    Aguiar, Andre Silva
    Magalhaes, Sandro Augusto
    dos Santos, Filipe Neves
    Castro, Luis
    Pinho, Tatiana
    Valente, Joao
    Martins, Rui
    Boaventura-Cunha, Jose
    [J]. AGRONOMY-BASEL, 2021, 11 (09):
  • [2] vitisFlower® : Development and Testing of a Novel Android-Smartphone Application for Assessing the Number of Grapevine Flowers per Inflorescence Using Artificial Vision Techniques
    Aquino, Arturo
    Millan, Borja
    Gaston, Daniel
    Diago, Maria-Paz
    Tardaguila, Javier
    [J]. SENSORS, 2015, 15 (09) : 21204 - 21218
  • [3] Benmehaia R., 2016, African Journal of Agricultural Research, V11, P3203
  • [4] Chen LB, 2017, IEEE INT SYMP NANO, P1, DOI 10.1109/NANOARCH.2017.8053709
  • [5] Assessment of flower number per inflorescence in grapevine by image analysis under field conditions
    Diago, Maria P.
    Sanz-Garcia, Andres
    Millan, Borja
    Blasco, Jose
    Tardaguila, Javier
    [J]. JOURNAL OF THE SCIENCE OF FOOD AND AGRICULTURE, 2014, 94 (10) : 1981 - 1987
  • [6] [杜文圣 Du Wensheng], 2022, [农业工程学报, Transactions of the Chinese Society of Agricultural Engineering], V38, P169
  • [7] Duan K., 2019, IEEE I CONF COMP VIS
  • [8] Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networks
    Feng, Zhen-Hua
    Kittler, Josef
    Awais, Muhammad
    Huber, Patrik
    Wu, Xiao-Jun
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2235 - 2245
  • [9] A detection algorithm for cherry fruits based on the improved YOLO-v4 model
    Gai, Rongli
    Chen, Na
    Yuan, Hai
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (19) : 13895 - 13906
  • [10] An adaptable approach to automated visual detection of plant organs with applications in grapevine breeding
    Grimm, Jonatan
    Herzog, Katja
    Rist, Florian
    Kicherer, Anna
    Toepfer, Reinhard
    Steinhage, Volker
    [J]. BIOSYSTEMS ENGINEERING, 2019, 183 : 170 - 183