Enhancing Grapevine Node Detection to Support Pruning Automation: Leveraging State-of-the-Art YOLO Detection Models for 2D Image Analysis

被引:0
|
作者
Oliveira, Francisco [1 ,2 ]
da Silva, Daniel Queiros [2 ]
Filipe, Vitor [1 ,2 ]
Pinho, Tatiana Martins [2 ]
Cunha, Mario [2 ,3 ]
Cunha, Jose Boaventura [1 ,2 ]
dos Santos, Filipe Neves [2 ]
机构
[1] Univ Tras Os Montes & Alto Douro UTAD, Sch Sci & Technol, P-5000801 Vila Real, Portugal
[2] INESC Technol & Sci, INESC TEC, P-4200465 Porto, Portugal
[3] Univ Porto, Fac Sci, FCUP, P-4169007 Porto, Portugal
关键词
deep learning; precision agriculture; pruning; robotic systems; YOLO;
D O I
10.3390/s24216774
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Automating pruning tasks entails overcoming several challenges, encompassing not only robotic manipulation but also environment perception and detection. To achieve efficient pruning, robotic systems must accurately identify the correct cutting points. A possible method to define these points is to choose the cutting location based on the number of nodes present on the targeted cane. For this purpose, in grapevine pruning, it is required to correctly identify the nodes present on the primary canes of the grapevines. In this paper, a novel method of node detection in grapevines is proposed with four distinct state-of-the-art versions of the YOLO detection model: YOLOv7, YOLOv8, YOLOv9 and YOLOv10. These models were trained on a public dataset with images containing artificial backgrounds and afterwards validated on different cultivars of grapevines from two distinct Portuguese viticulture regions with cluttered backgrounds. This allowed us to evaluate the robustness of the algorithms on the detection of nodes in diverse environments, compare the performance of the YOLO models used, as well as create a publicly available dataset of grapevines obtained in Portuguese vineyards for node detection. Overall, all used models were capable of achieving correct node detection in images of grapevines from the three distinct datasets. Considering the trade-off between accuracy and inference speed, the YOLOv7 model demonstrated to be the most robust in detecting nodes in 2D images of grapevines, achieving F1-Score values between 70% and 86.5% with inference times of around 89 ms for an input size of 1280 x 1280 px. Considering these results, this work contributes with an efficient approach for real-time node detection for further implementation on an autonomous robotic pruning system.
引用
收藏
页数:18
相关论文
共 3 条
  • [1] Enhancing wrist abnormality detection with YOLO: Analysis of state-of-the-art single-stage detection models
    Ahmed, Ammar
    Imran, Ali Shariq
    Manaf, Abdul
    Kastrati, Zenun
    Daudpota, Sher Muhammad
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 93
  • [2] Leveraging 2D Deep Learning ImageNet-trained Models for Native 3D Medical Image Analysis
    Baheti, Bhakti
    Pati, Sarthak
    Menze, Bjoern
    Bakas, Spyridon
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2022, 2023, 13769 : 68 - 79
  • [3] Comparison of 2D and 3D convolutional neural networks in hyperspectral image analysis of fruits applied to orange bruise detection
    Pourdarbani, Raziyeh
    Sabzi, Sajad
    Zohrabi, Reihaneh
    Garcia-Mateos, Gines
    Fernandez-Beltran, Ruben
    Molina-Martinez, Jose Miguel
    Rohban, Mohammad H.
    JOURNAL OF FOOD SCIENCE, 2023, 88 (12) : 5149 - 5163