Detection of maturity stages of coconuts in complex background using Faster R-CNN model

被引:88
作者
Parvathi, Subramanian [1 ]
Selvi, Sankar Tamil [1 ]
机构
[1] Natl Engn Coll, Dept ECE, KR Nagar, Kovilpatti 628503, Tamil Nadu, India
关键词
Coconut image acquisition; Coconut detection; Faster R-CNN; Deep learning; FRUIT RECOGNITION; COMPUTER VISION; AGRICULTURE;
D O I
10.1016/j.biosystemseng.2020.12.002
中图分类号
S2 [农业工程];
学科分类号
0828 ;
摘要
Coconuts are commonly harvested by judging their maturity based on colour, shape, timeframe, shaking sound, and other growth characteristics of changes as they grow. Currently, solutions involving image-processing techniques have substantial challenges involving the identification of the maturity stages of coconuts. Accordingly, an improved faster region-based convolutional neural network (Faster R-CNN) model is proposed for the detection of two important maturity stages for coconuts in complex backgrounds. The detection of the maturation stages of coconuts for harvesting without human intervention involves challenges because of the complexity of the environment and the similarity between fruits and their backgrounds. Images of coconut and mature coconut bunches were collected from coconut farms. These images were augmented using rotation and colour transformation techniques. These augmented images were used along with original images during model training. The Faster R-CNN algorithm with the ResNet-50 network was used to enhance the detection score of nuts with two major maturity stages. Following training, the detection performance was tested with a dataset that included real-time images as well as Google images. The test results showed that the detection performance achieved using the improved Faster R-CNN model was greater than that for other object detectors such as the single shot detector (SSD) you only look once (YOLO-V3) and Region-based Fully Convolutional Networks (R-FCN). The promising results obtained from this study provided the motivation to develop an application tool for detecting coconut maturity from real-time images on farms. (c) 2020 IAgrE. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:119 / 132
页数:14
相关论文
共 29 条
  • [1] Amara, 2017, DATENBANKSYSTEME BUS
  • [2] [Anonymous], 2015, ICLR
  • [3] Harvesting Robots for High-value Crops: State-of-the-art Review and Challenges Ahead
    Bac, C. Wouter
    van Henten, Eldert J.
    Hemming, Jochen
    Edan, Yael
    [J]. JOURNAL OF FIELD ROBOTICS, 2014, 31 (06) : 888 - 911
  • [4] Bargoti Suchet, 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA), P3626, DOI 10.1109/ICRA.2017.7989417
  • [5] A robust algorithm based on color features for grape cluster segmentation
    Behroozi-Khazaei, Nasser
    Maleki, Mohammad Reza
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2017, 142 : 41 - 49
  • [6] Computer vision based detection of external defects on tomatoes using deep learning
    da Costa, Arthur Z.
    Figueroa, Hugo E. H.
    Fracarolli, Juliana A.
    [J]. BIOSYSTEMS ENGINEERING, 2020, 190 : 131 - 144
  • [7] Apple flower detection using deep convolutional networks
    Dias, Philipe A.
    Tabb, Amy
    Medeiros, Henry
    [J]. COMPUTERS IN INDUSTRY, 2018, 99 : 17 - 28
  • [8] Plant species classification using deep convolutional neural network
    Dyrmann, Mads
    Karstoft, Henrik
    Midtiby, Henrik Skov
    [J]. BIOSYSTEMS ENGINEERING, 2016, 151 : 72 - 80
  • [9] Ghoury S., 2019, P INT C ADV TECHN CO, P39
  • [10] Deep learning for plant identification using vein morphological patterns
    Grinblat, Guillermo L.
    Uzal, Lucas C.
    Larese, Monica G.
    Granitto, Pablo M.
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2016, 127 : 418 - 424