Automatic detection of oil palm fruits from UAV images using an improved YOLO model

被引:58
作者
Junos, Mohamad Haniff [1 ]
Khairuddin, Anis Salwa Mohd [1 ]
Thannirmalai, Subbiah [2 ]
Dahari, Mahidzal [1 ]
机构
[1] Univ Malaya, Fac Engn, Dept Elect Engn, Kuala Lumpur 50603, Malaysia
[2] Sime Darby Technol Ctr Sdn Bhd, Adv Technol & Robot, Serdang 43400, Selangor, Malaysia
关键词
Deep learning; Machine vision; Object detection; Precision agriculture; Improved YOLO; OBJECT DETECTION;
D O I
10.1007/s00371-021-02116-3
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Manual harvesting of loose fruits in the oil palm plantation is both time consuming and physically laborious. Automatic harvesting system is an alternative solution for precision agriculture which requires accurate visual information of the targets. Current state-of-the-art one-stage object detection method provides excellent detection accuracy; however, it is computationally intensive and impractical for embedded system. This paper proposed an improved YOLO model to detect oil palm loose fruits from unmanned aerial vehicle images. In order to improve the robustness of the detection system, the images are augmented by brightness, rotation, and blurring to simulate the actual natural environment. The proposed improved YOLO model adopted several improvements; densely connected neural network for better feature reuse, swish activation function, multi-layer detection to enhance detection on small targets and prior box optimization to obtain accurate bounding box information. The experimental results show that the proposed model achieves outstanding average precision of 99.76% with detection time of 34.06 ms. In addition, the proposed model is also light in weight size and requires less training time which is significant in reducing the hardware costs. The results exhibit the superiority of the proposed improved YOLO model over several existing state-of-the-art detection models.
引用
收藏
页码:2341 / 2355
页数:15
相关论文
共 46 条
  • [1] Counting Apples and Oranges With Deep Learning: A Data-Driven Approach
    Chen, Steven W.
    Shivakumar, Shreyas S.
    Dcunha, Sandeep
    Das, Jnaneshwar
    Okon, Edidiong
    Qu, Chao
    Taylor, Camillo J.
    Kumar, Vijay
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2017, 2 (02): : 781 - 788
  • [2] YOLO-face: a real-time face detector
    Chen, Weijun
    Huang, Hongbo
    Peng, Shuai
    Zhou, Changsheng
    Zhang, Cuiping
    [J]. VISUAL COMPUTER, 2021, 37 (04) : 805 - 813
  • [3] Strawberry Yield Prediction Based on a Deep Neural Network Using High-Resolution Aerial Orthoimages
    Chen, Yang
    Lee, Won Suk
    Gan, Hao
    Peres, Natalia
    Fraisse, Clyde
    Zhang, Yanchao
    He, Yong
    [J]. REMOTE SENSING, 2019, 11 (13)
  • [4] Apple flower detection using deep convolutional networks
    Dias, Philipe A.
    Tabb, Amy
    Medeiros, Henry
    [J]. COMPUTERS IN INDUSTRY, 2018, 99 : 17 - 28
  • [5] Dyrmann M., 2017, ADV ANIM BIOSCI, V8, P842, DOI [DOI 10.1017/S2040470017000206, 10.1017/S2040470017000206>, 10.1017/S2040470017000206]
  • [6] Multi-modal deep learning for Fuji apple detection using RGB-D cameras and their radiometric capabilities
    Gene-Mola, Jordi
    Vilaplana, Veronica
    Rosell-Polo, Joan R.
    Morros, Josep-Ramon
    Ruiz-Hidalgo, Javier
    Gregorio, Eduard
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2019, 162 : 689 - 698
  • [7] Girshick R., 2017, RICH FEATURE HIERARC, DOI [DOI 10.1109/CVPR.2014.81, 10.1109/cvpr.2014.81]
  • [8] Design of fuzzy inference system for apple ripeness estimation using gradient method
    Hamza, Raja
    Chtourou, Mohamed
    [J]. IET IMAGE PROCESSING, 2020, 14 (03) : 561 - 569
  • [9] Han S, 2015, ADV NEUR IN, V28
  • [10] He KM, 2020, IEEE T PATTERN ANAL, V42, P386, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]