Automatic detection of oil palm fruits from UAV images using an improved YOLO model

被引:72
作者
Junos, Mohamad Haniff [1 ]
Khairuddin, Anis Salwa Mohd [1 ]
Thannirmalai, Subbiah [2 ]
Dahari, Mahidzal [1 ]
机构
[1] Univ Malaya, Fac Engn, Dept Elect Engn, Kuala Lumpur 50603, Malaysia
[2] Sime Darby Technol Ctr Sdn Bhd, Adv Technol & Robot, Serdang 43400, Selangor, Malaysia
关键词
Deep learning; Machine vision; Object detection; Precision agriculture; Improved YOLO; OBJECT DETECTION;
D O I
10.1007/s00371-021-02116-3
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Manual harvesting of loose fruits in the oil palm plantation is both time consuming and physically laborious. Automatic harvesting system is an alternative solution for precision agriculture which requires accurate visual information of the targets. Current state-of-the-art one-stage object detection method provides excellent detection accuracy; however, it is computationally intensive and impractical for embedded system. This paper proposed an improved YOLO model to detect oil palm loose fruits from unmanned aerial vehicle images. In order to improve the robustness of the detection system, the images are augmented by brightness, rotation, and blurring to simulate the actual natural environment. The proposed improved YOLO model adopted several improvements; densely connected neural network for better feature reuse, swish activation function, multi-layer detection to enhance detection on small targets and prior box optimization to obtain accurate bounding box information. The experimental results show that the proposed model achieves outstanding average precision of 99.76% with detection time of 34.06 ms. In addition, the proposed model is also light in weight size and requires less training time which is significant in reducing the hardware costs. The results exhibit the superiority of the proposed improved YOLO model over several existing state-of-the-art detection models.
引用
收藏
页码:2341 / 2355
页数:15
相关论文
共 46 条
[41]   On Plant Detection of Intact Tomato Fruits Using Image Analysis and Machine Learning Methods [J].
Yamamoto, Kyosuke ;
Guo, Wei ;
Yoshioka, Yosuke ;
Ninomiya, Seishi .
SENSORS, 2014, 14 (07) :12191-12206
[42]   SlimYOLOv3: Narrower, Faster and Better for Real-Time UAV Applications [J].
Zhang, Pengyi ;
Zhong, Yunxin ;
Li, Xiaoqiong .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :37-45
[43]   Mixed YOLOv3-LITE: A Lightweight Real-Time Object Detection Method [J].
Zhao, Haipeng ;
Zhou, Yang ;
Zhang, Long ;
Peng, Yangzhao ;
Hu, Xiaofei ;
Peng, Haojie ;
Cai, Xinyue .
SENSORS, 2020, 20 (07)
[44]   A review of key techniques of vision-based control for harvesting robot [J].
Zhao, Yuanshen ;
Gong, Liang ;
Huang, Yixiang ;
Liu, Chengliang .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2016, 127 :311-323
[45]   Object Detection With Deep Learning: A Review [J].
Zhao, Zhong-Qiu ;
Zheng, Peng ;
Xu, Shou-Tao ;
Wu, Xindong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (11) :3212-3232
[46]  
Zhu P., 2020, CoRR abs/2001.06303