Xiaomila Green Pepper Target Detection Method under Complex Environment Based on Improved YOLOv5s

被引:18
作者
Wang, Fenghua [1 ]
Sun, Zhexing [1 ]
Chen, Yu [1 ]
Zheng, Hao [1 ]
Jiang, Jin [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Modern Agr Engn, Kunming 650500, Yunnan, Peoples R China
来源
AGRONOMY-BASEL | 2022年 / 12卷 / 06期
基金
中国国家自然科学基金;
关键词
Capsicum frutescens L; improved YOLOv5; target detection; orchard; RECOGNITION; FRUITS; COLOR;
D O I
10.3390/agronomy12061477
中图分类号
S3 [农学(农艺学)];
学科分类号
0901 ;
摘要
Real-time detection of fruit targets is a key technology of the Xiaomila green pepper (Capsicum frutescens L.) picking robot. The complex conditions of orchards make it difficult to achieve accurate detection. However, most of the existing deep learning network detection algorithms cannot effectively detect Xiaomila green pepper fruits covered by leaves, branches, and other fruits in natural scenes. As detailed in this paper, the Red, Green, Blue (RGB) images of Xiaomila green pepper in the green and mature stage were collected under natural light conditions for building the dataset and an improved YOLOv5s model (YOLOv5s-CFL) is proposed to improve the efficiency and adaptability of picking robots in the natural environment. First, the convolutional layer in the Cross Stage Partial (CSP) is replaced with GhostConv, the detection speed is improved through a lightweight structure, and the detection accuracy is enhanced by adding a Coordinate Attention (CA) layer and replacing Path Aggregation Network (PANet) in the neck with Bidirectional Feature Pyramid Network (BiFPN). In the experiment, the YOLOv5s-CFL model was used to detect the Xiaomila, and the detection results were analyzed and compared with those of the original YOLOv5s, YOLOv4-tiny, and YOLOv3-tiny models. With these improvements, the Mean Average Precision (mAP) of YOLOv5s-CFL is 1.1%, 6.8%, and 8.9% higher than original YOLOv5s, YOLOv4-tiny, and YOLOv3-tiny, respectively. Compared with the original YOLOv5 model, the model size is reduced from 14.4 MB to 13.8 MB, and the running speed is reduced from 15.8 to 13.9 Gflops. The experimental results indicate that the lightweight model improves the detection accuracy and has good real-time performance and application prospects in the field of picking robots.
引用
收藏
页数:16
相关论文
共 34 条
[1]   Robust pixel-based classification of obstacles for robotic harvesting of sweet-pepper [J].
Bac, C. W. ;
Hemming, J. ;
van Henten, E. J. .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2013, 96 :148-162
[2]  
Bochkovskiy A., 2020, ARXIV 200410934
[3]   A new method for pedicel/peduncle detection and size assessment of grapevine berries and other fruits by image analysis [J].
Cubero, Sergio ;
Diago, Maria Paz ;
Blasco, Jose ;
Tardaguila, Javier ;
Millan, Borja ;
Aleixos, Nuria .
BIOSYSTEMS ENGINEERING, 2014, 117 :62-72
[4]   Apigenin glycosides from green pepper enhance longevity and stress resistance in Caenorhabditis elegans [J].
Elkhedir, Abdeen E. ;
Iqbal, Aamir ;
Zogona, Daniel ;
Mohammed, Hammad Hamed ;
Murtaza, Ayesha ;
Xu, Xiaoyun .
NUTRITION RESEARCH, 2022, 102 :23-34
[5]   YOLO-Banana: A Lightweight Neural Network for Rapid Detection of Banana Bunches and Stalks in the Natural Environment [J].
Fu, Lanhui ;
Yang, Zhou ;
Wu, Fengyun ;
Zou, Xiangjun ;
Lin, Jiaquan ;
Cao, Yongjun ;
Duan, Jieli .
AGRONOMY-BASEL, 2022, 12 (02)
[6]   Banana detection based on color and texture features in the natural environment [J].
Fu, Lanhui ;
Duan, Jieli ;
Zou, Xiangjun ;
Lin, Guichao ;
Song, Shuaishuai ;
Ji, Bang ;
Yang, Zhou .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2019, 167
[7]   A novel image processing algorithm to separate linearly clustered kiwifruits [J].
Fu, Longsheng ;
Tola, Elkamil ;
Al-Mallahi, Ahmad ;
Li, Rui ;
Cui, Yongjie .
BIOSYSTEMS ENGINEERING, 2019, 183 :184-195
[8]   Immature green citrus fruit detection using color and thermal images [J].
Gan, H. ;
Lee, W. S. ;
Alchanatis, V. ;
Ehsani, R. ;
Schueller, J. K. .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2018, 152 :117-125
[9]   GhostNet: More Features from Cheap Operations [J].
Han, Kai ;
Wang, Yunhe ;
Tian, Qi ;
Guo, Jianyuan ;
Xu, Chunjing ;
Xu, Chang .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1577-1586
[10]   A method of green litchi recognition in natural environment based on improved LDA classifier [J].
He, Zhi-Liang ;
Xiong, Jun-Tao ;
Lin, Rui ;
Zou, Xiangjun ;
Tang, Lin-Yue ;
Yang, Zhen-Gang ;
Liu, Zhen ;
Song, Ge .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2017, 140 :159-167