A Real-Time Apple Targets Detection Method for Picking Robot Based on ShufflenetV2-YOLOX

被引:65
作者
Ji, Wei [1 ]
Pan, Yu [1 ]
Xu, Bo [1 ]
Wang, Juncheng [1 ]
机构
[1] Jiangsu Univ, Sch Elect & Informat Engn, Zhenjiang 212013, Jiangsu, Peoples R China
来源
AGRICULTURE-BASEL | 2022年 / 12卷 / 06期
基金
中国国家自然科学基金;
关键词
machine vision; picking robot; apple detection; YOLOX; ShufflenetV2;
D O I
10.3390/agriculture12060856
中图分类号
S3 [农学(农艺学)];
学科分类号
0901 ;
摘要
In order to enable the picking robot to detect and locate apples quickly and accurately in the orchard natural environment, we propose an apple object detection method based on Shufflenetv2-YOLOX. This method takes YOLOX-Tiny as the baseline and uses the lightweight network Shufflenetv2 added with the convolutional block attention module (CBAM) as the backbone. An adaptive spatial feature fusion (ASFF) module is added to the PANet network to improve the detection accuracy, and only two extraction layers are used to simplify the network structure. The average precision (AP), precision, recall, and F1 of the trained network under the verification set are 96.76%, 95.62%, 93.75%, and 0.95, respectively, and the detection speed reaches 65 frames per second (FPS). The test results show that the AP value of Shufflenetv2-YOLOX is increased by 6.24% compared with YOLOX-Tiny, and the detection speed is increased by 18%. At the same time, it has a better detection effect and speed than the advanced lightweight networks YOLOv5-s, Efficientdet-d0, YOLOv4-Tiny, and Mobilenet-YOLOv4-Lite. Meanwhile, the half-precision floating-point (FP16) accuracy model on the embedded device Jetson Nano with TensorRT acceleration can reach 26.3 FPS. This method can provide an effective solution for the vision system of the apple picking robot.
引用
收藏
页数:18
相关论文
共 27 条
[1]  
Bochkovskiy A., 2020, YOLOV4 OPTIMAL SPEED
[2]   Deep learning-based apple detection using a suppression mask R-CNN [J].
Chu, Pengyu ;
Li, Zhaojian ;
Lammers, Kyle ;
Lu, Renfu ;
Liu, Xiaoming .
PATTERN RECOGNITION LETTERS, 2021, 147 :206-211
[3]  
Ge Z., 2021, ARXIV
[4]   Apple target recognition method in complex environment based on improved YOLOv4 [J].
Ji, Wei ;
Gao, Xiaoxiao ;
Xu, Bo ;
Pan, Yu ;
Zhang, Zhuo ;
Zhao, Dean .
JOURNAL OF FOOD PROCESS ENGINEERING, 2021, 44 (11)
[5]  
Liu S, 2019, ARXIV
[6]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37
[7]   A segmentation method of bagged green apple image [J].
Lv, Jidong ;
Wang, Fan ;
Xu, Liming ;
Ma, Zhenghua ;
Yang, Biao .
SCIENTIA HORTICULTURAE, 2019, 246 :411-417
[8]   ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design [J].
Ma, Ningning ;
Zhang, Xiangyu ;
Zheng, Hai-Tao ;
Sun, Jian .
COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 :122-138
[9]   Real-Time Apple Detection System Using Embedded Systems With Hardware Accelerators: An Edge AI Application [J].
Mazzia, Vittorio ;
Khaliq, Aleem ;
Salvetti, Francesco ;
Chiaberge, Marcello .
IEEE ACCESS, 2020, 8 :9102-9114
[10]   List of Deep Learning Models [J].
Mosavi, Amir ;
Ardabili, Sina ;
Varkonyi-Koczy, Annamaria R. .
ENGINEERING FOR SUSTAINABLE FUTURE, 2020, 101 :202-214