Super-High-Purity Seed Sorter Using Low-Latency Image-Recognition Based on Deep Learning

被引:43
作者
Heo, Young Jin [1 ]
Kim, Se Jin [1 ]
Kim, Dayeon [1 ]
Lee, Keondo [1 ]
Chung, Wan Kyun [1 ]
机构
[1] Pohang Univ Sci & Technol, Dept Mech Engn, Pohang Si 37673, South Korea
基金
新加坡国家研究基金会;
关键词
Agricultural automation; deep learning in robotics and automation; computer vision for automation; SYSTEM; DESIGN;
D O I
10.1109/LRA.2018.2849513
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Most commercial optical sorting systems are designed to achieve high throughput, so they use a naive low-latency image processing for object identification. These naive low-latency algorithms have difficulty in accurately identifying objects with various shapes, textures, sizes, and colors, so the purity of sorted objects is degraded. Current deep learning technology enables robust image detection and classification, but its inference latency requires several milliseconds; thus, deep learning cannot be directly applied to such real-time high throughput applications. We therefore developed a super-high purity seed sorting system that uses a low-latency image-recognition based on a deep neural network and removes the seeds of noxious weeds from mixed seed product at high throughput with accuracy. The proposed system partitions the detection task into localization and classification, and applies batch inference only once strategy; it achieved 500-fps throughput image-recognition including detection and tracking. Based on the classified and tracked results, air ejectors expel the unwanted seeds. This proposed system eliminates almost the whole weeds with small loss of desired seeds, and is superior to current commercial optical sorting systems.
引用
收藏
页码:3035 / 3042
页数:8
相关论文
共 26 条
[21]  
Redmon J., 2017, CVPR 2017, DOI DOI 10.1142/9789812771728_0012
[22]   You Only Look Once: Unified, Real-Time Object Detection [J].
Redmon, Joseph ;
Divvala, Santosh ;
Girshick, Ross ;
Farhadi, Ali .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :779-788
[23]   ImageNet Large Scale Visual Recognition Challenge [J].
Russakovsky, Olga ;
Deng, Jia ;
Su, Hao ;
Krause, Jonathan ;
Satheesh, Sanjeev ;
Ma, Sean ;
Huang, Zhiheng ;
Karpathy, Andrej ;
Khosla, Aditya ;
Bernstein, Michael ;
Berg, Alexander C. ;
Fei-Fei, Li .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 115 (03) :211-252
[24]  
Simonyan K., 2015, P 3 INT C LEARNING R
[25]   Design of an automatic apple sorting system using machine vision [J].
Sofu, M. M. ;
Er, O. ;
Kayacan, M. C. ;
Cetisli, B. .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2016, 127 :395-405
[26]   Rethinking the Inception Architecture for Computer Vision [J].
Szegedy, Christian ;
Vanhoucke, Vincent ;
Ioffe, Sergey ;
Shlens, Jon ;
Wojna, Zbigniew .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2818-2826