Auto-Sorting System Toward Smart Factory Based on Deep Learning for Image Segmentation

被引:29
作者
Wang, Tian [1 ]
Yao, Yuting [1 ]
Chen, Yang [1 ]
Zhang, Mengyi [2 ]
Tao, Fei [1 ]
Snoussi, Hichem [3 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100083, Peoples R China
[2] Nanjing Tech Univ, Coll Elect Engn & Control Sci, Nanjing 210028, Jiangsu, Peoples R China
[3] Univ Technol Troyes, Inst Charles Delaunay, LM2S, CNRS,UMR STMR 6279, F-10300 Troyes, France
基金
中国国家自然科学基金;
关键词
Smart factory; deep learning; auto-sorting; convolutional network; object detection; INTERNET; THINGS;
D O I
10.1109/JSEN.2018.2866943
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Machine part sorting is important and monotonous in smart factory. In this paper, an auto-sorting system is proposed based on the deep learning method. In the proposed system, an industrial objection detection network combined with a robotic arm controlling system is designed to automatically and efficiently complete machine part sorting. Region-based full convolutional network (R-FCN) is applied for locating and recognizing different types of images of industrial object models. After comparison and simulation analysis, it illustrated that the R-FCN model trained with enough labeled data can efficiently and accurately recognize the object from the images captured by visual sensors. Furthermore, with enough data, the network can be robust to view angle rotation both vertically and horizontally, and a small part of overlapping of object will not mislead the judgment of the network in most situations. The case study results illustrate that the position and type of objects can be successfully detected. The code will be available publicly at https://github.com/tianwangbuaa/.
引用
收藏
页码:8493 / 8501
页数:9
相关论文
共 43 条
[1]  
Ashton K., 2009, RFID J, V22, P97, DOI DOI 10.1016/J.AMJCARD.2013.11.014
[2]  
Canali C., 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE), P215, DOI 10.1109/CoASE.2014.6899329
[3]   Real-Time Monitoring via Patch-Type Piezoelectric Force Sensors for Internet of Things Based Logistics [J].
Chuang, Cheng-Hsin ;
Lee, Da-Huei ;
Chang, Wan-Jung ;
Weng, Wan-Ching ;
Shaikh, Muhammad Omar ;
Huang, Chung-Lin .
IEEE SENSORS JOURNAL, 2017, 17 (08) :2498-2506
[4]  
Dai J., 2016, ADV NEURAL INFORM PR, V29, P379, DOI [DOI 10.1016/J.JPOWSOUR.2007.02.075, DOI 10.48550/ARXIV.1605.06409, DOI 10.1109/CVPR.2017.690]
[5]  
Ebrahimzadeh Ataollah, 2010, Proceedings of the 2010 6th International Conference on Digital Content, Multimedia Technology and its Applications (IDC 2010), P372
[6]   The Pascal Visual Object Classes (VOC) Challenge [J].
Everingham, Mark ;
Van Gool, Luc ;
Williams, Christopher K. I. ;
Winn, John ;
Zisserman, Andrew .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 88 (02) :303-338
[7]  
Girshick R., 2014, P IEEE C COMP VIS PA, DOI [10.1109/CVPR.2014.81, DOI 10.1109/CVPR.2014.81, 10.1109/cvpr.2014.81]
[8]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[9]   AN ANALYSIS OF HISTOGRAM-BASED THRESHOLDING ALGORITHMS [J].
GLASBEY, CA .
CVGIP-GRAPHICAL MODELS AND IMAGE PROCESSING, 1993, 55 (06) :532-537
[10]  
Hassan Q.F., 2011, CrossTalk, P16