Deep learning-based method for vision-guided robotic grasping of unknown objects

被引:37
作者
Bergamini, Luca [1 ]
Sposato, Mario [1 ]
Pellicciari, Marcello [2 ]
Peruzzini, Margherita [1 ]
Calderara, Simone [1 ]
Schmidt, Juliana [1 ]
机构
[1] Univ Modena & Reggio Emilia, Dept Engn Enzo Ferrari, Via Vivarelli 10, Modena 41125, MO, Italy
[2] Univ Modena & Reggio Emilia, Dept Sci & Methods Engn, Reggio Emilia, RE, Italy
基金
欧盟地平线“2020”;
关键词
Collaborative robotics; Deep learning; Vision-guided robotic grasping; Industry; 4.0;
D O I
10.1016/j.aei.2020.101052
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays, robots are heavily used in factories for different tasks, most of them including grasping and manipulation of generic objects in unstructured scenarios. In order to better mimic a human operator involved in a grasping action, where he/she needs to identify the object and detect an optimal grasp by means of visual information, a widely adopted sensing solution is Artificial Vision. Nonetheless, state-of-art applications need long training and fine-tuning for manually build the object's model that is used at run-time during the normal operations, which reduce the overall operational throughput of the robotic system. To overcome such limits, the paper presents a framework based on Deep Convolutional Neural Networks (DCNN) to predict both single and multiple grasp poses for multiple objects all at once, using a single RGB image as input. Thanks to a novel loss function, our framework is trained in an end-to-end fashion and matches state-of-art accuracy with a substantially smaller architecture, which gives unprecedented real-time performances during experimental tests, and makes the application reliable for working on real robots. The system has been implemented using the ROS framework and tested on a Baxter collaborative robot.
引用
收藏
页数:14
相关论文
共 47 条
  • [1] [Anonymous], CORRABS16070
  • [2] [Anonymous], CORRABS14126
  • [3] [Anonymous], P 9 INT S IND ROB WA
  • [4] [Anonymous], P AUST C ROB AUT
  • [5] [Anonymous], FULLY CONVOLUTIONAL
  • [6] [Anonymous], NEURAL NETW
  • [7] [Anonymous], INT C ROB AUT SEATTL
  • [8] [Anonymous], IEEE INT C ROB AUT
  • [9] [Anonymous], ROBOTIC PICK PLACE N
  • [10] [Anonymous], ROB 2012 7 GER C ROB