Manipulation of a Complex Object Using Dual-Arm Robot with Mask R-CNN and Grasping Strategy

被引:0
作者
Kijdech, Dumrongsak [1 ]
Vongbunyong, Supachai [1 ]
机构
[1] King Mongkuts Univ Technol Thonburi, Inst Field Robot FIBO, Bangkok 10140, Thailand
关键词
Mask R-CNN; Image processing; YuMi; RGB-D; AI;
D O I
10.1007/s10846-024-02132-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hot forging is one of the common manufacturing processes for producing brass workpieces. However forging produces flash which is a thin metal part around the desired part formed with an excessive material. Using robots with vision system to manipulate this workpiece has encountered several challenging issues, e.g. the uncertain shape of flash, color, reflection of brass surface, different lighting condition, and the uncertainty surrounding the position and orientation of the workpiece. In this research, Mask region-based convolutional neural network together with image processing is used to resolve these issues. The depth camera can provide images for visual detection. Machine learning Mask region-based convolutional neural network model was trained with color images and the position of the object is determined by the depth image. A dual arm 7 degree of freedom collaborative robot with proposed grasping strategy is used to grasp the workpiece that can be in inappropriate position and pose. Eventually, experiments were conducted to assess the visual detection process and the grasp planning of the robot.
引用
收藏
页数:16
相关论文
共 31 条
[1]   Car Detection using Unmanned Aerial Vehicles: Comparison between Faster R-CNN and YOLOv3 [J].
Benjdira, Bilel ;
Khursheed, Taha ;
Koubaa, Anis ;
Ammar, Adel ;
Ouni, Kais .
2019 1ST INTERNATIONAL CONFERENCE ON UNMANNED VEHICLE SYSTEMS-OMAN (UVS), 2019,
[2]   Multi Angle Rotation Object Detection for Remote Sensing Image Based on Modified Feature Pyramid Networks [J].
Cao, Lianyu ;
Zhang, Xiaolu ;
Wang, Zhaoshun ;
Ding, Guangyu .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (14) :5253-5276
[3]   Investigation of YOLOv5 Efficiency in iPhone Supported Systems [J].
Dluznevskij, Daniel ;
Stefanovic, Pavel ;
Ramanauskaite, Simona .
BALTIC JOURNAL OF MODERN COMPUTING, 2021, 9 (03) :333-344
[4]   Understanding of Object Detection Based on CNN Family and YOLO [J].
Du, Juan .
2ND INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2018), 2018, 1004
[5]   A simulated annealing strategy for the detection of arbitrarily shaped spatial clusters [J].
Duczmal, L ;
Assunçao, R .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2004, 45 (02) :269-286
[6]  
Guanhao Yang, 2020, 2020 IEEE 6th International Conference on Computer and Communications (ICCC), P1398, DOI 10.1109/ICCC51575.2020.9345042
[7]  
He PL, 2019, INT CONF INFO SCI, P108, DOI [10.1109/ICIST.2019.8836852, 10.1109/icist.2019.8836852]
[8]  
Hu J, 2017, CHIN AUTOM CONGR, P7151, DOI 10.1109/CAC.2017.8244068
[9]   A novel method based on a Mask R-CNN model for processing dPCR images [J].
Hu, Zhenming ;
Fang, Weibo ;
Gou, Tong ;
Wu, Wenshuai ;
Hu, Jiumei ;
Zhou, Shufang ;
Mu, Ying .
ANALYTICAL METHODS, 2019, 11 (27) :3410-3418
[10]  
Kirschner David, 2016, Interactive Collaborative Robotics. First International Conference, ICR 2016. Proceedings: LNAI 9812, P243, DOI 10.1007/978-3-319-43955-6_29