Effective grasp detection method based on Swin transformer

被引:0
作者
Zhang, Jing [1 ,2 ]
Tang, Yulin [2 ]
Luo, Yusong [2 ]
Du, Yukun [2 ]
Chen, Mingju [3 ]
机构
[1] Univ Sci & Technol China, Dept Automat, Hefei, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Sichuan, Peoples R China
[3] Artificial Intelligence Key Lab Sichuan Prov, Yibin, Peoples R China
关键词
grasp detection; Swin transformer; attention mechanism; decoupled head; grasping tasks;
D O I
10.1117/1.JEI.33.3.033008
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
. Grasp detection within unstructured environments encounters challenges that lead to a reduced success rate in grasping attempts, attributable to factors including object uncertainty, random positions, and differences in perspective. This work proposes a grasp detection algorithm framework, Swin-transNet, which adopts a hypothesis treating graspable objects as a generalized category and distinguishing between graspable and non-graspable objects. The utilization of the Swin transformer module in this framework augments the feature extraction process, enabling the capture of global relationships within images. Subsequently, the integration of a decoupled head with attention mechanisms further refines the channel and spatial representation of features. This strategic combination markedly improves the system's adaptability to uncertain object categories and random positions, culminating in the precise output of grasping information. Moreover, we elucidate their roles in grasping tasks. We evaluate the grasp detection framework using the Cornell grasp dataset, which is divided into image and object levels. The experiment indicated a detection accuracy of 98.1% and a detection speed of 52 ms. Swin-transNet shows robust generalization on the Jacquard dataset, attaining a detection accuracy of 95.2%. It demonstrates an 87.8% success rate in real-world grasping testing on a visual grasping system, confirming its effectiveness for robotic grasping tasks.
引用
收藏
页数:22
相关论文
共 49 条
  • [1] Learn to grasp unknown objects in robotic manipulation
    Al-Shanoon, Abdulrahman
    Lang, Haoxiang
    Wang, Ying
    Zhang, Yunfei
    Hong, Wenxin
    [J]. INTELLIGENT SERVICE ROBOTICS, 2021, 14 (04) : 571 - 582
  • [2] Asir U, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P4875
  • [3] Deep learning-based method for vision-guided robotic grasping of unknown objects
    Bergamini, Luca
    Sposato, Mario
    Pellicciari, Marcello
    Peruzzini, Margherita
    Calderara, Simone
    Schmidt, Juliana
    [J]. ADVANCED ENGINEERING INFORMATICS, 2020, 44
  • [4] Caldera Shehan, 2018, Multimodal Technologies and Interaction, V2, DOI 10.3390/mti2030057
  • [5] Robotic grasping: from wrench space heuristics to deep learning policies
    Carvalho de Souza, Joao Pedro
    Rocha, Luis F.
    Oliveira, Paulo Moura
    Paulo Moreira, A.
    Boaventura-Cunha, Jose
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2021, 71
  • [6] Attention mechanism feedback network for image super-resolution
    Chen, Xiao
    Jing, Ruyun
    Suna, Chaowen
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (04)
  • [7] Two-stage grasp strategy combining CNN-based classification and adaptive detection on a flexible hand
    Chen, Xiaoyan
    Sun, Yilin
    Zhang, Qiuju
    Liu, Fei
    [J]. APPLIED SOFT COMPUTING, 2020, 97
  • [8] Swin transformer based vehicle detection in undisciplined traffic environment
    Deshmukh, Prashant
    Satyanarayana, G. S. R.
    Majhi, Sudhan
    Sahoo, Upendra Kumar
    Das, Santos Kumar
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [9] Di Guo, 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA), P1609, DOI 10.1109/ICRA.2017.7989191
  • [10] A review of robotic grasp detection technology
    Dong, Minglun
    Zhang, Jian
    [J]. ROBOTICA, 2023, 41 (12) : 3846 - 3885