A Fast 6DOF Visual Selective Grasping System Using Point Clouds

被引:0
|
作者
de Oliveira, Daniel Moura [1 ]
Conceicao, Andre Gustavo Scolari [2 ]
机构
[1] Univ Fed Bahia, Postgrad Program Elect Engn, BR-40210630 Salvador, Brazil
[2] Univ Fed Bahia, Dept Elect & Comp Engn, LaR Robot Lab, BR-40210630 Salvador, Brazil
关键词
robot manipulation; grasping system; AI in robotics; deep learning; point clouds;
D O I
10.3390/machines11050540
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual object grasping can be complex when dealing with different shapes, points of view, and environments since the robotic manipulator must estimate the most feasible place to grasp. This work proposes a new selective grasping system using only point clouds of objects. For the selection of the object of interest, a deep learning network for object classification is proposed, named Point Encoder Convolution (PEC). The network is trained with a dataset obtained in a realistic simulator and uses an autoencoder with 1D convolution. The developed grasping algorithm used in the system uses geometry primitives and lateral curvatures to estimate the best region to grasp without previously knowing the object's point cloud. Experimental results show a success ratio of 94% for a dataset with five classes, and the proposed visual selective grasping system can be executed in around 0.004 s, suitable for tasks that require a low execution time or use low-cost hardware.
引用
收藏
页数:18
相关论文
共 13 条
  • [1] Subjective Quality Database and Objective Study of Compressed Point Clouds With 6DoF Head-Mounted Display
    Wu, Xinju
    Zhang, Yun
    Fan, Chunling
    Hou, Junhui
    Kwong, Sam
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (12) : 4630 - 4644
  • [2] Towards 6DoF HTTP Adaptive Streaming Through Point Cloud Compression
    van der Hooft, Jeroen
    Wauters, Tim
    De Turck, Filip
    Timmerer, Christian
    Hellwagner, Hermann
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 2405 - 2413
  • [3] POINTVOTENET: ACCURATE OBJECT DETECTION AND 6 DOF POSE ESTIMATION IN POINT CLOUDS
    Hagelskjaer, Frederik
    Buch, Anders Glent
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2641 - 2645
  • [4] SynPo-Net-Accurate and Fast CNN-Based 6DoF Object Pose Estimation Using Synthetic Training
    Su, Yongzhi
    Rambach, Jason
    Pagani, Alain
    Stricker, Didier
    SENSORS, 2021, 21 (01) : 1 - 16
  • [5] Fast Object Segmentation Pipeline for Point Clouds Using Robot Operating System
    Josyula, Anjani
    Anand, Bhaskar
    Rajalakshmi, P.
    2019 IEEE 5TH WORLD FORUM ON INTERNET OF THINGS (WF-IOT), 2019, : 915 - 919
  • [6] Microscale Precision of 6DOF Localization Rectification of Low-End Stereo Vision Using Deep Learning
    Farag, Ramy
    Saad, Mohamed S.
    Emara, H.
    Bahgat, A.
    2020 IEEE 29TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2020, : 549 - 554
  • [7] Using dense point clouds as environment model for visual localization of mobile robot
    Crombez, Nathan
    Caron, Guillaume
    Mouaddib, El Mustapha
    2015 12TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2015, : 40 - 45
  • [8] Exploring the Long-Term Changes in Visual Attributes of Urban Green Spaces Using Point Clouds
    Zhang, Xiaohan
    Fang, Yuhao
    Zhang, Guanting
    Cheng, Shi
    LAND, 2024, 13 (06)
  • [9] Development and application of 3D spatial metrics using point clouds for landscape visual quality assessment
    Qi, Jinda
    Lin, Ervine Shengwei
    Tan, Puay Yok
    Ho, Roger Chun Man
    Sia, Angelia
    Olszewska-Guizzo, Agnieszka
    Zhang, Xudong
    Waykool, Radha
    LANDSCAPE AND URBAN PLANNING, 2022, 228
  • [10] Fast Planar Surface Detection in Point Clouds Using Voxel-grid-center-constrained Iterative Adaptive Plane Extraction
    Liu, Liyong
    Tu, Xiaowei
    Yang, Qinghua
    Yu, Jingyuan
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7343 - 7348