Simple kinesthetic haptics for object recognition

被引:0
|
作者
Sintov, Avishai [1 ]
Meir, Inbar [1 ]
机构
[1] Tel Aviv Univ, Sch Mech Engn, Haim Levanon St, IL-6139001 Tel Aviv, Israel
关键词
Kinesthetic haptics; object recognition; haptic glance; IDENTIFYING OBJECTS; POINT SETS; CLASSIFICATION; EXPLORATION; ALGORITHM; HAND;
D O I
10.1177/02783649231182486
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Object recognition is an essential capability when performing various tasks. Humans naturally use either or both visual and tactile perception to extract object class and properties. Typical approaches for robots, however, require complex visual systems or multiple high-density tactile sensors which can be highly expensive. In addition, they usually require actual collection of a large dataset from real objects through direct interaction. In this paper, we propose a kinesthetic-based object recognition method that can be performed with any multi-fingered robotic hand in which the kinematics is known. The method does not require tactile sensors and is based on observing grasps of the objects. We utilize a unique and frame invariant parameterization of grasps to learn instances of object shapes. To train a classifier, training data is generated rapidly and solely in a computational process without interaction with real objects. We then propose and compare between two iterative algorithms that can integrate any trained classifier. The classifiers and algorithms are independent of any particular robot hand and, therefore, can be exerted on various ones. We show in experiments, that with few grasps, the algorithms acquire accurate classification. Furthermore, we show that the object recognition approach is scalable to objects of various sizes. Similarly, a global classifier is trained to identify general geometries (e.g., an ellipsoid or a box) rather than particular ones and demonstrated on a large set of objects. Full scale experiments and analysis are provided to show the performance of the method.
引用
收藏
页码:537 / 561
页数:25
相关论文
共 50 条
  • [1] Visual-Haptic-Kinesthetic Object Recognition with Multimodal Transformer
    Zhou, Xinyuan
    Lan, Shiyong
    Wa, Wenwu
    Li, Xinyang
    Zhou, Siyuan
    Yang, Hongyu
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VII, 2023, 14260 : 233 - 245
  • [2] Attention can improve a simple model for object recognition
    Bermudez-Contreras, E.
    Buxton, H.
    Spier, E.
    IMAGE AND VISION COMPUTING, 2008, 26 (06) : 776 - 787
  • [3] Simple object recognition based on spatial relations and visual features represented using irregular pyramids
    Morales-Gonzalez, Annette
    Garcia-Reyes, Edel B.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2013, 63 (03) : 875 - 897
  • [4] Object Recognition with Fourier Descriptors
    Sarfraz, Muhammad
    2020 24TH INTERNATIONAL CONFERENCE INFORMATION VISUALISATION (IV 2020), 2020, : 657 - 662
  • [5] Kinesthetic Metaphors for Precise Spatial Manipulation: A Study of Object Rotation
    Mohanty, Ronak R.
    Krishnamurthy, Vinayak R.
    JOURNAL OF COMPUTING AND INFORMATION SCIENCE IN ENGINEERING, 2021, 21 (02)
  • [6] Semantic object recognition by merging decision tree with object ontology
    Damak, Wafa
    Rebai, Issam
    Kallel, Imene Khanfir
    2014 1ST INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR SIGNAL AND IMAGE PROCESSING (ATSIP 2014), 2014, : 65 - 70
  • [7] A Recognition Method for Soft Objects Based on the Fusion of Vision and Haptics
    Sun, Teng
    Zhang, Zhe
    Miao, Zhonghua
    Zhang, Wen
    BIOMIMETICS, 2023, 8 (01)
  • [8] Object recognition using discriminative parts
    Liu, Ying-Ho
    Lee, Anthony J. T.
    Chang, Fu
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2012, 116 (07) : 854 - 867
  • [9] Object recognition datasets and challenges: A review
    Salari, Aria
    Djavadifar, Abtin
    Liu, Xiangrui
    Najjaran, Homayoun
    NEUROCOMPUTING, 2022, 495 : 129 - 152
  • [10] OBJECT RECOGNITION USING IMAGE DESCRIPTORS
    Mohan, V
    Shanmugapriya, P.
    Venkataramani, Y.
    ICCN: 2008 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING, 2008, : 337 - 340