Neuromorphic approach to tactile edge orientation estimation using spatiotemporal similarity

被引:7
作者
Kumar, Deepesh [1 ]
Ghosh, Rohan [1 ]
Nakagawa-Silva, Andrei [2 ]
Soares, Alcimar B. [2 ]
Thakor, Nitish, V [1 ,3 ]
机构
[1] Natl Univ Singapore, Inst Hlth N1, Singapore 117456, Singapore
[2] Univ Fed Uberlandia, Fac Elect Engn, BR-38400902 Uberlandia, MG, Brazil
[3] Johns Hopkins Univ, Dept Biomed Engn, Baltimore, MD 21218 USA
关键词
Tactile sensing; Neuromorphic; Biomimetic; Spatiotemporal; Edge orientation estimation; Mechanoreceptors; HUMAN HAND; FINGERTIP; MODEL;
D O I
10.1016/j.neucom.2020.04.131
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Moving a finger around the boundary edge is one of the important strategies followed by humans for ascertaining the shape and size of an object by touch. Tactile response from thousands of mechanorecep-tors in the human hand offers a high spatiotemporal resolution to perceive the edge orientation quickly (< 50 ms) and accurately (acuity of < 3 degrees). Inspired by the computational efficiency of biological tactile system, we present a neuromorphic approach to artificial tactile sensing that mimics the spike-based spa-tiotemporal tactile response of Fast Adapting type I (FA-I) mechanoreceptors. We propose a novel, model -based spatiotemporal correlation matching method to estimate the orientation of the boundary edge while a piezoresistive tactile sensor array attached to robotic arm palpates over the object. Results high-light the ability of the proposed method to efficiently leverage spatial and temporal information, by obtaining very precise orientation estimates (+/- 1.67 degrees error for edges oriented from 10 degrees to 90 degrees, with a step of 5 degrees) in spite of a low-resolution sensor (169 mm(2), 4 x 4 resolution). A comparison with both spatial and spatiotemporal based classifiers indicates that the proposed method achieves 20% lower mean absolute error (MAE) than its closest counterparts, all of which required supervised training. Furthermore, we show that even with a ten-fold loss of spike time precision (1 ms-10 ms), MAE is maintained at 2 degrees. This work highlights that even with a modest sensor size and resolution, spatiotemporal similarity met-rics can be used to obtain very precise estimates of orientation. Such an approach has potential applica-tions towards improving the tactile sensing capability in robotic/prosthetic hands where knowledge of spatial edge orientation information is paramount for object manipulation, and sensor contact area is often sparse and small. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:246 / 258
页数:13
相关论文
共 41 条
[31]   Neuromorphic Artificial Touch for Categorization of Naturalistic Textures [J].
Rongala, Udaya Bhaskar ;
Mazzoni, Alberto ;
Oddo, Calogero Maria .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (04) :819-829
[32]   Texture Discrimination using a Flexible Tactile Sensor Array on a Soft Biomimetic Finger [J].
Sankar, Sriramana ;
Brown, Alisa ;
Balamurugan, Darshini ;
Nguyen, Harrison ;
Iskarous, Mark ;
Simcox, Talya ;
Kumar, Deepesh ;
Nakagawa, Andrei ;
Thakor, Nitish .
2019 IEEE SENSORS, 2019,
[33]   Which spike train distance is most suitable for distinguishing rate and temporal coding? [J].
Satuvuori, Eero ;
Kreuz, Thomas .
JOURNAL OF NEUROSCIENCE METHODS, 2018, 299 :22-33
[34]  
Spigler G, 2012, P IEEE RAS-EMBS INT, P1913, DOI 10.1109/BioRob.2012.6290849
[35]   SOME MODELS OF NEURONAL VARIABILITY [J].
STEIN, RB .
BIOPHYSICAL JOURNAL, 1967, 7 (01) :37-&
[36]   OBJECT DETECTION BY TACTILE SENSING METHOD EMPLOYING FORCE TORQUE INFORMATION [J].
TSUJIMURA, T ;
YABUTA, T .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1989, 5 (04) :444-450
[37]  
VALLBO AB, 1984, HUM NEUROBIOL, V3, P3
[38]   A novel spike distance [J].
van Rossum, MCW .
NEURAL COMPUTATION, 2001, 13 (04) :751-763
[39]   Spike train metrics [J].
Victor, JD .
CURRENT OPINION IN NEUROBIOLOGY, 2005, 15 (05) :585-592
[40]   Recognizing tactile surface roughness with a biomimetic fingertip: A soft neuromorphic approach [J].
Yi Zhengkun ;
Zhang Yilei .
NEUROCOMPUTING, 2017, 244 :102-111