Perception of Tactile Directionality via Artificial Fingerpad Deformation and Convolutional Neural Networks

被引:7
作者
Gutierrez, Kenneth [1 ]
Santos, Veronica J. [2 ]
机构
[1] Univ Calif Los Angeles, Los Angeles, CA 90095 USA
[2] Univ Calif Los Angeles, Mech & Aerosp Engn Dept, Los Angeles, CA 90095 USA
基金
美国国家科学基金会;
关键词
Perturbation methods; Tactile sensors; Force; Strain; Electrodes; Convolutional neural networks; manipulation; robot; skin displacement; tactile directionality; tactile images; tactile perception; tactile sensors; THUMB RESPONSES; OBJECT HELD; GRIP FORCE; REPRESENTATION; AFFERENTS; RESTRAINT; TEXTURES; SIGNALS; SLIP; SKIN;
D O I
10.1109/TOH.2020.2975555
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Humans can perceive tactile directionality with angular perception thresholds of 14-40 degrees via fingerpad skin displacement. Using deformable, artificial tactile sensors, the ability to perceive tactile directionality was developed for a robotic system to aid in object manipulation tasks. Two convolutional neural networks (CNNs) were trained on tactile images created from fingerpad deformation measurements during perturbations to a handheld object. A primary CNN regression model provided a point estimate of tactile directionality over a range of grip forces, perturbation angles, and perturbation speeds. A secondary CNN model provided a variance estimate that was used to determine uncertainty about the point estimate. A 5-fold cross-validation was performed to evaluate model performance. The primary CNN produced tactile directionality point estimates with an error rate of 4.3% for a 20 degrees angular resolution and was benchmarked against an open-source force estimation network. The model was implemented in real-time for interactions with an external agent and the environment with different object shapes and widths. The perception of tactile directionality could be used to enhance the situational awareness of human operators of telerobotic systems and to develop decision-making algorithms for context-appropriate responses by semi-autonomous robots.
引用
收藏
页码:831 / 839
页数:9
相关论文
共 50 条
[41]   SUPERPIXEL SEGMENTATION VIA CONVOLUTIONAL NEURAL NETWORKS WITH REGULARIZED INFORMATION MAXIMIZATION [J].
Suzuki, Teppei .
2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, :2573-2577
[42]   Hierarchical Services of Convolutional Neural Networks via Probabilistic Selective Encryption [J].
Tian, Jinyu ;
Zhou, Jiantao ;
Duan, Jia .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (01) :343-355
[43]   Hand Gesture Recognition via Radar Sensors and Convolutional Neural Networks [J].
Franceschini, S. ;
Ambrosanio, M. ;
Vitale, S. ;
Baselice, F. ;
Gifuni, A. ;
Grassini, G. ;
Pascazio, V .
2020 IEEE RADAR CONFERENCE (RADARCONF20), 2020,
[44]   Examining Gender Bias of Convolutional Neural Networks via Facial Recognition [J].
Gwyn, Tony ;
Roy, Kaushik .
FUTURE INTERNET, 2022, 14 (12)
[45]   Classification of Grain Discoloration via Transfer Learning and Convolutional Neural Networks [J].
Nghia Duong-Trung ;
Luyl-Da Quach ;
Minh-Hoang Nguyen ;
Chi-Ngon Nguyen .
PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING (ICMLSC 2019), 2019, :27-32
[46]   AM-SGCN: Tactile Object Recognition for Adaptive Multichannel Spiking Graph Convolutional Neural Networks [J].
Yang, Jing ;
Liu, Tingqing ;
Ren, Yaping ;
Hou, Qing ;
Li, Shaobo ;
Hu, Jianjun .
IEEE SENSORS JOURNAL, 2023, 23 (24) :30805-30820
[47]   On Human-like Biases in Convolutional Neural Networks for the Perception of Slant from Texture [J].
Wang, Yuanhao ;
Zhang, Qian ;
Aubuchon, Celine ;
Kemp, Jovan ;
Domini, Fulvio ;
Tompkin, James .
ACM TRANSACTIONS ON APPLIED PERCEPTION, 2023, 20 (04)
[48]   Accelerating Algebraic Multigrid Methods via Artificial Neural Networks [J].
Paola F. Antonietti ;
Matteo Caldana ;
Luca Dede’ .
Vietnam Journal of Mathematics, 2023, 51 :1-36
[49]   Accelerating Algebraic Multigrid Methods via Artificial Neural Networks [J].
Antonietti, Paola F. ;
Caldana, Matteo ;
Dede', Luca .
VIETNAM JOURNAL OF MATHEMATICS, 2023, 51 (1) :1-36
[50]   Understanding the Basis of Graph Convolutional Neural Networks via an Intuitive Matched Filtering Approach [Lecture Notes] [J].
Stankovica, Ljubisa ;
Mandic, Danilo P. .
IEEE SIGNAL PROCESSING MAGAZINE, 2023, 40 (02) :155-165