Touch Modality Classification Using Recurrent Neural Networks

被引:18
作者
Alameh, Mohamad [1 ]
Abbass, Yahya [1 ]
Ibrahim, Ali [1 ,2 ]
Moser, Gabriele [1 ]
Valle, Maurizio [1 ]
机构
[1] Univ Genoa, Dept Elect Elect Telecommun Engn & Naval Architec, I-16145 Genoa, Italy
[2] Lebanese Int Univ, Dept Elect & Elect Engn, Beirut 1105, Lebanon
基金
欧盟地平线“2020”;
关键词
Sensors; Sensor arrays; Tactile sensors; Feature extraction; Recurrent neural networks; Complexity theory; Hardware; Tactile sensing systems; recurrent neural network; deep learning; tactile data classification; ELECTRONIC SKIN; TACTILE;
D O I
10.1109/JSEN.2021.3055565
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recurrent Neural Networks (RNNs) are mainly designed to deal with sequence prediction problems and they show their effectiveness in processing data originally represented as time series. This paper investigates the time series characteristics of RNNs to classify touch modalities represented as spatio temporal 3D tensor data. Different approaches are followed in order to propose efficient RNN models aimed at tactile data classification. The main idea is to capture long-term dependence from data that can be used to deal with long sequences represented by employing Gated Recurrent Unit (GRU) and Long Short-Term Memory (LSTM) architectures. Moreover, a case specific approach to dataset organization of the 3D tensor data is presented. The target is to provide efficient hardware-friendly touch modality classification approaches suitable for embedded applications. To this end, the proposed work achieves effective performance in terms of hardware complexity by reducing the FLOPS by 99.98 and the memory storage by 98.34, with respect to the state-of-art solutions on the same benchmark dataset. This directly affects the time latency and energy consumption of the embedded hardware. Besides, the implemented models shows a classification accuracy higher than those state-of-art solutions. Results demonstrate that the proposed computing architecture is scalable showing acceptable complexity when the system is scaled up in terms of input matrix size and number of classes to be recognized.
引用
收藏
页码:9983 / 9993
页数:11
相关论文
共 47 条
[1]  
Abderrahmane Z, 2018, I C CONT AUTOMAT ROB, P1765, DOI 10.1109/ICARCV.2018.8581230
[2]   Smart Tactile Sensing Systems Based on Embedded CNN Implementations [J].
Alameh, Mohamad ;
Abbass, Yahya ;
Ibrahim, Ali ;
Valle, Maurizio .
MICROMACHINES, 2020, 11 (01)
[3]  
Alameh M, 2019, 2019 15TH CONFERENCE ON PHD RESEARCH IN MICROELECTRONICS AND ELECTRONICS (PRIME), P237, DOI [10.1109/PRIME.2019.8787748, 10.1109/prime.2019.8787748]
[4]  
[Anonymous], 2014, Comput. Sci.
[5]  
[Anonymous], 2016, NAACL
[6]  
[Anonymous], 2017, ARXIV170201923
[7]   SURF: Speeded up robust features [J].
Bay, Herbert ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2006 , PT 1, PROCEEDINGS, 2006, 3951 :404-417
[8]   A Comprehensive Realization of Robot Skin: Sensors, Sensing, Control, and Applications [J].
Cheng, Gordon ;
Dean-Leon, Emmanuel ;
Bergner, Florian ;
Olvera, Julio Rogelio Guadarrama ;
Leboutet, Quentin ;
Mittendorfer, Philipp .
PROCEEDINGS OF THE IEEE, 2019, 107 (10) :2034-2051
[9]  
Cho K., 2014, P C EMP METH NAT LAN, P1724, DOI [10.3115/v1/D14-1179, DOI 10.3115/V1/D14-1179]
[10]   Large-Area Soft e-Skin: The Challenges Beyond Sensor Designs [J].
Dahiya, Ravinder ;
Yogeswaran, Nivasan ;
Liu, Fengyuan ;
Manjakkal, Libu ;
Burdet, Etienne ;
Hayward, Vincent ;
Jorntell, Henrik .
PROCEEDINGS OF THE IEEE, 2019, 107 (10) :2016-2033