Flexible touch and gesture recognition system for curved surfaces with machine learning for assistive applications

被引:2
作者
Verma, Gitansh [1 ]
Sarma, Shrutidhara [1 ,2 ]
Koch, Eugen [2 ]
Dietzel, Andreas [2 ]
机构
[1] IIT Jodhpur, Dept Mech Engn, Jodhpur 342030, Rajasthan, India
[2] TU Braunschweig, Inst Microtechnol, Alte Salzdahlumer Str 203, D-38124 Braunschweig, Germany
关键词
Screen printing; Touch and bending sensing patch; Machine Learning; Evaluation Electronics; SENSOR;
D O I
10.1016/j.snr.2025.100284
中图分类号
Q81 [生物工程学(生物技术)]; Q93 [微生物学];
学科分类号
071005 ; 0836 ; 090102 ; 100705 ;
摘要
Touch is a fundamental mode of human-machine interaction and ability to monitor tactile pressure, recognize gestures and location of touch are crucial for touch-based technologies. However, achieving reliable touch sensing on curved surfaces remains challenging as flexing often disrupts the stability of sensor outputs and diminishes sensitivity, especially in dynamic environments. This study presents the development of a flexible multi-element touch sensing patch that can monitor its bending state as well as detect pressure with a sensitivity of 0.827 kPa(-1). The patch is fabricated using resistive strain sensors, screen printed onto a PET sheet with a foam backing. Evaluation electronics were integrated to ensure stable, noise-free signal acquisition, and output was processed with machine learning (ML) algorithms to classify gestures such as single and double finger taps, swipes, and touch locations, with 93 % accuracy, on both flat and curved surfaces. Based on the identified gesture, the system enables users to type text or control external devices with minimal physical effort. Its scalable fabrication, high sensitivity, mechanical resilience and seamless ML integration establishes it as a powerful and efficient tool for assistive technologies, designed to support individuals with limited speech and mobility, such as those with quadriplegia or paralysis.
引用
收藏
页数:11
相关论文
共 44 条
[1]   Highly sensitive screen printed strain sensors on flexible substrates via ink composition optimization [J].
Anderson, Nickolas ;
Szorc, Nicole ;
Gunasekaran, Vimal ;
Joshi, Shiv ;
Jursich, Gregory .
SENSORS AND ACTUATORS A-PHYSICAL, 2019, 290 :1-7
[2]   A linear and large-range pressure sensor based on a graphene/silver nanowires nanobiocomposites network and a hierarchical structural sponge [J].
Dong, Xuchu ;
Wei, Yong ;
Chen, Song ;
Lin, Yong ;
Liu, Lan ;
Li, Jing .
COMPOSITES SCIENCE AND TECHNOLOGY, 2018, 155 :108-116
[3]   Multiobjective evolutionary algorithms to identify highly autocorrelated areas: the case of spatial distribution in financially compromised farms [J].
Garcia-Alonso, Carlos R. ;
Perez-Naranjo, Leonor M. ;
Fernandez-Caballero, Juan C. .
ANNALS OF OPERATIONS RESEARCH, 2014, 219 (01) :187-202
[4]   Human touch sensation-inspired, ultrawide-sensing-range, and high-robustness flexible piezoresistive sensor based on CB/MXene/SR/fiber nanocomposites for wearable electronics [J].
Guo, Xiaohui ;
Hong, Weiqiang ;
Hu, Bing ;
Zhang, Tianxu ;
Jin, Chengchao ;
Yao, Xiaomeng ;
Li, Hongjin ;
Yan, Zihao ;
Jiao, Ziyang ;
Wang, Ming ;
Ye, Bin ;
Wei, Siqi ;
Xia, Yun ;
Hong, Qi ;
Xu, Yaohua ;
Zhao, Yunong .
COMPOSITE STRUCTURES, 2023, 321
[5]   Machine Learning-Enabled Intelligent Gesture Recognition and Communication System Using Printed Strain Sensors [J].
Hu, Minglu ;
He, Pei ;
Zhao, Weikai ;
Zeng, Xianghui ;
He, Jiaorui ;
Chen, Yucheng ;
Xu, Xiaowen ;
Sun, Jia ;
Li, Zheling ;
Yang, Junliang .
ACS APPLIED MATERIALS & INTERFACES, 2023, 15 (44) :51360-51369
[6]  
Hu RJ, 2024, Applied and Computational Engineering, V30, P94, DOI [10.54254/2755-2721/30/20230080, 10.54254/2755-2721/30/20230080, DOI 10.54254/2755-2721/30/20230080]
[7]   A Simple, Inexpensive, Wearable Glove with Hybrid Resistive-Pressure Sensors for Computational Sensing, Proprioception, and Task Identification [J].
Hughes, Josie ;
Spielberg, Andrew ;
Chounlakone, Mark ;
Chang, Gloria ;
Matusik, Wojciech ;
Rus, Daniela .
ADVANCED INTELLIGENT SYSTEMS, 2020, 2 (06)
[8]   Porous AgNWs/Poly(vinylidene fluoride) Composite-Based Flexible Piezoresistive Sensor with High Sensitivity and Wide Pressure Ranges [J].
Jing, Mengyuan ;
Zhou, Jing ;
Zhang, Pengchao ;
Hou, Dajun ;
Shen, Jie ;
Tian, Jing ;
Chen, Wen .
ACS APPLIED MATERIALS & INTERFACES, 2022, 14 (49) :55119-55129
[9]   Multiple predicting K-fold cross-validation for model selection [J].
Jung, Yoonsuh .
JOURNAL OF NONPARAMETRIC STATISTICS, 2018, 30 (01) :197-215
[10]   Surface reconstruction by means of a flexible sensor array [J].
Koch, Eugen ;
Dietzel, Andreas .
SENSORS AND ACTUATORS A-PHYSICAL, 2017, 267 :293-300