Accurate and Efficient Sitting Posture Recognition and Human-Machine Interaction Device Based on Fabric Pressure Sensor Array and Neural Network

被引:4
作者
Zhong, Weibing [1 ]
Xu, Hui [1 ]
Ke, Yiming [2 ]
Ming, Xiaojuan [2 ]
Jiang, Haiqing [1 ]
Li, Mufang [1 ]
Wang, Dong [1 ,2 ]
机构
[1] Wuhan Text Univ, Key Lab Text Fiber & Prod, Minist Educ, Wuhan 430200, Peoples R China
[2] Donghua Univ, Coll Chem & Chem Engn, Shanghai 201620, Peoples R China
基金
中国国家自然科学基金;
关键词
deep-learning; fabric-based sensors; human-machine interaction; posture recognition; pressure sensors array;
D O I
10.1002/admt.202301579
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This article presents a novel approach to interact with users through posture recognition, leveraging its advantages of convenience and real-time feedback to enhance user engagement and personalized experiences. In contrast to traditional methods that rely on camera-based posture detection, this study proposes a deep learning-based framework for posture recognition by classifying the distribution of body pressure under different sitting positions. The system integrates a large-area, highly flexible fabric pressure sensor array into the chair, which collects data on posture-specific pressure patterns for training and identification purposes. A deep learning algorithm, specifically the LeNet architecture, is employed to classify 49 different sitting positions based on angular variations, including body tilt to the left or right, standard posture, and forward or backward leaning. The proposed approach achieves an impressive accuracy rate of 99.86%. Furthermore, the application of this posture recognition system in VR devices enables intelligent chair control for VR games. This research provides strong support for future advancements in chair design and human-computer interaction technologies, enhancing ergonomic designs in various domains such as automotive seats, office chairs, and medical seating, while simultaneously improving user comfort and well-being. A new human-machine interaction method is presented using fabric pressure sensors and deep learning, achieving 99.86% accurate sitting posture classification. It enables race car control based on posture recognition.image
引用
收藏
页数:10
相关论文
共 32 条
[1]   Computer vision algorithms acceleration using graphic processors NVIDIA CUDA [J].
Afif, Mouna ;
Said, Yahia ;
Atri, Mohamed .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2020, 23 (04) :3335-3347
[2]   Flexible piezocapacitive sensors based on wrinkled microstructures: toward low-cost fabrication of pressure sensors over large areas [J].
Baek, Seolhee ;
Jang, Hayeong ;
Kim, So Young ;
Jeong, Heejeong ;
Han, Singu ;
Jang, Yunseok ;
Kim, Do Hwan ;
Lee, Hwa Sung .
RSC ADVANCES, 2017, 7 (63) :39420-39426
[3]   Feature selection in image analysis: a survey [J].
Bolon-Canedo, Veronica ;
Remeseiro, Beatriz .
ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (04) :2905-2931
[4]   Spatial Attention Fusion for Obstacle Detection Using MmWave Radar and Vision Sensor [J].
Chang, Shuo ;
Zhang, Yifan ;
Zhang, Fan ;
Zhao, Xiaotong ;
Huang, Sai ;
Feng, Zhiyong ;
Wei, Zhiqing .
SENSORS, 2020, 20 (04)
[5]   Deep learning-based facial emotion recognition for human-computer interaction applications [J].
Chowdary, M. Kalpana ;
Nguyen, Tu N. ;
Hemanth, D. Jude .
NEURAL COMPUTING & APPLICATIONS, 2023, 35 (32) :23311-23328
[6]   Resolution limit of image analysis algorithms [J].
Cohen, Edward A. K. ;
Abraham, Anish, V ;
Ramakrishnan, Sreevidhya ;
Ober, Raimund J. .
NATURE COMMUNICATIONS, 2019, 10 (1)
[7]   A novel type of activation function in artificial neural networks: Trained activation function [J].
Ertugrul, Omer Faruk .
NEURAL NETWORKS, 2018, 99 :148-157
[8]  
Grubert J., 2020, ARXIV, DOI [10.17863/CAM.57784, DOI 10.17863/CAM.57784]
[9]   An Overview of the Development of Flexible Sensors [J].
Han, Su-Ting ;
Peng, Haiyan ;
Sun, Qijun ;
Venkatesh, Shishir ;
Chung, Kam-Sing ;
Lau, Siu Chuen ;
Zhou, Ye ;
Roy, V. A. L. .
ADVANCED MATERIALS, 2017, 29 (33)
[10]   Emerging Technologies of Flexible Pressure Sensors: Materials, Modeling, Devices, and Manufacturing [J].
Huang, Yan ;
Fan, Xiangyu ;
Chen, Shih-Chi ;
Zhao, Ni .
ADVANCED FUNCTIONAL MATERIALS, 2019, 29 (12)