SKIP: Accurate Fall Detection Based on Skeleton Keypoint Association and Critical Feature Perception

被引:2
作者
Du, Chenjie [1 ]
Jin, Ran [1 ]
Tang, Hao [2 ]
Jiang, Qiuping [3 ]
He, Zhiwei [4 ]
机构
[1] Zhejiang Wanli Univ, Coll Big Data & Software Engn, Ningbo 315100, Peoples R China
[2] Swiss Fed Inst Technol, Dept Informat Technol & Elect Engn, CH-8092 Zurich, Switzerland
[3] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China
[4] Hangzhou Dianzi Univ, Fac Elect Informat, Hangzhou 310018, Peoples R China
关键词
Critical feature perception (CFP); cross-frame association; fall detection; skeleton keypoints; RECOGNITION;
D O I
10.1109/JSEN.2024.3379167
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As deep learning technology advances, human fall detection (HFD) leveraging convolutional neural networks (CNNs) has recently garnered significant interest within the research community. However, most existing works ignore the cross-frame association of skeleton keypoints and aggregation of feature representations. To address this, we first introduce an image preprocessing (IPP) module, which enhances the foreground and weakens the background. Diverging from common practices that employ the off-the-shelf detector for target position estimation, our skeleton keypoint detection and association (SKDA) module is designed to detect and cross-frame associate the skeleton keypoints with high affinity. This design reduces the misleading impact of ambiguous detections and ensures the continuity of long-range trajectories. Further, our critical feature perception (CFP) module is crafted to help the model learn more discriminative feature representations for human activity classification. Incorporating these components mentioned above, we introduce SKIP, a novel human fall detection approach, showcasing improved detection precision. Evaluations on the publicly available telecommunication system team v2 (TSTv2) and self-build datasets show SKIP's superior performance.
引用
收藏
页码:14812 / 14824
页数:13
相关论文
共 54 条
[1]  
Alexey B., 2020, DarkNet: Open Source Neural Networks in Python
[2]   Radar Signal Processing for Elderly Fall Detection The future for in-home monitoring [J].
Amin, Moeness G. ;
Zhang, Yimin D. ;
Ahmad, Fauzia ;
Ho, K. C. .
IEEE SIGNAL PROCESSING MAGAZINE, 2016, 33 (02) :71-80
[3]   Multimodal spatiotemporal skeletal kinematic gait feature fusion for vision-based fall detection [J].
Amsaprabhaa, M. ;
Jane, Y. Nancy ;
Nehemiah, H. Khanna .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 212
[4]  
Bewley A, 2016, IEEE IMAGE PROC, P3464, DOI 10.1109/ICIP.2016.7533003
[5]   OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields [J].
Cao, Zhe ;
Hidalgo, Gines ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) :172-186
[6]   Optimized spatio-temporal descriptors for real-time fall detection: comparison of support vector machine and Adaboost-based classification [J].
Charfi, Imen ;
Miteran, Johel ;
Dubois, Julien ;
Atri, Mohamed ;
Tourki, Rached .
JOURNAL OF ELECTRONIC IMAGING, 2013, 22 (04)
[7]   A simple vision-based fall detection technique for indoor video surveillance [J].
Chua, Jia-Luen ;
Chang, Yoong Choon ;
Lim, Wee Keong .
SIGNAL IMAGE AND VIDEO PROCESSING, 2015, 9 (03) :623-633
[8]   Smart Seismic Sensing for Indoor Fall Detection, Location, and Notification [J].
Clemente, Jose ;
Li, Fangyu ;
Valero, Maria ;
Song, WenZhan .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (02) :524-532
[9]   Audio Metric Learning by Using Siamese Autoencoders for One-Shot Human Fall Detection [J].
Droghini, Diego ;
Squartini, Stefano ;
Principi, Emanuele ;
Gabrielli, Leonardo ;
Piazza, Francesco .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2021, 5 (01) :108-118
[10]   Wavelet-Based Sit-To-Stand Detection and Assessment of Fall Risk in Older People Using a Wearable Pendant Device [J].
Ejupi, Andreas ;
Brodie, Matthew ;
Lord, Stephen R. ;
Annegarn, Janneke ;
Redmond, Stephen J. ;
Delbaere, Kim .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2017, 64 (07) :1602-1607