SKIP: Accurate Fall Detection Based on Skeleton Keypoint Association and Critical Feature Perception

被引:1
作者
Du, Chenjie [1 ]
Jin, Ran [1 ]
Tang, Hao [2 ]
Jiang, Qiuping [3 ]
He, Zhiwei [4 ]
机构
[1] Zhejiang Wanli Univ, Coll Big Data & Software Engn, Ningbo 315100, Peoples R China
[2] Swiss Fed Inst Technol, Dept Informat Technol & Elect Engn, CH-8092 Zurich, Switzerland
[3] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China
[4] Hangzhou Dianzi Univ, Fac Elect Informat, Hangzhou 310018, Peoples R China
关键词
Critical feature perception (CFP); cross-frame association; fall detection; skeleton keypoints; RECOGNITION;
D O I
10.1109/JSEN.2024.3379167
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As deep learning technology advances, human fall detection (HFD) leveraging convolutional neural networks (CNNs) has recently garnered significant interest within the research community. However, most existing works ignore the cross-frame association of skeleton keypoints and aggregation of feature representations. To address this, we first introduce an image preprocessing (IPP) module, which enhances the foreground and weakens the background. Diverging from common practices that employ the off-the-shelf detector for target position estimation, our skeleton keypoint detection and association (SKDA) module is designed to detect and cross-frame associate the skeleton keypoints with high affinity. This design reduces the misleading impact of ambiguous detections and ensures the continuity of long-range trajectories. Further, our critical feature perception (CFP) module is crafted to help the model learn more discriminative feature representations for human activity classification. Incorporating these components mentioned above, we introduce SKIP, a novel human fall detection approach, showcasing improved detection precision. Evaluations on the publicly available telecommunication system team v2 (TSTv2) and self-build datasets show SKIP's superior performance.
引用
收藏
页码:14812 / 14824
页数:13
相关论文
共 54 条
  • [1] Alexey A. B., 2020, DarkNet: Open Source Neural Networks in Python
  • [2] Radar Signal Processing for Elderly Fall Detection The future for in-home monitoring
    Amin, Moeness G.
    Zhang, Yimin D.
    Ahmad, Fauzia
    Ho, K. C.
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2016, 33 (02) : 71 - 80
  • [3] Multimodal spatiotemporal skeletal kinematic gait feature fusion for vision-based fall detection
    Amsaprabhaa, M.
    Jane, Y. Nancy
    Nehemiah, H. Khanna
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 212
  • [4] Bewley A, 2016, IEEE IMAGE PROC, P3464, DOI 10.1109/ICIP.2016.7533003
  • [5] OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
    Cao, Zhe
    Hidalgo, Gines
    Simon, Tomas
    Wei, Shih-En
    Sheikh, Yaser
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) : 172 - 186
  • [6] Optimized spatio-temporal descriptors for real-time fall detection: comparison of support vector machine and Adaboost-based classification
    Charfi, Imen
    Miteran, Johel
    Dubois, Julien
    Atri, Mohamed
    Tourki, Rached
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2013, 22 (04)
  • [7] A simple vision-based fall detection technique for indoor video surveillance
    Chua, Jia-Luen
    Chang, Yoong Choon
    Lim, Wee Keong
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2015, 9 (03) : 623 - 633
  • [8] Smart Seismic Sensing for Indoor Fall Detection, Location, and Notification
    Clemente, Jose
    Li, Fangyu
    Valero, Maria
    Song, WenZhan
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (02) : 524 - 532
  • [9] Audio Metric Learning by Using Siamese Autoencoders for One-Shot Human Fall Detection
    Droghini, Diego
    Squartini, Stefano
    Principi, Emanuele
    Gabrielli, Leonardo
    Piazza, Francesco
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2021, 5 (01): : 108 - 118
  • [10] Wavelet-Based Sit-To-Stand Detection and Assessment of Fall Risk in Older People Using a Wearable Pendant Device
    Ejupi, Andreas
    Brodie, Matthew
    Lord, Stephen R.
    Annegarn, Janneke
    Redmond, Stephen J.
    Delbaere, Kim
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2017, 64 (07) : 1602 - 1607