Vision-Based Fall Event Detection in Complex Background Using Attention Guided Bi-Directional LSTM

被引:43
作者
Chen, Yong [1 ]
Li, Weitong [1 ]
Wang, Lu [1 ]
Hu, Jiajia [1 ]
Ye, Mingbin [1 ]
机构
[1] Guangdong Univ Technol, Sch Informat Engn, Guangzhou 510006, Peoples R China
关键词
Feature extraction; Event detection; Bidirectional control; Sensors; Machine learning; Accelerometers; Shape; Fall detection; solitary scene; deep learning; LSTM; attention mechanism; DETECTION SYSTEM; SURVEILLANCE; MIXTURE; MODEL;
D O I
10.1109/ACCESS.2020.3021795
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Fall event, as one of the greatest risks to the elderly, its detection has been a hot research issue in the solitary scene in recent years. Nevertheless, most current researches are conducted in the ideal environments, without considering the challenge of complex background in real situation. Therefore, this paper aims to detect fall event detection in complex background based on visual data. Different from most conventional background subtraction methods which depend on background modeling, Mask R-CNN method is first used to accurately extract the moving objects in the noise background. Then, an attention guided Bi-directional LSTM model is proposed for the final fall event detection. To demonstrate the efficiency, the proposed method is verified in the public dataset and self-build dataset. Evaluation of the algorithm performances in comparison with other state-of-the-art methods indicates that the proposed design is accurate and robust, which means it is suitable for the task of fall event detection in complex situation.
引用
收藏
页码:161337 / 161348
页数:12
相关论文
共 68 条
[11]  
Bouwmans T., 2014, Background modeling and foreground detection for video surveillance
[12]   Deep neural network concepts for background subtraction: A systematic review and comparative evaluation [J].
Bouwmans, Thierry ;
Jayed, Sajid ;
Sultana, Maryam ;
Jung, Soon Ki .
NEURAL NETWORKS, 2019, 117 :8-66
[13]  
Chaitep T, 2017, 2017 14TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), P183, DOI 10.1109/ECTICon.2017.8096203
[14]  
Charfi I, 2012, 8TH INTERNATIONAL CONFERENCE ON SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS (SITIS 2012), P218, DOI 10.1109/SITIS.2012.155
[15]   Panning and Jitter Invariant Incremental Principal Component Pursuit for Video Background Modeling [J].
Chau, Gustavo ;
Rodriguez, Paul .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :1844-1852
[16]   A Framework for Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals [J].
Cheng, Juan ;
Chen, Xiang ;
Shen, Minfen .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2013, 17 (01) :38-45
[17]  
El Baf F, 2008, LECT NOTES COMPUT SC, V5358, P772, DOI 10.1007/978-3-540-89639-5_74
[18]   Spatio-temporal fall event detection in complex scenes using attention guided LSTM [J].
Feng, Qi ;
Gao, Chenqiang ;
Wang, Lan ;
Zhao, Yue ;
Song, Tiecheng ;
Li, Qiang .
PATTERN RECOGNITION LETTERS, 2020, 130 (130) :242-249
[19]   Background subtraction in real applications: Challenges, current models and future directions [J].
Garcia-Garcia, Belmar ;
Bouwmans, Thierry ;
Rosales Silva, Alberto Jorge .
COMPUTER SCIENCE REVIEW, 2020, 35 (35)
[20]   Proposal and Experimental Evaluation of Fall Detection Solution Based on Wearable and Depth Data Fusion [J].
Gasparrini, Samuele ;
Cippitelli, Enea ;
Gambi, Ennio ;
Spinsante, Susanna ;
Wahslen, Jonas ;
Orhan, Ibrahim ;
Lindh, Thomas .
ICT INNOVATIONS 2015: EMERGING TECHNOLOGIES FOR BETTER LIVING, 2016, 399 :99-108