Deep Learning-Based Abnormal Behavior Detection for Elderly Healthcare Using Consumer Network Cameras

被引:11
作者
Zhang, Yinlong [1 ,2 ]
Liang, Wei [1 ,2 ]
Yuan, Xudong [1 ,2 ]
Zhang, Sichao [1 ,2 ]
Yang, Geng [3 ]
Zeng, Ziming [4 ]
机构
[1] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang 110169, Peoples R China
[3] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Peoples R China
[4] Shenzhen Polytech, Sch Automot & Transportat Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Behavioral sciences; Older adults; Medical services; Cameras; Monitoring; Feature extraction; Deep learning; Elderly healthcare; abnormal behavior detection; consumer electronics; network cameras; ANOMALY DETECTION; CASCADE;
D O I
10.1109/TCE.2023.3309852
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Abnormal behavior has become the leading cause of injuries among the elderly in the modern society. Elderly anomaly is a widespread concern in both academic and industrial fields. Detection of abnormal behaviors using deep learning techniques has been pervasively investigated due to the flourishing of powerful edge computing and the decreasing costs of consumer electronics, such as commercial vision sensors. This paper intentionally designs an innovative architecture to detect the elderly typical abnormal behaviors: falls and tumbles, aggression and wandering, using the consumer network cameras, which are configured in the residential areas, healthcare centers, to name a few. Different from the conventional abnormal behavior detection methods, which suffer the issues of improper model generalization and lack of the spatial and temporal coherence, we design a deep learning model that robustly extracts the skeleton joints, detects and classifies the abnormal behaviors while considering the spatial and temporal context. It should be noted that the images are captured with the network cameras rigidly fixed at the typical elderly activity spots. The group of captured images will be fed to the local server, equipped with GPUs, for online monitoring and alarming. Our method is extensively evaluated on the elderly anomaly detection platform. It achieves the competitive performance with mAP greater than 85%.
引用
收藏
页码:2414 / 2422
页数:9
相关论文
共 37 条
[1]   Smart Gravimetric System for Enhanced Security of Accesses to Public Places Embedding a MobileNet Neural Network Classifier [J].
Addabbo, Tommaso ;
Fort, Ada ;
Mugnaini, Marco ;
Vignoli, Valerio ;
Intravaia, Matteo ;
Tani, Marco ;
Bianchini, Monica ;
Scarselli, Franco ;
Corradini, Barbara Toniella .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[2]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[3]   Modeling patterns of activities using activity curves [J].
Dawadi, Prafulla N. ;
Cook, Diane J. ;
Schmitter-Edgecombe, Maureen .
PERVASIVE AND MOBILE COMPUTING, 2016, 28 :51-68
[4]   A Survey on Anomalous Behavior Detection for Elderly Care Using Dense-Sensing Networks [J].
Deep, Samundra ;
Zheng, Xi ;
Karmakar, Chandan ;
Yu, Dongjin ;
Hamey, Leonard G. C. ;
Jin, Jiong .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2020, 22 (01) :352-370
[5]   Comparative study on poultry target tracking algorithms based on a deep regression network [J].
Fang, Cheng ;
Huang, Junduan ;
Cuan, Kaixuan ;
Zhuang, Xiaolin ;
Zhang, Tiemin .
BIOSYSTEMS ENGINEERING, 2020, 190 :176-183
[6]   A context-aware approach for long-term behavioural change detection and abnormality prediction in ambient assisted living [J].
Forkan, Abdur Rahim Mohammad ;
Khalil, Ibrahim ;
Tari, Zahir ;
Foufou, Sebti ;
Bouras, Abdelaziz .
PATTERN RECOGNITION, 2015, 48 (03) :628-641
[7]   A Survey of Driving Safety With Sensing, Vehicular Communications, and Artificial Intelligence-Based Collision Avoidance [J].
Fu, Yuchuan ;
Li, Changle ;
Yu, Fei Richard ;
Luan, Tom H. ;
Zhang, Yao .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :6142-6163
[8]   Towards effective detection of elderly falls with CNN-LSTM neural networks [J].
Garcia, Enol ;
Villar, Mario ;
Fanez, Mirko ;
Villar, Jose R. ;
de la Cal, Enrique ;
Cho, Sung-Bae .
NEUROCOMPUTING, 2022, 500 :231-240
[9]   Positive technology for elderly well-being: A review [J].
Grossi, Giuliano ;
Lanzarotti, Raffaella ;
Napoletano, Paolo ;
Noceti, Nicoletta ;
Odone, Francesca .
PATTERN RECOGNITION LETTERS, 2020, 137 :61-70
[10]  
Hao Z., An end-to-end human abnormal behavior recognitionframework for crowds with mentally disordered individuals