Deep-learning-based human activity recognition for Alzheimer's patients' daily life activities assistance

被引:17
作者
Snoun, Ahmed [1 ]
Bouchrika, Tahani [1 ]
Jemai, Olfa [1 ]
机构
[1] Univ Gabes, Natl Engn Sch Gabes ENIG, Res Team Intelligent Machines RTIM, Gabes 6029, Tunisia
关键词
Alzheimer; Assistance; CNN; Transformer; Reinforcement learning; ADLs;
D O I
10.1007/s00521-022-07883-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Alzheimer's disease is considered as one of the most well-known illnesses in the elderly. It is a neurodegenerative and irreversible brain disorder that slowly destroys memory, thinking ability, and ultimately the ability to perform even basic daily tasks. In fact, people suffering from this disorder have difficulty remembering events, recognizing objects and faces, remembering the meaning of words, and developing judgment. As a result, their cognitive abilities are impaired and they are unable to perform activities of daily living independently. Therefore, patients need constant support to carry out their daily activities. In this study, we propose a new support system to support patients with Alzheimer's disease to carry out their daily tasks independently. The proposed assistance systems are composed of two parts. The first is a human activity recognition (HAR) module to monitor the patient behaviour. Here, we proposed two HAR systems. The first is based on 2D skeleton data and convolution neural network, and the second is based on 3D skeleton and transformers. The second part of the assistance systems consists of a support module that recognizes the patient's behavioural abnormalities and issues appropriate warnings. Here, we also proposed two methods. The first is based on a simple conditional structure, and the second is based on a reinforcement learning technique. As a result, we obtain four different assistance systems for Alzheimer's patients. Finally, a comparative study between the four systems was carried out in terms of performance and time complexity using the DemCare dataset.
引用
收藏
页码:1777 / 1802
页数:26
相关论文
共 55 条
  • [1] Alzheimer's A., 2016, Alzheimers Dement, V12, P459, DOI [10.1016/j.jalz.2016.03.001, DOI 10.1016/J.JALZ.2016.03.001]
  • [2] Activity detection using Sequential Statistical Boundary Detection (SSBD)
    Avgerinakis, Konstantinos
    Briassouli, Alexia
    Kompatsiaris, Yiannis
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2016, 144 : 46 - 61
  • [3] Keyword Transformer: A Self-Attention Model for Keyword Spotting
    Berg, Axel
    O'Connor, Mark
    Cruz, Miguel Tairum
    [J]. INTERSPEECH 2021, 2021, : 4249 - 4253
  • [4] Action Recognition with Dynamic Image Networks
    Bilen, Hakan
    Fernando, Basura
    Gavves, Efstratios
    Vedaldi, Andrea
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (12) : 2799 - 2813
  • [5] CAMPBELL LW, 1995, FIFTH INTERNATIONAL CONFERENCE ON COMPUTER VISION, PROCEEDINGS, P624, DOI 10.1109/ICCV.1995.466880
  • [6] OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
    Cao, Zhe
    Hidalgo, Gines
    Simon, Tomas
    Wei, Shih-En
    Sheikh, Yaser
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) : 172 - 186
  • [7] Chen H, 2018, IEEE Trans. Vis. Comput. Graph., V23, P1
  • [8] Elderly activities recognition and classification for applications in assisted living
    Chernbumroong, Saisakul
    Cang, Shuang
    Atkins, Anthony
    Yu, Hongnian
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (05) : 1662 - 1674
  • [9] Devanne M, 2013, LECT NOTES COMPUT SC, V8158, P456, DOI 10.1007/978-3-642-41190-8_49
  • [10] Division UP, 2019, WORLD POP AG 2019 HI, P37