Video-Based Hand Movement Analysis of Parkinson Patients before and after Medication Using High-Frame-Rate Videos and MediaPipe

被引：25

作者：

Gueney, Gokhan ^{[1
]}

Jansen, Talisa S. ^{[2
]}

Dill, Sebastian ^{[1
]}

Schulz, Joerg B. ^{[2
,3
,4
]}

Dafotakis, Manuel ^{[2
]}

Antink, Christoph Hoog ^{[1
]}

Braczynski, Anne K. ^{[2
,5
]}

机构：

[1] Tech Univ Darmstadt, KIS MED AI Syst Med, Merckstr 25, D-64283 Darmstadt, Germany

[2] RWTH Univ Hosp, Dept Neurol, D-52074 Aachen, Germany

[3] FZ Julich, Julich Aachen Res Alliance JARA, JARA Inst Mol Neurosci & Neuroimaging, D-52428 Julich, Germany

[4] RWTH Univ, D-52428 Julich, Germany

[5] Heinrich Heine Univ, Inst Phys Biol, D-40225 Dusseldorf, Germany

来源：

SENSORS | 2022年 / 22卷 / 20期

关键词：

Parkinson's disease; tremor; video-based analyses; mediapipe; artificial intelligence;

D O I：

10.3390/s22207992

中图分类号：

O65 [分析化学];

学科分类号：

070302 ; 081704 ;

摘要：

Tremor is one of the common symptoms of Parkinson's disease (PD). Thanks to the recent evolution of digital technologies, monitoring of PD patients' hand movements employing contactless methods gained momentum. Objective: We aimed to quantitatively assess hand movements in patients suffering from PD using the artificial intelligence (AI)-based hand-tracking technologies of MediaPipe. Method: High-frame-rate videos and accelerometer data were recorded from 11 PD patients, two of whom showed classical Parkinsonian-type tremor. In the OFF-state and 30 Minutes after taking their standard oral medication (ON-state), video recordings were obtained. First, we investigated the frequency and amplitude relationship between the video and accelerometer data. Then, we focused on quantifying the effect of taking standard oral treatments. Results: The data extracted from the video correlated well with the accelerometer-based measurement system. Our video-based approach identified the tremor frequency with a small error rate (mean absolute error 0.229 (+/- 0.174) Hz) and an amplitude with a high correlation. The frequency and amplitude of the hand movement before and after medication in PD patients undergoing medication differ. PD Patients experienced a decrease in the mean value for frequency from 2.012 (+/- 1.385) Hz to 1.526 (+/- 1.007) Hz and in the mean value for amplitude from 8.167 (+/- 15.687) a.u. to 4.033 (+/- 5.671) a.u. Conclusions: Our work achieved an automatic estimation of the movement frequency, including the tremor frequency with a low error rate, and to the best of our knowledge, this is the first paper that presents automated tremor analysis before/after medication in PD, in particular using high-frame-rate video data.

引用

页数：15