Analysis of facial expressions in parkinson's disease through video-based automatic methods

被引:81
作者
Bandini, Andrea [1 ,2 ]
Orlandi, Silvia [1 ]
Escalante, Hugo Jair [3 ]
Giovannelli, Fabio [4 ]
Cincotta, Massimo [4 ]
Reyes-Garcia, Carlos A. [3 ]
Vanni, Paola [4 ]
Zaccara, Gaetano [4 ]
Manfredi, Claudia [1 ]
机构
[1] Univ Firenze, Dept Informat Engn, Via S Marta 3, I-50139 Florence, Italy
[2] Univ Bologna, Dept Elect Elect & Informat Engn DEI Guglielmo Ma, Viale Risorgimento 2, I-40136 Bologna, Italy
[3] INAOE, Dept Comp Sci, Luis Enrique Erro 1, Tonantzintla 72840, Puebla, Mexico
[4] Osped Nuovo San Giovanni Dio, Unit Neurol Florence Hlth Autor, Via Torregalli 3, Florence, Italy
关键词
Parkinson's disease; Hypomimia; Automatic facial expression recognition; Facial mimicry; Contactless; Video-based; RECOGNITION; EMOTION; IMPRESSIONS; FACES;
D O I
10.1016/j.jneumeth.2017.02.006
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Background: The automatic analysis of facial expressions is an evolving field that finds several clinical applications. One of these applications is the study of facial bradykinesia in Parkinson's disease (PD), which is a major motor sign of this neurodegenerative illness. Facial bradykinesia consists in the reduction/loss of facial movements and emotional facial expressions called hypomimia. New method: In this work we propose an automatic method for studying facial expressions in PD patients relying on video-based Methods: 17 Parkinsonian patients and 17 healthy control subjects were asked to show basic facial expressions, upon request of the clinician and after the imitation of a visual cue on a screen. Through an existing face tracker, the Euclidean distance of the facial model from a neutral baseline was computed in order to quantify the changes in facial expressivity during the tasks. Moreover, an automatic facial expressions recognition algorithm was trained in order to study how PD expressions differed from the standard expressions. Results: Results show that control subjects reported on average higher distances than PD patients along the tasks. Comparison with existing methods: This confirms that control subjects show larger movements during both posed and imitated facial expressions. Moreover, our results demonstrate that anger and disgust are the two most impaired expressionS in PD patients. Conclusions: Contactless video-based systems can be important techniques for analyzing facial expressions also in rehabilitation, in particular speech therapy, where patients could get a definite advantage from a real-time feedback about the proper facial expressions/movements to perform. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:7 / 20
页数:14
相关论文
共 47 条
[1]  
[Anonymous], 1977, FACIAL ACTION CODING
[2]  
[Anonymous], 2006, BRIT MACH VIS C
[3]  
[Anonymous], 2012, FACE EXPRESSION RECO
[4]  
Bandini A., 2015, P MAVEBA FIR IT, P99
[5]   Markerless Analysis of Articulatory Movements in Patients With Parkinson's Disease [J].
Bandini, Andrea ;
Orlandi, Silvia ;
Giovannelli, Fabio ;
Felici, Andrea ;
Cincotta, Massimo ;
Clemente, Daniela ;
Vanni, Paola ;
Zaccara, Gaetano ;
Manfredi, Claudia .
JOURNAL OF VOICE, 2016, 30 (06) :766.e1-766.e11
[6]  
Bandini A, 2015, 16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, P2162
[7]  
Bartlett M. S., 2006, Journal of Multimedia, V1, DOI 10.4304/jmm.1.6.22-35
[8]   Facial bradykinesia [J].
Bologna, Matteo ;
Fabbrini, Giovanni ;
Marsili, Luca ;
Defazio, Giovanni ;
Thompson, Philip D. ;
Berardelli, Alfredo .
JOURNAL OF NEUROLOGY NEUROSURGERY AND PSYCHIATRY, 2013, 84 (06) :681-685
[9]   Faces of emotion in Parkinsons disease: Micro-expressivity and bradykinesia during voluntary facial expressions [J].
Bowers, Dawn ;
Miller, Kimberly ;
Bosch, Wendelyn ;
Gokcay, Didem ;
Pedraza, Otto ;
Springer, Utaka ;
Okun, Michael .
JOURNAL OF THE INTERNATIONAL NEUROPSYCHOLOGICAL SOCIETY, 2006, 12 (06) :765-773
[10]   Active appearance models [J].
Cootes, TF ;
Edwards, GJ ;
Taylor, CJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (06) :681-685