Comprehensive assessment of facial paralysis based on facial animation units

被引:12
作者
Gaber, Amira [1 ]
Taher, Mona F. [1 ]
Wahed, Manal Abdel [1 ]
Shalaby, Nevin Mohieldin [2 ]
Gaber, Sarah [3 ]
机构
[1] Cairo Univ, Fac Engn, Syst & Biomed Engn Dept, Giza, Egypt
[2] Cairo Univ, Fac Med, Neurol Dept, Giza, Egypt
[3] Cairo Univ, Fac Phys Therapy, Dept Neuromuscular Disorder & Its Surg, Giza, Egypt
关键词
PALSY; RECOGNITION; KINECT;
D O I
10.1371/journal.pone.0277297
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Quantitative grading and classification of the severity of facial paralysis (FP) are important for selecting the treatment plan and detecting subtle improvement that cannot be detected clinically. To date, none of the available FP grading systems have gained widespread clinical acceptance. The work presented here describes the development and testing of a system for FP grading and assessment which is part of a comprehensive evaluation system for FP. The system is based on the Kinect v2 hardware and the accompanying software SDK 2.0 in extracting the real time facial landmarks and facial animation units (FAUs). The aim of this paper is to describe the development and testing of the FP assessment phase (first phase) of a larger comprehensive evaluation system of FP. The system includes two phases; FP assessment and FP classification. A dataset of 375 records from 13 unilateral FP patients was compiled for this study. The FP assessment includes three separate modules. One module is the symmetry assessment of both facial sides at rest and while performing five voluntary facial movements. Another module is responsible for recognizing the facial movements. The last module assesses the performance of each facial movement for both sides of the face depending on the involved FAUs. The study validates that the FAUs captured using the Kinect sensor can be processed and used to develop an effective tool for the automatic evaluation of FP. The developed FP grading system provides a detailed quantitative report and has significant advantages over the existing grading scales. It is fast, easy to use, user-independent, low cost, quantitative, and automated and hence it is suitable to be used as a clinical tool.
引用
收藏
页数:18
相关论文
共 41 条
[1]  
Alabasi HA., 2015, INT RES J ENG TECHNO, V2, P421
[2]  
Alabbasi Hesham A., 2015, IOSR Journal of Computer Engineering (IOSR-JCE), Volume, V17, P61
[3]  
[Anonymous], 1977, Manual for the facial action coding system
[4]  
[Anonymous], 1978, Manual for The Facial Action Coding System
[5]  
Banita, 2018, INT J ENG TECHNOLOGY, V7, P2325
[6]   Clinician-Graded Electronic Facial Paralysis Assessment: The eFACE [J].
Banks, Caroline A. ;
Bhama, Prabhat K. ;
Park, Jong ;
Hadlock, Charles R. ;
Hadlock, Tessa A. .
PLASTIC AND RECONSTRUCTIVE SURGERY, 2015, 136 (02) :223E-230E
[7]   Clinical Practice Guideline: Bell's Palsy [J].
Baugh, Reginald F. ;
Basura, Gregory J. ;
Ishii, Lisa E. ;
Schwartz, Seth R. ;
Drumheller, Caitlin Murray ;
Burkholder, Rebecca ;
Deckard, Nathan A. ;
Dawson, Cindy ;
Driscoll, Colin ;
Gillespie, M. Boyd ;
Gurgel, Richard K. ;
Halperin, John ;
Khalid, Ayesha N. ;
Kumar, Kaparaboyna Ashok ;
Micco, Alan ;
Munsell, Debra ;
Rosenbaum, Steven ;
Vaughan, William .
OTOLARYNGOLOGY-HEAD AND NECK SURGERY, 2013, 149 :S1-S27
[8]  
Brenner Michael J, 2004, Semin Plast Surg, V18, P13, DOI 10.1055/s-2004-823119
[9]  
Caisberger F., 2019, BIOMEDICAL J SCI TEC, V14, P10928
[10]   Facial Expression Analysis with Kinect for the Diagnosis of Paralysis Using Nottingham System [J].
Carro, R. C. ;
Huerta, E. B. ;
Caporal, R. M. ;
Hernandez, J. C. ;
Cruz, F. R. .
IEEE LATIN AMERICA TRANSACTIONS, 2016, 14 (07) :3418-3426