paraFaceTest: an ensemble of regression tree-based facial features extraction for efficient facial paralysis classification

被引:21
作者
Barbosa, Jocelyn [1 ,2 ]
Seo, Woo-Keun [3 ,4 ,5 ]
Kang, Jaewoo [1 ]
机构
[1] Korea Univ, Dept Comp Sci & Engn, Seoul, South Korea
[2] Univ Sci & Technol Southern Philippines, IT Dept, Cagayan De Oro, Philippines
[3] Samsung Med Ctr, Dept Neurol, Seoul, South Korea
[4] Samsung Med Ctr, Stroke Ctr, Seoul, South Korea
[5] Sungkyunkwan Univ, Sch Med, Dept Digital Hlth, SAIHST, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Facial paralysis classification; Facial paralysis objective evaluation; Ensemble of regression trees; Salient point detection; Iris detection; Facial paralysis evaluation framework;
D O I
10.1186/s12880-019-0330-8
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
BackgroundFacial paralysis (FP) is a neuromotor dysfunction that losses voluntary muscles movement in one side of the human face. As the face is the basic means of social interactions and emotional expressions among humans, individuals afflicted can often be introverted and may develop psychological distress, which can be even more severe than the physical disability. This paper addresses the problem of objective facial paralysis evaluation.MethodsWe present a novel approach for objective facial paralysis evaluation and classification, which is crucial for deciding the medical treatment scheme. For FP classification, in particular, we proposed a method based on the ensemble of regression trees to efficiently extract facial salient points and detect iris or sclera boundaries. We also employ 2(nd) degree polynomial of parabolic function to improve Daugman's algorithm for detecting occluded iris boundaries, thereby allowing us to efficiently get the area of the iris. The symmetry score of each face is measured by calculating the ratio of both iris area and the distances between the key points in both sides of the face. We build a model by employing hybrid classifier that discriminates healthy from unhealthy subjects and performs FP classification.ResultsObjective analysis was conducted to evaluate the performance of the proposed method. As we explore the effect of data augmentation using publicly available datasets of facial expressions, experiments reveal that the proposed approach demonstrates efficiency.ConclusionsExtraction of iris and facial salient points on images based on ensemble of regression trees along with our hybrid classifier (classification tree plus regularized logistic regression) provides a more improved way of addressing FP classification problem. It addresses the common limiting factor introduced in the previous works, i.e. having the greater sensitivity to subjects exposed to peculiar facial images, whereby improper identification of initial evolving curve for facial feature segmentation results to inaccurate facial feature extraction. Leveraging ensemble of regression trees provides accurate salient points extraction, which is crucial for revealing the significant difference between the healthy and the palsy side when performing different facial expressions.
引用
收藏
页数:14
相关论文
共 24 条
[1]  
[Anonymous], 2012, INT J COMPUT APPL
[2]   Efficient quantitative assessment of facial paralysis using iris segmentation and active contour-based key points detection with hybrid classifier [J].
Barbosa, Jocelyn ;
Lee, Kyubum ;
Lee, Sunwon ;
Lodhi, Bilal ;
Cho, Jae-Gu ;
Seo, Woo-Keun ;
Kang, Jaewoo .
BMC MEDICAL IMAGING, 2016, 16
[3]   Clinical Practice Guideline: Bell's Palsy [J].
Baugh, Reginald F. ;
Basura, Gregory J. ;
Ishii, Lisa E. ;
Schwartz, Seth R. ;
Drumheller, Caitlin Murray ;
Burkholder, Rebecca ;
Deckard, Nathan A. ;
Dawson, Cindy ;
Driscoll, Colin ;
Gillespie, M. Boyd ;
Gurgel, Richard K. ;
Halperin, John ;
Khalid, Ayesha N. ;
Kumar, Kaparaboyna Ashok ;
Micco, Alan ;
Munsell, Debra ;
Rosenbaum, Steven ;
Vaughan, William .
OTOLARYNGOLOGY-HEAD AND NECK SURGERY, 2013, 149 :S1-S27
[4]  
Dalal Navneet, 2005, P IEEE C COMP VIS PA
[5]   How iris recognition works [J].
Daugman, J .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2004, 14 (01) :21-30
[6]   Face recognition using Histograms of Oriented Gradients [J].
Deniz, O. ;
Bueno, G. ;
Salido, J. ;
De la Torre, F. .
PATTERN RECOGNITION LETTERS, 2011, 32 (12) :1598-1603
[7]  
Dong J, 2008, INT S INT INF TECHN
[8]   Automatic facial expression analysis: a survey [J].
Fasel, B ;
Luettin, J .
PATTERN RECOGNITION, 2003, 36 (01) :259-275
[9]   Quantitative Analysis of Facial Paralysis Using Local Binary Patterns in Biomedical Videos [J].
He, Shu ;
Soraghan, John J. ;
O'Reilly, Brian F. ;
Xing, Dongshan .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2009, 56 (07) :1864-1870
[10]  
Kanerva M, 2008, THESIS