Automatic Emotion Recognition in Robot-Children Interaction for ASD Treatment

被引:38
作者
Leo, Marco [1 ]
Del Coco, Marco [1 ]
Carcagni, Pierluigi [1 ]
Distante, Cosimo [1 ]
Bernava, Massimo [1 ]
Pioggia, Giovanni [1 ]
Palestra, Giuseppe [1 ]
机构
[1] ISASI UOS Lecce, Campus Univ Via Monteroni Sn, I-73100 Lecce, Italy
来源
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOP (ICCVW) | 2015年
关键词
FACIAL EXPRESSION RECOGNITION; FEATURES;
D O I
10.1109/ICCVW.2015.76
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Autism Spectrum Disorders (ASD) are a group of lifelong disabilities that affect people's communication and understanding social cues. The state of the art witnesses how technology, and in particular robotics, may offer promising tools to strengthen the research and therapy of ASD. This work represents the first attempt to use machine-learning strategies during robot-ASD children interactions, in terms of facial expression imitation, making possible an objective evaluation of children's behaviours and then giving the possibility to introduce a metric about the effectiveness of the therapy. In particular, the work focuses on the basic emotion recognition skills. In addition to the aforementioned applicative innovations this work contributes also to introduce a facial expression recognition (FER) engine that automatically detects and tracks the child's face and then recognize emotions on the basis of a machine learning pipeline based on HOG descriptor and Support Vector Machines. Two different experimental sessions were carried out: the first one tested the FER engine on publicly available datasets demonstrating that the proposed pipeline outperforms the existing strategies in terms of recognition accuracy. The second one involved ASD children and it was a preliminary exploration of how the introduction of the FER engine in the therapeutic protocol can be effectively used to monitor children's behaviours.
引用
收藏
页码:537 / 545
页数:9
相关论文
共 35 条
[1]  
[Anonymous], 2011, ACM T INTEL SYST TEC, DOI DOI 10.1145/1961189.1961199
[2]   How children with autism spectrum disorder behave and explore the 4-dimensional (spatial 3D+time) environment during a joint attention induction task with a robot [J].
Anzalone, Salvatore Maria ;
Tilmont, Elodie ;
Boucenna, Sofiane ;
Xavier, Jean ;
Jouen, Anne-Lise ;
Bodeau, Nicolas ;
Maharatna, Koushik ;
Chetouani, Mohamed ;
Cohen, David .
RESEARCH IN AUTISM SPECTRUM DISORDERS, 2014, 8 (07) :814-826
[3]   Why Robots? A Survey on the Roles and Benefits of Social Robots in the Therapy of Children with Autism [J].
Cabibihan, John-John ;
Javed, Hifza ;
Ang, Marcelo, Jr. ;
Aljunied, Sharifah Mariam .
INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2013, 5 (04) :593-618
[4]   ENCARA2:: Real-time detection of multiple faces at different resolutions in video streams [J].
Castrillon, M. ;
Deniz, O. ;
Guerra, C. ;
Hernandez, M. .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2007, 18 (02) :130-140
[5]   SUPPORT-VECTOR NETWORKS [J].
CORTES, C ;
VAPNIK, V .
MACHINE LEARNING, 1995, 20 (03) :273-297
[6]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[7]   The clinical use of robots for individuals with Autism Spectrum Disorders: A critical review [J].
Diehl, Joshua J. ;
Schmitt, Lauren M. ;
Villano, Michael ;
Crowell, Charles R. .
RESEARCH IN AUTISM SPECTRUM DISORDERS, 2012, 6 (01) :249-262
[8]   Improving dynamic facial expression recognition with feature subset selection [J].
Dornaika, F. ;
Lazkano, E. ;
Sierra, B. .
PATTERN RECOGNITION LETTERS, 2011, 32 (05) :740-748
[9]   Automatic Facial Expression Recognition Using Features of Salient Facial Patches [J].
Happy, S. L. ;
Routray, Aurobinda .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2015, 6 (01) :1-12
[10]   Automatic facial expression recognition based on spatiotemporal descriptors [J].
Ji, Yi ;
Idrissi, Khalid .
PATTERN RECOGNITION LETTERS, 2012, 33 (10) :1373-1380