How Children Recognize Emotions from Video and Audio

被引:0
|
作者
Lyakso, Mena [1 ]
Froloya, Olga [1 ]
Nikolaev, Aleksandr [1 ]
Grechanyi, Severin [1 ]
Filatova, Yulia [2 ]
Nersisson, Ruban [2 ]
机构
[1] St Petersburg State Univ, Child Speech Res Grp, St Petersburg, Russia
[2] Vellore Inst Technol, Sch Elect Engn, Vellore, Tamil Nadu, India
来源
SPEECH AND COMPUTER, SPECOM 2024, PT II | 2025年 / 15300卷
基金
俄罗斯科学基金会;
关键词
Emotions; Recognition; Children with Autism Spectrum Disorders and Intellectual Disabilities; Video and Audio Modalities; AUTISM;
D O I
10.1007/978-3-031-78014-1_11
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
The paper presents the results of assessing the ability of children from different groups - typical development (TD), autism spectrum disorder (ASD), and intellectual disability (ID) - to recognize the emotions of other people using video and audio tests. The study included 225 children aged 5 to 16 years and 2 adults. We used the original dataset by the Child's Emotional Development Method (CEDM), selecting from dataset the video recordings of four test tasks performed by children to recognize emotions from photographs of children, photographs of adults, abstract images, and the speech and voice of children (audio test). Children's ability to recognize emotions correctly was assessed in two ways: by experts' ratings on a Likert scale and by children's correct answers. The results showed greater accuracy in recognizing emotional states by TD children compared to children with ASD and ID. Peculiarities of recognition by children with ASD and ID of various emotions using video and audio tests were revealed. The novelty of the results lies in the comparative data on the recognition of emotions by TD children and children with various developmental disorders. The problem of assessing children's emotion recognition using a standardized approach for further use of data in creating applications that teach children to express and recognize emotions is original and new.
引用
收藏
页码:138 / 153
页数:16
相关论文
共 50 条
  • [42] How to recognize and manage psychological distress in cancer patients
    Ryan, H
    Schofield, P
    Cockburn, J
    Butow, P
    Tattersall, M
    Turner, J
    Girgis, A
    Bandaranayake, D
    Bowman, D
    EUROPEAN JOURNAL OF CANCER CARE, 2005, 14 (01) : 7 - 15
  • [43] AENet: Learning Deep Audio Features for Video Analysis
    Takahashi, Naoya
    Gygli, Michael
    Van Gool, Luc
    IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (03) : 513 - 524
  • [44] Autism Screening Using a Video Game Based on Emotions
    Irani, Atefeh
    Moradi, Hadi
    Vahid, Leila Kashani
    2018 2ND NATIONAL AND 1ST INTERNATIONAL DIGITAL GAMES RESEARCH CONFERENCE: TRENDS, TECHNOLOGIES, AND APPLICATIONS (DGRC), 2018, : 40 - 45
  • [45] Attempting to Aggregate Perceptual Constructs From Deep Neural Networks for Video and Audio Interaction Representation
    Maheux, Marc-Antoine
    Auclair, Guillaume
    Warren, Philippe
    Letourneau, Dominic
    Michaud, Francois
    2023 32ND IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, RO-MAN, 2023, : 1302 - 1307
  • [46] Trajectory of the Recognition of Basic Emotions in the Neurodevelopment of Children and Its Evaluation Through the "Recognition of Basic Emotions in Childhood" Test (REBEC)
    Poenitz, Victoria
    Roman, Fabian
    FRONTIERS IN EDUCATION, 2020, 5
  • [47] Emotions on the Streets: Application of the Test of Emotions Comprehension in Children Working on the Streets
    da Silva Moita Minervino, Carla Alexandra
    Bompastor Borges Dias, Maria da Graca
    Dantas da Silveira, Natercia Janine
    Roazzi, Antonio
    PSICOLOGIA-REFLEXAO E CRITICA, 2010, 23 (02): : 354 - 361
  • [48] A teaching procedure to help children with autistic spectrum disorder to label emotions
    Conallen, Kevin
    Reed, Phil
    RESEARCH IN AUTISM SPECTRUM DISORDERS, 2016, 23 : 63 - 72
  • [49] Awareness of Single and Multiple Emotions in High-functioning Children with Autism
    Carolien Rieffe
    Mark Meerum Terwogt
    Katerina Kotronopoulou
    Journal of Autism and Developmental Disorders, 2007, 37 : 455 - 465
  • [50] How Are Your Participants Feeling Today? Accounting For and Assessing Emotions in Virtual Reality
    Radiah, Rivu
    Prodan, Pia
    Makela, Ville
    Knierim, Pascal
    Alt, Florian
    PROCEEDINGS OF 2023 MENSCH UND COMPUTER, MUC 2023: Building Bridges, 2023, : 37 - 48