How Children Recognize Emotions from Video and Audio

被引:0
|
作者
Lyakso, Mena [1 ]
Froloya, Olga [1 ]
Nikolaev, Aleksandr [1 ]
Grechanyi, Severin [1 ]
Filatova, Yulia [2 ]
Nersisson, Ruban [2 ]
机构
[1] St Petersburg State Univ, Child Speech Res Grp, St Petersburg, Russia
[2] Vellore Inst Technol, Sch Elect Engn, Vellore, Tamil Nadu, India
来源
SPEECH AND COMPUTER, SPECOM 2024, PT II | 2025年 / 15300卷
基金
俄罗斯科学基金会;
关键词
Emotions; Recognition; Children with Autism Spectrum Disorders and Intellectual Disabilities; Video and Audio Modalities; AUTISM;
D O I
10.1007/978-3-031-78014-1_11
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
The paper presents the results of assessing the ability of children from different groups - typical development (TD), autism spectrum disorder (ASD), and intellectual disability (ID) - to recognize the emotions of other people using video and audio tests. The study included 225 children aged 5 to 16 years and 2 adults. We used the original dataset by the Child's Emotional Development Method (CEDM), selecting from dataset the video recordings of four test tasks performed by children to recognize emotions from photographs of children, photographs of adults, abstract images, and the speech and voice of children (audio test). Children's ability to recognize emotions correctly was assessed in two ways: by experts' ratings on a Likert scale and by children's correct answers. The results showed greater accuracy in recognizing emotional states by TD children compared to children with ASD and ID. Peculiarities of recognition by children with ASD and ID of various emotions using video and audio tests were revealed. The novelty of the results lies in the comparative data on the recognition of emotions by TD children and children with various developmental disorders. The problem of assessing children's emotion recognition using a standardized approach for further use of data in creating applications that teach children to express and recognize emotions is original and new.
引用
收藏
页码:138 / 153
页数:16
相关论文
共 50 条
  • [1] Children can accurately recognize facial emotions from emoticons
    Oleszkiewicz, Anna
    Frackowiak, Tomasz
    Sorokowska, Agnieszka
    Sorokowski, Piotr
    COMPUTERS IN HUMAN BEHAVIOR, 2017, 76 : 372 - 377
  • [2] Facial Expressions and Ability to Recognize Emotions From Eyes or Mouth in Children
    Guarnera, Maria
    Hichy, Zira
    Cascio, Maura I.
    Carrubba, Stefano
    EUROPES JOURNAL OF PSYCHOLOGY, 2015, 11 (02): : 183 - 196
  • [3] Facial Expressions and the Ability to Recognize Emotions from the Eyes or Mouth: A Comparison Between Children and Adults
    Guarnera, Maria
    Hichy, Zira
    Cascio, Maura
    Carrubba, Stefano
    Buccheri, Stefania L.
    JOURNAL OF GENETIC PSYCHOLOGY, 2017, 178 (06): : 309 - 318
  • [4] Use of a Video Game with Tangible Interfaces to Work Emotions in Children with Autism
    Andres Sandoval-Bringas, J.
    Carreno-Leon, Monica A.
    Alvarez-Robles, Teresita
    Duran-Encinas, Israel
    Leyva-Carrillo, Alejandro
    Estrada-Cota, Italia
    HCI INTERNATIONAL 2021 - LATE BREAKING PAPERS: COGNITION, INCLUSION, LEARNING, AND CULTURE, HCII 2021, 2021, 13096 : 295 - 305
  • [5] Mu-musicplay: How the Interactive Use of Games and Music Influence the Capacity of Autistic Children to Recognize Emotions in Videos and Music
    Liang, Ting
    Lee, I-Jui
    ADVANCES IN HUMAN FACTORS AND ERGONOMICS IN HEALTHCARE AND MEDICAL DEVICES (AHFE 2021), 2021, 263 : 353 - 361
  • [6] Subjective Evaluation of Basic Emotions from Audio-Visual Data
    Kadiri, Sudarsana Reddy
    Alku, Paavo
    SENSORS, 2022, 22 (13)
  • [7] Ensemble perception of emotions in autistic and typical children and adolescents
    Karaminis, Themelis
    Neil, Louise
    Manning, Catherine
    Turi, Marco
    Fiorentini, Chiara
    Burr, David
    Pellicano, Elizabeth
    DEVELOPMENTAL COGNITIVE NEUROSCIENCE, 2017, 24 : 51 - 62
  • [8] The Influence of Audio on Video Memorability with an Audio Gestalt Regulated Video Memorability System
    Sweeney, Lorin
    Healy, Graham
    Smeaton, Alan F.
    2021 INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI), 2021, : 23 - 28
  • [9] Masking Emotions: Face Masks Impair How We Read Emotions
    Gori, Monica
    Schiatti, Lucia
    Amadeo, Maria Bianca
    FRONTIERS IN PSYCHOLOGY, 2021, 12
  • [10] Applying FaceReader to Recognize Consumer Emotions in Graphic Styles
    Yu, Chia-Yin
    Ko, Chih-Hsiang
    COMPLEX SYSTEMS ENGINEERING AND DEVELOPMENT, 2017, 60 : 104 - 109