How Children Recognize Emotions from Video and Audio

被引:0
|
作者
Lyakso, Mena [1 ]
Froloya, Olga [1 ]
Nikolaev, Aleksandr [1 ]
Grechanyi, Severin [1 ]
Filatova, Yulia [2 ]
Nersisson, Ruban [2 ]
机构
[1] St Petersburg State Univ, Child Speech Res Grp, St Petersburg, Russia
[2] Vellore Inst Technol, Sch Elect Engn, Vellore, Tamil Nadu, India
来源
SPEECH AND COMPUTER, SPECOM 2024, PT II | 2025年 / 15300卷
基金
俄罗斯科学基金会;
关键词
Emotions; Recognition; Children with Autism Spectrum Disorders and Intellectual Disabilities; Video and Audio Modalities; AUTISM;
D O I
10.1007/978-3-031-78014-1_11
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
The paper presents the results of assessing the ability of children from different groups - typical development (TD), autism spectrum disorder (ASD), and intellectual disability (ID) - to recognize the emotions of other people using video and audio tests. The study included 225 children aged 5 to 16 years and 2 adults. We used the original dataset by the Child's Emotional Development Method (CEDM), selecting from dataset the video recordings of four test tasks performed by children to recognize emotions from photographs of children, photographs of adults, abstract images, and the speech and voice of children (audio test). Children's ability to recognize emotions correctly was assessed in two ways: by experts' ratings on a Likert scale and by children's correct answers. The results showed greater accuracy in recognizing emotional states by TD children compared to children with ASD and ID. Peculiarities of recognition by children with ASD and ID of various emotions using video and audio tests were revealed. The novelty of the results lies in the comparative data on the recognition of emotions by TD children and children with various developmental disorders. The problem of assessing children's emotion recognition using a standardized approach for further use of data in creating applications that teach children to express and recognize emotions is original and new.
引用
收藏
页码:138 / 153
页数:16
相关论文
共 50 条
  • [21] A Spontaneous Driver Emotion Facial Expression (DEFE) Dataset for Intelligent Vehicles: Emotions Triggered by Video-Audio Clips in Driving Scenarios
    Li, Wenbo
    Cui, Yaodong
    Ma, Yintao
    Chen, Xingxin
    Li, Guofa
    Zeng, Guanzhong
    Guo, Gang
    Cao, Dongpu
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (01) : 747 - 760
  • [22] Autism classification and monitoring from predicted categorical and dimensional emotions of video features
    Khor, Stephen Wen Hwooi
    Sabri, Aznul Qalid Md
    Othmani, Alice
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (01) : 191 - 198
  • [23] On the Performance Analysis of APIs Recognizing Emotions from Video Images of Facial Expressions
    Bhattacharjee, Ananya
    Pias, Tanmoy
    Ahmad, Mahathir
    Rahman, Ashikur
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 223 - 230
  • [24] What are emotions and how many are there?
    Woelfel J.
    Anderson K.B.
    Iacobucci A.
    Quality & Quantity, 2024, 58 (6) : 5483 - 5502
  • [25] How poetry evokes emotions
    Johnson-Laird, Philip N.
    Oatley, Keith
    ACTA PSYCHOLOGICA, 2022, 224
  • [26] Understanding of Emotions and False Beliefs Among Hearing Children versus Deaf Children
    Ziv, Margalit
    Most, Tova
    Cohen, Shirit
    JOURNAL OF DEAF STUDIES AND DEAF EDUCATION, 2013, 18 (02): : 161 - 174
  • [27] Children with autism can express social emotions in their drawings
    Kotroni, P.
    Bonoti, F.
    Mavropoulou, S.
    INTERNATIONAL JOURNAL OF DEVELOPMENTAL DISABILITIES, 2019, 65 (04) : 248 - 256
  • [28] SOFTWARE INTEGRATION FOR APPLICATIONS WITH AUDIO/VIDEO STREAM
    Fang, Guo-Ming
    Lin, Jim-Min
    Chin, Kai-Yi
    Lee, Chiou-Yng
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2010, 6 (3B): : 1421 - 1433
  • [29] Video and Audio Compressions and Human Perception Mechanism
    Bank, Michael
    PROCEEDINGS OF THE 12TH WSEAS INTERNATIONAL CONFERENCE ON COMMUNICATIONS: NEW ASPECTS OF COMMUNICATIONS, 2008, : 225 - +
  • [30] The New Italian Audio and Video Emotional Database
    Esposito, Anna
    Riviello, Maria Teresa
    DEVELOPMENT OF MULTIMODAL INTERFACES: ACTIVE LISTING AND SYNCHRONY, 2010, 5967 : 406 - 422