Neural network modeling of altered facial expression recognition in autism spectrum disorders based on predictive processing framework

被引:9
作者
Takahashi, Yuta [1 ,2 ]
Murata, Shingo [3 ]
Idei, Hayato [4 ]
Tomita, Hiroaki [1 ]
Yamashita, Yuichi [2 ]
机构
[1] Tohoku Univ Hosp, Dept Psychiat, Sendai, Miyagi, Japan
[2] Natl Ctr Neurol & Psychiat, Dept Med Informat, 4-1-1 Ogawa Higashi, Kodaira, Tokyo 1878502, Japan
[3] Keio Univ, Fac Sci & Technol, Dept Elect & Elect Engn, Tokyo, Japan
[4] Waseda Univ, Dept Intermedia Studies, Tokyo, Japan
关键词
COMPUTATIONAL PSYCHIATRY; EMOTION RECOGNITION; BRAIN;
D O I
10.1038/s41598-021-94067-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The mechanism underlying the emergence of emotional categories from visual facial expression information during the developmental process is largely unknown. Therefore, this study proposes a system-level explanation for understanding the facial emotion recognition process and its alteration in autism spectrum disorder (ASD) from the perspective of predictive processing theory. Predictive processing for facial emotion recognition was implemented as a hierarchical recurrent neural network (RNN). The RNNs were trained to predict the dynamic changes of facial expression movies for six basic emotions without explicit emotion labels as a developmental learning process, and were evaluated by the performance of recognizing unseen facial expressions for the test phase. In addition, the causal relationship between the network characteristics assumed in ASD and ASD-like cognition was investigated. After the developmental learning process, emotional clusters emerged in the natural course of self-organization in higher-level neurons, even though emotional labels were not explicitly instructed. In addition, the network successfully recognized unseen test facial sequences by adjusting higher-level activity through the process of minimizing precision-weighted prediction error. In contrast, the network simulating altered intrinsic neural excitability demonstrated reduced generalization capability and impaired emotional clustering in higher-level neurons. Consistent with previous findings from human behavioral studies, an excessive precision estimation of noisy details underlies this ASD-like cognition. These results support the idea that impaired facial emotion recognition in ASD can be explained by altered predictive processing, and provide possible insight for investigating the neurophysiological basis of affective contact.
引用
收藏
页数:14
相关论文
共 50 条
  • [11] Neural correlates of facial recognition deficits in autism spectrum disorder: a comprehensive review
    Liu, Jianmei
    Chen, Huihui
    Wang, Haijing
    Wang, Zhidan
    FRONTIERS IN PSYCHIATRY, 2025, 15
  • [12] Facial expression recognition as a candidate marker for autism spectrum disorder: how frequent and severe are deficits?
    Loth, E.
    Garrido, L.
    Ahmad, J.
    Watson, E.
    Duff, A.
    Duchaine, B.
    MOLECULAR AUTISM, 2018, 9
  • [13] The relationship between alexithymia, interoception, and neural functional connectivity during facial expression processing in autism spectrum disorder
    Butera, Christiana
    Kaplan, Jonas
    Kilroy, Emily
    Harrison, Laura
    Jayashankar, Aditya
    Loureiro, Fernanda
    Aziz-Zadeh, Lisa
    NEUROPSYCHOLOGIA, 2023, 180
  • [14] Neural correlates of emotion processing during observed self-face recognition in individuals with autism spectrum disorders
    Morita, Tomoyo
    Kosaka, Hirotaka
    Saito, Daisuke N.
    Fujii, Takeshi
    Ishitobi, Makoto
    Munesue, Toshio
    Inohara, Keisuke
    Okazawa, Hidehiko
    Kakigi, Ryusuke
    Sadato, Norihiro
    RESEARCH IN AUTISM SPECTRUM DISORDERS, 2016, 26 : 16 - 32
  • [15] Efficient Facial Expression Recognition Algorithm Based on Hierarchical Deep Neural Network Structure
    Kim, Ji-Hae
    Kim, Byung-Gyu
    Roy, Partha Pratim
    Jeong, Da-Mi
    IEEE ACCESS, 2019, 7 : 41273 - 41285
  • [16] Early neural activation during facial affect processing in adolescents with Autism Spectrum Disorder
    Leung, Rachel C.
    Pang, Elizabeth W.
    Cassel, Daniel
    Brian, Jessica A.
    Smith, Mary Lou
    Taylor, Margot J.
    NEUROIMAGE-CLINICAL, 2015, 7 : 203 - 212
  • [17] Human Facial Expression Recognition System Using Artificial Neural Network Classification of Gabor Feature Based Facial Expression Information
    Islam, Bayezid
    Mahmud, Firoz
    Hossain, Arafat
    Mia, Md. Sumon
    Goala, Pushpen Bikash
    2018 4TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND INFORMATION & COMMUNICATION TECHNOLOGY (ICEEICT), 2018, : 364 - 368
  • [18] Mechanisms of facial emotion recognition in autism spectrum disorders: Insights from eye tracking and electroencephalography
    Black, Melissa H.
    Chen, Nigel T. M.
    Iyer, Kartik K.
    Lipp, Ottmar V.
    Bolte, Sven
    Falkmer, Marita
    Tan, Tele
    Girdler, Sonya
    NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2017, 80 : 488 - 515
  • [19] An Augmentative System with Facial and Emotion Recognition for Improving Social Skills of Children with Autism Spectrum Disorders
    Alharbi, Mohammed
    Huang, Shihong
    2020 14TH ANNUAL IEEE INTERNATIONAL SYSTEMS CONFERENCE (SYSCON2020), 2020,
  • [20] A Deep Quantum Convolutional Neural Network Based Facial Expression Recognition For Mental Health Analysis
    Hossain, Sanoar
    Umer, Saiyed
    Rout, Ranjeet Kumar
    Al Marzouqi, Hasan
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 1556 - 1565