Neural network modeling of altered facial expression recognition in autism spectrum disorders based on predictive processing framework

被引:9
作者
Takahashi, Yuta [1 ,2 ]
Murata, Shingo [3 ]
Idei, Hayato [4 ]
Tomita, Hiroaki [1 ]
Yamashita, Yuichi [2 ]
机构
[1] Tohoku Univ Hosp, Dept Psychiat, Sendai, Miyagi, Japan
[2] Natl Ctr Neurol & Psychiat, Dept Med Informat, 4-1-1 Ogawa Higashi, Kodaira, Tokyo 1878502, Japan
[3] Keio Univ, Fac Sci & Technol, Dept Elect & Elect Engn, Tokyo, Japan
[4] Waseda Univ, Dept Intermedia Studies, Tokyo, Japan
关键词
COMPUTATIONAL PSYCHIATRY; EMOTION RECOGNITION; BRAIN;
D O I
10.1038/s41598-021-94067-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The mechanism underlying the emergence of emotional categories from visual facial expression information during the developmental process is largely unknown. Therefore, this study proposes a system-level explanation for understanding the facial emotion recognition process and its alteration in autism spectrum disorder (ASD) from the perspective of predictive processing theory. Predictive processing for facial emotion recognition was implemented as a hierarchical recurrent neural network (RNN). The RNNs were trained to predict the dynamic changes of facial expression movies for six basic emotions without explicit emotion labels as a developmental learning process, and were evaluated by the performance of recognizing unseen facial expressions for the test phase. In addition, the causal relationship between the network characteristics assumed in ASD and ASD-like cognition was investigated. After the developmental learning process, emotional clusters emerged in the natural course of self-organization in higher-level neurons, even though emotional labels were not explicitly instructed. In addition, the network successfully recognized unseen test facial sequences by adjusting higher-level activity through the process of minimizing precision-weighted prediction error. In contrast, the network simulating altered intrinsic neural excitability demonstrated reduced generalization capability and impaired emotional clustering in higher-level neurons. Consistent with previous findings from human behavioral studies, an excessive precision estimation of noisy details underlies this ASD-like cognition. These results support the idea that impaired facial emotion recognition in ASD can be explained by altered predictive processing, and provide possible insight for investigating the neurophysiological basis of affective contact.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network
    Shi, Min
    Xu, Lijun
    Chen, Xiang
    IEEE ACCESS, 2020, 8 : 57606 - 57614
  • [32] Action unit analysis enhanced facial expression recognition by deep neural network evolution
    Zhi, Ruicong
    Zhou, Caixia
    Li, Tingting
    Liu, Shuai
    Jin, Yi
    NEUROCOMPUTING, 2021, 425 : 135 - 148
  • [33] A multi-scale feature fusion convolutional neural network for facial expression recognition
    Zhang, Xiufeng
    Fu, Xingkui
    Qi, Guobin
    Zhang, Ning
    EXPERT SYSTEMS, 2024, 41 (04)
  • [34] The Effectiveness of Technology-Based Intervention in Improving Emotion Recognition Through Facial Expression in People with Autism Spectrum Disorder: a Systematic Review
    Clara S. C. Lee
    Stephen H. F. Lam
    Sally T. K. Tsang
    Cheong M. C. Yuen
    Carmen K. M. Ng
    Review Journal of Autism and Developmental Disorders, 2018, 5 : 91 - 104
  • [35] The Effectiveness of Technology-Based Intervention in Improving Emotion Recognition Through Facial Expression in People with Autism Spectrum Disorder: a Systematic Review
    Lee, Clara S. C.
    Lam, Stephen H. F.
    Tsang, Sally T. K.
    Yuen, Cheong M. C.
    Ng, Carmen K. M.
    REVIEW JOURNAL OF AUTISM AND DEVELOPMENTAL DISORDERS, 2018, 5 (02) : 91 - 104
  • [36] Faster Region Convolutional Neural Network (FRCNN) Based Facial Emotion Recognition
    Angel, J. Sheril
    Andrushia, A. Diana
    Neebha, T. Mary
    Accouche, Oussama
    Saker, Louai
    Anand, N.
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 79 (02): : 2427 - 2448
  • [37] Expression Recognition Method Based on a Lightweight Convolutional Neural Network
    Zhao, Guangzhe
    Yang, Hanting
    Yu, Min
    IEEE ACCESS, 2020, 8 : 38528 - 38537
  • [38] Fusing HOG and convolutional neural network spatial-temporal features for video-based facial expression recognition
    Pan, Xianzhang
    IET IMAGE PROCESSING, 2020, 14 (01) : 176 - 182
  • [39] Altered immune function associated with disordered neural connectivity and executive dysfunctions: A neurophysiological study on children with autism spectrum disorders
    Han, Yvonne M. Y.
    Chan, Agnes S.
    Sze, Sophia L.
    Cheung, Mei-Chun
    Wong, Chun-kwok
    Lam, Joseph M. K.
    Poon, Priscilla M. K.
    RESEARCH IN AUTISM SPECTRUM DISORDERS, 2013, 7 (06) : 662 - 674
  • [40] Real-time facial expression recognition using smoothed deep neural network ensemble
    Benamara, Nadir Kamel
    Val-Calvo, Mikel
    Alvarez-Sanchez, Jose Ramon
    Diaz-Morcillo, Alejandro
    Ferrandez-Vicente, Jose Manuel
    Fernandez-Jover, Eduardo
    Stambouli, Tarik Boudghene
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2021, 28 (01) : 97 - 111