Game-Based Social Interaction Platform for Cognitive Assessment of Autism Using Eye Tracking

被引：10
|
作者：
Chien, Yi-Ling [1 ]
Lee, Chia-Hsin [2 ]
Chiu, Yen-Nan [1 ]
Tsai, Wen-Che [1 ]
Min, Yuan-Che [2 ]
Lin, Yang-Min [2 ]
Wong, Jui-Shen [2 ]
Tseng, Yi-Li [3 ]
机构：
[1] Natl Taiwan Univ Hosp, Dept Psychiat, Taipei 100229, Taiwan
[2] Fu Jen Catholic Univ, Dept Elect Engn, New Taipei City 242062, Taiwan
[3] Natl Sun Yat Sen Univ, Dept Elect Engn, Kaohsiung 804201, Taiwan
来源：
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING | 2023年 / 31卷
关键词：
Games; Emotion recognition; Gaze tracking; Autism; Pediatrics; Face recognition; Biomarkers; Social interaction game; autism spectrum disorder; eye tracking; serious games; SPECTRUM DISORDER; CHILDREN; ATTENTION; EMOTIONS; INTERVENTION; PERCEPTION;
D O I：
10.1109/TNSRE.2022.3232369
中图分类号：
R318 [生物医学工程];
学科分类号：
0831 ;
摘要：
The design goals of recently developed serious games are to improve attention, affective recognition, and social interactions among individuals with autism. However, most previous studies on serious games used behavioral questionnaires to evaluate their effectiveness. The cognitive assessment of individuals with autism after behavioral intervention or drug treatment has become important because it provides promising biomarkers to assess improvement after cognitive intervention. In this study, we developed a game-based social interaction platform incorporating an eye-tracking system for children and preadolescents with autism. Three modules (focusing on gaze following, facial emotion recognition, and social interaction skills) are included in the platform; participants with autism learn these according to their cognitive abilities. The eye-tracking results showed decreased fixation durations when autistic children looked at positive emotional expressions and focused on multiple targets. Prolonged saccade durations and shorter fixation times for social-related facial emotion expressions were also found in preadolescents and teenagers with autism. Our findings suggest that these atypical gaze patterns are reliable biomarkers for evaluating the social and cognitive functions of autistic individuals while playing serious games. The proposed platform's game-based modules and the findings regarding aberrant gaze patterns in autistic individuals demonstrate the possibility of evaluating cognitive functions and intervention effectiveness by using eye-tracking signals in a serious game or real-life environment.
引用
收藏
页码：749 / 758
页数：10
相关论文
共 50 条
  • [1] Game-Based Social Interaction Platform for Cognitive Assessment of Autism Using Eye Tracking
    Chien, Yi-Ling
    Lee, Chia-Hsin
    Chiu, Yen-Nan
    Tsai, Wen-Che
    Min, Yuan-Che
    Lin, Yang-Min
    Wong, Jui-Shen
    Tseng, Yi-Li
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 749 - 758
  • [2] Cognitive Assessment of Autism Spectrum Disorder Using an EEG-based Social Interaction Platform
    Tseng, Yi-Li
    Chien, Yi-Ling
    Chuang, Tse-Min
    Chiu, Yen-Nan
    Tsai, Wen-Che
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 181 - 186
  • [3] Eye Tracking in Game-based Learning Research and Game Design
    Kiili, Kristian
    Ketamo, Harri
    Kickmeier-Rust, Michael D.
    INTERNATIONAL JOURNAL OF SERIOUS GAMES, 2014, 1 (02): : 51 - 65
  • [4] Simulating interaction: Using gaze-contingent eye-tracking to measure the reward value of social signals in toddlers with and without autism
    Vernetti, Angelina
    Senju, Atsushi
    Charman, Tony
    Johnson, Mark H.
    Gliga, Teodora
    DEVELOPMENTAL COGNITIVE NEUROSCIENCE, 2018, 29 : 21 - 29
  • [5] Social gaze training for Autism Spectrum Disorder using eye-tracking and virtual humans
    Grynszpan, Ouriel
    Bouteiller, Julie
    Grynszpan, Severine
    Martin, Jean-Claude
    Nadel, Jacqueline
    INTERACTION STUDIES, 2022, 23 (01) : 89 - 115
  • [6] To Add or Not to Add Game Elements? Exploring the Effects of Different Cognitive Task Designs Using Eye Tracking
    Ninaus, Manuel
    Kiili, Kristian
    Wood, Guilherme
    Moeller, Korbinian
    Kober, Silvia Erika
    IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, 2020, 13 (04): : 847 - 860
  • [7] Electroencephalography Connectivity Assesses Cognitive Disorders of Autistic Children During Game-Based Social Interaction
    Tseng, Yi-Li
    Liu, Hong-Hsiang
    Chiu, Yen-Nan
    Lee, Chia-Hsin
    Tsai, Wen-Che
    Lin, Yang-Min
    Chien, Yi-Ling
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (02) : 782 - 793
  • [8] Multiplayer Interaction Platform With Gaze Tracking for Individuals With Autism
    Krishnappa Babu, Pradeep Raj
    Lahiri, Uttama
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (11) : 2443 - 2450
  • [9] Detecting High-Functioning Autism in Adults Using Eye Tracking and Machine Learning
    Yaneva, Victoria
    Le An Ha
    Eraslan, Sukru
    Yesilada, Yeliz
    Mitkov, Ruslan
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (06) : 1254 - 1261
  • [10] A Game-Based Cognitive Assessment for Visuospatial Tasks: Evaluation in Healthy Adults
    Hadjiaros, M.
    Neokleous, K.
    Schiza, E.
    Matsangidou, M.
    Avraamide, M. N.
    Pattichis, C. S.
    2021 IEEE 21ST INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOENGINEERING (IEEE BIBE 2021), 2021,
12345