Investigating Visual Perception Impairments through Serious Games and Eye Tracking to Anticipate Handwriting Difficulties

被引:0
作者
Piazzalunga, Chiara [1 ]
Dui, Linda Greta [1 ]
Termine, Cristiano [2 ]
Bortolozzo, Marisa [2 ]
Matteucci, Matteo [1 ]
Ferrante, Simona [1 ]
机构
[1] Politecn Milan, Dept Elect Informat & Bioengn, I-20133 Milan, Italy
[2] Univ Insubria, Dept Med & Surg, I-21100 Varese, Italy
基金
欧盟地平线“2020”;
关键词
gamification; dysgraphia; eye tracking; SELF-ESTEEM; VIDEO GAMES; CHILDREN; DYSGRAPHIA; SKILLS; MOVEMENTS; DYSLEXIA; VISION; SCHOOL;
D O I
10.3390/s23041765
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Dysgraphia is a learning disability that causes handwritten production below expectations. Its diagnosis is delayed until the completion of handwriting development. To allow a preventive training program, abilities not directly related to handwriting should be evaluated, and one of them is visual perception. To investigate the role of visual perception in handwriting skills, we gamified standard clinical visual perception tests to be played while wearing an eye tracker at three difficulty levels. Then, we identified children at risk of dysgraphia through the means of a handwriting speed test. Five machine learning models were constructed to predict if the child was at risk, using the CatBoost algorithm with Nested Cross-Validation, with combinations of game performance, eye-tracking, and drawing data as predictors. A total of 53 children participated in the study. The machine learning models obtained good results, particularly with game performances as predictors (F1 score: 0.77 train, 0.71 test). SHAP explainer was used to identify the most impactful features. The game reached an excellent usability score (89.4 +/- 9.6). These results are promising to suggest a new tool for dysgraphia early screening based on visual perception skills.
引用
收藏
页数:20
相关论文
共 66 条
[1]  
Abt C. C., 1987, Serious games
[2]  
American Psychiatric Association, 2022, Diagnostic and Statistical Manual of Mental Disorders, V5th, DOI DOI 10.1176/APPI.BOOKS.9780890425596
[3]   Automated human-level diagnosis of dysgraphia using a consumer tablet [J].
Asselborn, Thibault ;
Gargot, Thomas ;
Kidzinski, Lukasz ;
Johal, Wafa ;
Cohen, David ;
Jolly, Caroline ;
Dillenbourg, Pierre .
NPJ DIGITAL MEDICINE, 2018, 1
[4]  
Berninger V.W., UNDERSTANDING DYSGRA
[5]   Evidence-Based Diagnosis and Treatment for Specific Learning Disabilities Involving Impairments in Written and/or Oral Language [J].
Berninger, Virginia W. ;
May, Maggie O'Malley .
JOURNAL OF LEARNING DISABILITIES, 2011, 44 (02) :167-183
[6]  
Berninger VW., 2009, Teaching students with dyslexia and dysgraphia: Lessons from teaching and science
[7]   Do action video games improve perception and cognition? [J].
Boot, Walter R. ;
Blakely, Daniel P. ;
Simons, Daniel J. .
FRONTIERS IN PSYCHOLOGY, 2011, 2
[8]   Children's future parasocial relationships with media characters: the age of intelligent characters [J].
Brunick, Kaitlin L. ;
Putnam, Marisa M. ;
McGarry, Lauren E. ;
Richards, Melissa N. ;
Calvert, Sandra L. .
JOURNAL OF CHILDREN AND MEDIA, 2016, 10 (02) :181-190
[9]  
BUCKLAND M, 1994, J AM SOC INFORM SCI, V45, P12, DOI 10.1002/(SICI)1097-4571(199401)45:1<12::AID-ASI2>3.0.CO
[10]  
2-L