AUTOMATIC SCORING OF A NONWORD REPETITION TEST

被引:0
作者
Asgari, Meysam [1 ]
Van Santen, Jan [1 ]
Papadakis, Katina [1 ]
机构
[1] Oregon Hlth & Sci Univ, Inst Dev & Disabil, Ctr Spoken Language Understanding, Portland, OR 97201 USA
来源
2017 16TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA) | 2017年
关键词
Automatic Scoring; Autism Spectrum Disorder; Nonword stimuli repetition; MEMORY;
D O I
10.1109/ICMLA.2017.0-143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this study, we explore the feasibility of speech-based techniques to automatically evaluate a nonword repetition (NWR) test. NWR tests, a useful marker for detecting language impairment, require repetition of pronounceable nonwords, such as "DOYF", presented aurally by an examiner or via a recording. Our proposed method leverages ASR techniques to first transcribe verbal responses. Second, it applies machine learning techniques to ASR output for predicting gold standard scores provided by speech and language pathologists. Our experimental results for a sample of 101 children (42 with autism spectrum disorders, or ASD; 18 with specific language impairment, or SLI; and 41 typically developed, or TD) show that the proposed approach is successful in predicting scores on this test, with averaged product-moment correlations of 0.74 and mean absolute error of 0.06 (on a observed score range from 0.34 to 0.97) between observed and predicted ratings.
引用
收藏
页码:304 / 308
页数:5
相关论文
共 50 条
[31]   Knowledge Distillation of LLMs for Automatic Scoring of Science Assessments [J].
Latif, Ehsan ;
Fang, Luyang ;
Ma, Ping ;
Zhai, Xiaoming .
ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS, DOCTORAL CONSORTIUM AND BLUE SKY, AIED 2024, 2024, 2151 :166-174
[32]   Automatic Scoring in a Task of Retelling Stories for Language Learners [J].
Chen, Meng ;
Luo, Dean ;
Wang, Lan .
WMSCI 2011: 15TH WORLD MULTI-CONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL I, 2011, :289-292
[33]   Automatic proficiency scoring for early-stage writing [J].
Andersen M.R. ;
Kabel K. ;
Bremholm J. ;
Bundsgaard J. ;
Hansen L.K. .
Computers and Education: Artificial Intelligence, 2023, 5
[34]   Two Experiments for Automatic Scoring of Handwritten Descriptive Answers [J].
Nakagawa, Masaki ;
Hung Tuan Nguyen ;
Nghia Thanh Truong ;
Nam Tuan Ly ;
Cuong Tuan Nguyen ;
Oka, Haruki ;
Ishioka, Tsunenori ;
Asakura, Tomo ;
Miyazawa, Hiroshi ;
Yamamoto, Takahiro ;
Horie, Toshihiko ;
Yasuno, Fumiko .
DOCUMENT ANALYSIS SYSTEMS, DAS 2024, 2024, 14994 :3-19
[35]   Feature Enhanced Capsule Networks for Robust Automatic Essay Scoring [J].
Sharma, Arushi ;
Kabra, Anubha ;
Kapoor, Rajiv .
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2021: APPLIED DATA SCIENCE TRACK, PT V, 2021, 12979 :365-380
[36]   Phoneme, Phone Boundary, and Tone in Automatic Scoring of Mandarin Proficiency [J].
Yuan, Jiahong ;
Liberman, Mark .
17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, :2145-2149
[37]   Deep learning-based scoring method of the three-chamber social behaviour test in a mouse model of alcohol intoxication. A comparative analysis of DeepLabCut, commercial automatic tracking and manual scoring [J].
Zahran, Mohamed Aly ;
Manas-Ojeda, Aroa ;
Navarro-Sanchez, Monica ;
Castillo-Gomez, Esther ;
Olucha-Bordonau, Francisco E. .
HELIYON, 2024, 10 (17)
[38]   Neural signatures of automatic repetition detection in temporally regular and jittered acoustic sequences [J].
Ringer, Hanna ;
Schroeger, Erich ;
Grimm, Sabine .
PLOS ONE, 2023, 18 (11)
[39]   Research of VB Programming Automatic Scoring Method Based on the Windows API [J].
Fei, Tan Peng ;
Heng, Li Yan ;
Yun, Zhang Chang .
INTERNATIONAL MULTICONFERENCE OF ENGINEERS AND COMPUTER SCIENTISTS, IMECS 2012, VOL I, 2012, :235-239
[40]   Effectiveness of sequential automatic-manual home respiratory polygraphy scoring [J].
Masa, Juan F. ;
Corral, Jaime ;
Pereira, Ricardo ;
Duran-Cantolla, Joaquin ;
Cabello, Marta ;
Hernandez-Blasco, Luis ;
Monasterio, Carmen ;
Alonso-Fernandez, Alberto ;
Chiner, Eusebi ;
Vazquez-Polo, Francisco-Jose ;
Montserrat, Jose M. .
EUROPEAN RESPIRATORY JOURNAL, 2013, 41 (04) :879-887