AUTOMATIC SCORING OF A NONWORD REPETITION TEST

被引:0
作者
Asgari, Meysam [1 ]
Van Santen, Jan [1 ]
Papadakis, Katina [1 ]
机构
[1] Oregon Hlth & Sci Univ, Inst Dev & Disabil, Ctr Spoken Language Understanding, Portland, OR 97201 USA
来源
2017 16TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA) | 2017年
关键词
Automatic Scoring; Autism Spectrum Disorder; Nonword stimuli repetition; MEMORY;
D O I
10.1109/ICMLA.2017.0-143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this study, we explore the feasibility of speech-based techniques to automatically evaluate a nonword repetition (NWR) test. NWR tests, a useful marker for detecting language impairment, require repetition of pronounceable nonwords, such as "DOYF", presented aurally by an examiner or via a recording. Our proposed method leverages ASR techniques to first transcribe verbal responses. Second, it applies machine learning techniques to ASR output for predicting gold standard scores provided by speech and language pathologists. Our experimental results for a sample of 101 children (42 with autism spectrum disorders, or ASD; 18 with specific language impairment, or SLI; and 41 typically developed, or TD) show that the proposed approach is successful in predicting scores on this test, with averaged product-moment correlations of 0.74 and mean absolute error of 0.06 (on a observed score range from 0.34 to 0.97) between observed and predicted ratings.
引用
收藏
页码:304 / 308
页数:5
相关论文
共 50 条
[21]   Fine-tuning ChatGPT for automatic scoring [J].
Latif E. ;
Zhai X. .
Computers and Education: Artificial Intelligence, 2024, 6
[22]   A method for automatic, objective and continuous scoring of bradykinesia [J].
Martinez-Manzanera, O. ;
Roosma, E. ;
Beudel, M. ;
Borgemeester, R. W. K. ;
van Laar, T. ;
Maurits, N. M. .
2015 IEEE 12TH INTERNATIONAL CONFERENCE ON WEARABLE AND IMPLANTABLE BODY SENSOR NETWORKS (BSN), 2015,
[23]   Automatic Arabic Essays Scoring: A Scoping Review [J].
Elhaddadi, Chima ;
Zeroual, Imad ;
El Kah, Anoual .
ARABIC LANGUAGE PROCESSING: FROM THEORY TO PRACTICE, ICALP 2023, PT I, 2025, 2339 :38-48
[24]   Automatic Scoring of Pronunciation Quality with Hybrid Measure [J].
Dong, Bin ;
Ge, Fengpei ;
Pan, Fuping ;
Chan, Shui-duen .
2009 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTATIONAL INTELLIGENCE, VOL III, PROCEEDINGS, 2009, :381-+
[25]   Unveiling Scoring Processes: Dissecting the Differences Between LLMs and Human Graders in Automatic Scoring [J].
Wu, Xuansheng ;
Saraf, Padmaja Pravin ;
Lee, Gyeonggeon ;
Latif, Ehsan ;
Liu, Ninghao ;
Zhai, Xiaoming .
TECHNOLOGY KNOWLEDGE AND LEARNING, 2025,
[26]   Automatic, Qualitative Scoring of the Interlocking Pentagon Drawing Test (PDT) Based on U-Net and Mobile Sensor Data [J].
Park, Ingyu ;
Kim, Yun Joong ;
Kim, Yeo Jin ;
Lee, Unjoo .
SENSORS, 2020, 20 (05)
[27]   Automatic, Qualitative Scoring of the Clock Drawing Test (CDT) Based on U-Net, CNN and Mobile Sensor Data [J].
Park, Ingyu ;
Lee, Unjoo .
SENSORS, 2021, 21 (15)
[28]   Visual and automatic cyclic alternating pattern (CAP) scoring [J].
Rosa, Agostinho ;
Alves, Gabriela Rodrigues ;
Brito, Magneide ;
Lopes, Maria Cecilia ;
Tufik, Sergio .
ARQUIVOS DE NEURO-PSIQUIATRIA, 2006, 64 (3A) :578-581
[29]   Automatic Short Answer Scoring based on Paragraph Embeddings [J].
Hassan, Sarah ;
Fahmy, Aly A. ;
El-Ramly, Mohammad .
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2018, 9 (10) :397-402
[30]   Knowledge Distillation of LLMs for Automatic Scoring of Science Assessments [J].
Latif, Ehsan ;
Fang, Luyang ;
Ma, Ping ;
Zhai, Xiaoming .
ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS, DOCTORAL CONSORTIUM AND BLUE SKY, AIED 2024, 2024, 2151 :166-174