Opti-Speech: A real-time, 3D visual feedback system for speech training

被引：0

作者：

Katz, William ^{[1
]}

Campbell, Thomas ^{[1
]}

Wang, Jun ^{[1
,2
]}

Farrar, Eric ^{[3
]}

Eubanks, J. Coleman ^{[3
]}

Balasubramanian, Arvind ^{[4
]}

Prabhakaran, Balakrishnan ^{[4
]}

Rennaker, Rob ^{[2
,5
]}

机构：

[1] Univ Texas Dallas, Callier Ctr Commun Disorders, Dallas, TX USA

[2] Univ Texas Dallas, Dept Bioengn, Dallas, TX USA

[3] Univ Texas Dallas, Arts & Technol Program, Dallas, TX USA

[4] Univ Texas Dallas, Dept Comp Sci, Dallas, TX USA

[5] Vulintus LLC, Sachse, TX USA

来源：

15TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2014), VOLS 1-4 | 2014年

关键词：

speech production; visual feedback; speech therapy; electromagnetic articulography; APRAXIA;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We describe an interactive 3D system to provide talkers with real-time information concerning their tongue and jaw movements during speech. Speech movement is tracked by a magnetometer system (Wave; NDI, Waterloo, Ontario, Canada). A customized interface allows users to view their current tongue position (represented as an avatar consisting of flesh-point markers and a modeled surface) placed in a synchronously moving, transparent head. Subjects receive augmented visual feedback when tongue sensors achieve the correct place of articulation. Preliminary data obtained for a group of adult talkers suggest this system can be used to reliably provide real-time feedback for American English consonant place of articulation targets. Future studies, including tests with communication disordered subjects, are described.

引用

页码：1174 / 1178

页数：5

共 19 条

[1]

[Anonymous], 2010, COURSE PHONETICS

[2] Can you 'read' tongue movements? Evaluation of the contribution of tongue display to speech understanding [J].

Badin, Pierre ;

Tarabalka, Yuliya ;

Elisei, Frederic ;

Bailly, Gerard .

SPEECH COMMUNICATION, 2010, 52 (06) :493-503

[3] Ultrasound in speech therapy with adolescents and adults [J].

Bernhardt, B ;

Gick, B ;

Bacsfalvi, P ;

Adler-Bock, M .

CLINICAL LINGUISTICS & PHONETICS, 2005, 19 (6-7) :605-617

[4] Accuracy of the NDI Wave Speech Research System [J].

Berry, Jeffrey J. .

JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2011, 54 (05) :1295-1301

[5]

Engwall Olov, 2007, Computer Assisted Language Learning, V20, P235, DOI 10.1080/09588220701489507

[6]

Katz WF., 2010, Perspectives on Neurophysiology and Neurogenic Speech and Language Disorders, V20, P73, DOI [10.1044/nnsld20.3.73, DOI 10.1044/NNSLD20.3.73]

[7] Treatment of an individual with aphasia and apraxia of speech using EMA visually-augmented feedback [J].

Katz, William F. ;

Garst, Diane M. ;

Carter, Gregory S. ;

McNeil, Malcolm R. ;

Fossett, Tepanta R. ;

Doyle, Patrick J. ;

Szuminsky, Neil J. .

BRAIN AND LANGUAGE, 2007, 103 (1-2) :213-214

[8] Treating apraxia of speech (AOS) with EMA-supplied visual augmented feedback [J].

Katz, William F. ;

McNeil, Malcolm R. ;

Garst, Diane M. .

APHASIOLOGY, 2010, 24 (6-8) :826-837

[9]

Levitt JS, 2010, 11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 3 AND 4, P1862

[10]

MACLEOD A, 1987, British Journal of Audiology, V21, P131, DOI 10.3109/03005368709077786

← 1 2 →