Silent speech interfaces

被引:316
|
作者
Denby, B. [1 ,4 ]
Schultz, T. [2 ]
Honda, K. [3 ]
Hueber, T. [4 ]
Gilbert, J. M. [5 ]
Brumberg, J. S. [6 ]
机构
[1] Univ Paris 06, F-75005 Paris, France
[2] Univ Karlsruhe, Cognit Syst Lab, D-76131 Karlsruhe, Germany
[3] ATR Cognit Informat Sci Labs, Seika, Kyoto 6190288, Japan
[4] ESPCI ParisTech, Elect Lab, F-75005 Paris, France
[5] Univ Hull, Dept Engn, Kingston Upon Hull HU6 7RX, N Humberside, England
[6] Boston Univ, Dept Cognit & Neural Syst, Boston, MA 02215 USA
基金
美国国家科学基金会;
关键词
Silent speech; Speech pathologies; Cellular telephones; Speech recognition; Speech synthesis; BRAIN-COMPUTER INTERFACE; ULTRASOUND IMAGES; RECOGNITION; ELECTRODE; SYSTEM; COMMUNICATION; MOVEMENTS; SIGNALS; PATIENT; HEAD;
D O I
10.1016/j.specom.2009.08.002
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
The possibility of speech processing in the absence of an intelligible acoustic signal has given rise to the idea of a 'silent speech' interface, to be used as an aid for the speech-handicapped, or as part of a communications system operating in silence-required or high-background-noise environments. The article first outlines the emergence of the silent speech interface from the fields of speech production, automatic speech processing, speech pathology research, and telecommunications privacy issues, and then follows with a presentation of demonstrator systems based on seven different types of technologies. A concluding section underlining some of the common challenges faced by silent speech interface researchers, and ideas for possible future directions, is also provided. (C) 2009 Elsevier B.V. All rights reserved.
引用
收藏
页码:270 / 287
页数:18
相关论文
共 50 条
  • [11] Multi-Task Learning of Speech Recognition and Speech Synthesis Parameters for Ultrasound-based Silent Speech Interfaces
    Toth, Laszlo
    Gosztolya, Gabor
    Grosz, Tamas
    Marko, Alexandra
    Csapo, Tamas Gabor
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 3172 - 3176
  • [12] Effects of Speaking Rate on Speech and Silent Speech Recognition
    Pandey, Laxmi
    Arif, Ahmed Sabbir
    EXTENDED ABSTRACTS OF THE 2022 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2022, 2022,
  • [13] ICCHP Keynote: Recognizing Silent and Weak Speech Based on Electromyography
    Schultz, Tanja
    COMPUTERS HELPING PEOPLE WITH SPECIAL NEEDS, PROCEEDINGS, PT 1, 2010, 6179 : 595 - 604
  • [14] IR-UWB Radar-Based Contactless Silent Speech Recognition of Vowels, Consonants, Words, and Phrases
    Lee, Sunghwa
    Shin, Younghoon
    Kim, Myungjong
    Seo, Jiwon
    IEEE ACCESS, 2023, 11 : 144844 - 144859
  • [15] Sequence-to-Sequence Voice Reconstruction for Silent Speech in a Tonal Language
    Li, Huiyan
    Lin, Haohong
    Wang, You
    Wang, Hengyang
    Zhang, Ming
    Gao, Han
    Ai, Qing
    Luo, Zhiyuan
    Li, Guang
    BRAIN SCIENCES, 2022, 12 (07)
  • [16] Exploring Silent Speech Interfaces Based on Frequency-Modulated Continuous-Wave Radar
    Ferreira, David
    Silva, Samuel
    Curado, Francisco
    Teixeira, Antonio
    SENSORS, 2022, 22 (02)
  • [17] Classification of Silent Speech using Adaptive Collection
    Matsumoto, Mariko
    Hori, Junichi
    PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE IN REHABILITATION AND ASSISTIVE TECHNOLOGIES (CIRAT), 2013, : 5 - 12
  • [18] Ultrasensitive textile strain sensors redefine wearable silent speech interfaces with high machine learning efficiency
    Tang, Chenyu
    Xu, Muzi
    Yi, Wentian
    Zhang, Zibo
    Occhipinti, Edoardo
    Dong, Chaoqun
    Ravenscroft, Dafydd
    Jung, Sung-Min
    Lee, Sanghyo
    Gao, Shuo
    Kim, Jong Min
    Occhipinti, Luigi Giuseppe
    NPJ FLEXIBLE ELECTRONICS, 2024, 8 (01)
  • [19] EarCommand: "Hearing" Your Silent Speech Commands In Ear
    Jin, Yincheng
    Gao, Yang
    Xu, Xuhai
    Choi, Seokmin
    Li, Jiyang
    Liu, Feng
    Li, Zhengxiong
    Jin, Zhanpeng
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2022, 6 (02):
  • [20] Applying DNN Adaptation to Reduce the Session Dependency of Ultrasound Tongue Imaging-based Silent Speech Interfaces
    Gosztolya, Gabor
    Grosz, Tamas
    Toth, Laszlo
    Marko, Alexandra
    Csapo, Tamas Gabor
    ACTA POLYTECHNICA HUNGARICA, 2020, 17 (07) : 109 - 124