Custom arithmetic for high-speed, low-resource ASR systems

被引:0
|
作者
Malkin, J [1 ]
Li, X [1 ]
Bilmes, J [1 ]
机构
[1] Univ Washington, Dept Elect Engn, SSLI Lab, Seattle, WA 98195 USA
来源
2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL V, PROCEEDINGS: DESIGN AND IMPLEMENTATION OF SIGNAL PROCESSING SYSTEMS INDUSTRY TECHNOLOGY TRACKS MACHINE LEARNING FOR SIGNAL PROCESSING MULTIMEDIA SIGNAL PROCESSING SIGNAL PROCESSING FOR EDUCATION | 2004年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the skyrocketing popularity of mobile devices, new processing methods tailored for low-resource systems have become necessary. We propose the use of custom arithmetic, arithmetic logic tailored to a specific application. In a system with all parameters quantized to low precision, such arithmetic can be implemented through a set of small, fast table lookups. We present here a framework for the design of such a system architecture, and several heuristic algorithms to optimize system performance. In addition, we apply our techniques to an automatic speech recognition (ASR) application. Our simulations on various architectures show that on most modem processor designs, we can expect a cycle-count speedup of at least 3 times while requiring a total of only 59kB of ROMs to hold the lookup tables.
引用
收藏
页码:305 / 308
页数:4
相关论文
共 50 条
  • [1] A high-speed, low-resource ASR back-end based on custom arithmetic
    Li, Xiao
    Malkin, Jonathan
    Bilmes, Jeff A.
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2006, 14 (05): : 1683 - 1693
  • [2] Codebook design for ASR systems using custom arithmetic units
    Li, X
    Malkin, J
    Bilmes, J
    2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL I, PROCEEDINGS: SPEECH PROCESSING, 2004, : 845 - 848
  • [3] INCORPORATING DISCRIMINATIVE DPGMM POSTERIORGRAMS FOR LOW-RESOURCE ASR
    Wu, Bin
    Sakti, Sakriani
    Nakamura, Satoshi
    2021 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP (SLT), 2021, : 201 - 208
  • [4] Data Augmentation for Low-Resource Quechua ASR Improvement
    Zevallos, Rodolfo
    Bel, Nuria
    Cambara, Guillermo
    Farrus, Mireia
    Luque, Jordi
    INTERSPEECH 2022, 2022, : 3518 - 3522
  • [5] SYNTHETIC DATA AUGMENTATION FOR IMPROVING LOW-RESOURCE ASR
    Thai, Bao
    Jimerson, Robert
    Arcoraci, Dominic
    Prud'hommeaux, Emily
    Ptucha, Raymond
    2019 IEEE WESTERN NEW YORK IMAGE AND SIGNAL PROCESSING WORKSHOP (WNYISPW), 2019,
  • [6] Reduce and Reconstruct: ASR for Low-Resource Phonetic Languages
    Diwan, Anuj
    Jyothi, Preethi
    INTERSPEECH 2021, 2021, : 3445 - 3449
  • [7] MULTILINGUAL SHIFTING DEEP BOTTLENECK FEATURES FOR LOW-RESOURCE ASR
    Quoc Bao Nguyen
    Gehring, Jonas
    Mueller, Markus
    Stueker, Sebastian
    Waibel, Alex
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [8] SEMI-SUPERVISED TRAINING IN LOW-RESOURCE ASR AND KWS
    Metze, Florian
    Gandhe, Ankur
    Miao, Yajie
    Sheikh, Zaid
    Wang, Yun
    Xu, Di
    Zhang, Hao
    Kim, Jungsuk
    Lane, Ian
    Lee, Won Kyum
    Stueker, Sebastian
    Mueller, Markus
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 4699 - 4703
  • [9] A novel low-resource consumption and high-speed hardware implementation of HOG feature extraction on FPGA for human detection
    He, Yuhai
    Huang, Jiye
    Pan, Yiming
    INTEGRATION-THE VLSI JOURNAL, 2024, 97
  • [10] ANALYZING ASR PRETRAINING FOR LOW-RESOURCE SPEECH-TO-TEXT TRANSLATION
    Stoian, Mihaela C.
    Bansal, Sameer
    Goldwater, Sharon
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 7909 - 7913