An Acoustic Signal Based Language Independent Lip Synchronization Method and Its Implementation via Extended LPC

被引：0

作者：

Cankurtaran, Halil Said ^{[1
]}

Boyaci, Ali ^{[2
]}

Yarkan, Serhan ^{[1
]}

机构：

[1] Istanbul Ticaret Univ, Elekt Elekt Muhendisligi Bolumu, Kucukyali E5 Kavsagi,Inonu Cad,4 Kucukyali, TR-34840 Istanbul, Turkey

[2] Istanbul Ticaret Univ, Bilgisayar Muhendisligi Bolumu, Kucukyali E5 Kavsagi,Inonu Cad,4 Kucukyali, TR-34840 Istanbul, Turkey

来源：

2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU) | 2020年

关键词：

formant frequency; linear predictive coding; lip sync;

D O I：

暂无

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

Processing human speech with the use of digital technologies leads to several important fields of research. Speech-to-text and lip-syncing are among the instances of relevant prominent research areas. In this regard, audio-visualization of acoustic signals, providing visual aid in real-time for disabled people, and realization of text-free animation applications are just to name a few. Therefore, in this study, a language-independent lip-sync method that is based on extended linear predictive coding is proposed. The proposed method operates on baseband electrical signal that is acquired by a standard single-channel off-the-shelf microphone and exploits the statistical characteristics of acoustic signals produced by human speech. In addition, the proposed method is implemented on an embedded system, tested, and its performance is evaluated. Results are given along with discussions and future directions.

引用

页数：4

共 17 条

[1] Speaker-Independent Speech-Driven Visual Speech Synthesis using Domain-Adapted Acoustic Models [J].