Real-time lip-synch face animation driven by human voice

被引：0
|
作者：
Huang, FJ [1 ]
Chen, TH [1 ]
机构：
[1] Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
来源：
1998 IEEE SECOND WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING | 1998年
关键词：
D O I：
暂无
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this demo, we present a technique for synthesizing the mouth movement from acoustic speech information. The algorithm maps the audio parameter set to the visual. parameter set using the Gaussian Mixture Model and the Hidden Markov Model, With this technique, we can create smooth and realistic lip movements.
引用
收藏
页码：352 / 357
页数：6
相关论文
共 50 条
  • [1] SVM-based phoneme classification and lip shape refinement in real-time lip-synch system
    Ko, Hanseok
    Han, David K.
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2006, 20 (07) : 1029 - 1051
  • [2] Efficient lip-synch tool for 3D cartoon animation
    Kawamoto, Shin-ichi
    Yotsukura, Tatsuo
    Anjyo, Ken
    Nakamura, Satoshi
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2008, 19 (3-4) : 247 - 257
  • [3] Real-time face synthesis driven by voice
    Huang, Y
    Ding, XQ
    Gu, BN
    Shum, HY
    CAD/GRAPHICS '2001: PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN AND COMPUTER GRAPHICS, VOLS 1 AND 2, 2001, : 393 - 398
  • [4] Real-time Projection of Lip Animation onto Face Masks using OmniProcam
    Takagi, Luna
    Sato, Toshiki
    Miyafuji, Shio
    Koike, Hideki
    SIGGRAPH '21: ACM SIGGRAPH 2021 POSTERS, 2021,
  • [5] FACE IT!: A PIPELINE FOR REAL-TIME PERFORMANCE-DRIVEN FACIAL ANIMATION
    Barros, Jilliam Maria Diaz
    Golyanik, Vladislav
    Varanasi, Kiran
    Stricker, Didier
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2209 - 2213
  • [6] Kernel-Based Lip Shape Clustering with Phoneme Recognition for Real-Time Voice Driven Talking Face
    Shih, Po-Yi
    Wang, Jhing-Fa
    Chen, Zong-You
    ADVANCES IN NEURAL NETWORKS - ISNN 2010, PT 2, PROCEEDINGS, 2010, 6064 : 516 - 523
  • [7] Real-time speech-driven 3D face animation
    Hong, PY
    Wen, Z
    Huang, TS
    Shum, HY
    FIRST INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING VISUALIZATION AND TRANSMISSION, 2002, : 713 - 716
  • [8] Real-Time Speech Driven Gesture Animation
    Kasarci, Kenan
    Bozkurt, Elif
    Yemez, Yucel
    Erzin, Engin
    2016 24TH SIGNAL PROCESSING AND COMMUNICATION APPLICATION CONFERENCE (SIU), 2016, : 1917 - 1920
  • [9] Real-time speech-driven face animation with expressions using neural networks
    Hong, PY
    Wen, Z
    Huang, TS
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (04): : 916 - 927
  • [10] FRAMEWORK DEVELOPMENT OF REAL-TIME LIP SYNC ANIMATION ON VISEME BASED HUMAN SPEECH
    Hoon, Loh Ngiik
    Rahman, Khairul Aidil Azlin Abd.
    Chai, Wang Yin
    JURNAL TEKNOLOGI, 2015, 75 (04): : 43 - 48
12345