Human-Computer Interaction System: A Survey of Talking-Head Generation

被引:24
|
作者
Zhen, Rui [1 ]
Song, Wenchao [1 ]
He, Qiang [1 ,2 ]
Cao, Juan [1 ]
Shi, Lei [1 ]
Luo, Jia [3 ]
机构
[1] Commun Univ China, State Key Lab Media Convergence & Commun, Beijing 100024, Peoples R China
[2] State Key Lab Media Convergence Prod Technol & Sys, Beijing 100803, Peoples R China
[3] Beijing Univ Technol, Coll Econ & Management, Beijing 100124, Peoples R China
关键词
talking-head generation; virtual human generation; human-computer interaction; IMAGE;
D O I
10.3390/electronics12010218
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Virtual human is widely employed in various industries, including personal assistance, intelligent customer service, and online education, thanks to the rapid development of artificial intelligence. An anthropomorphic digital human can quickly contact people and enhance user experience in human-computer interaction. Hence, we design the human-computer interaction system framework, which includes speech recognition, text-to-speech, dialogue systems, and virtual human generation. Next, we classify the model of talking-head video generation by the virtual human deep generation framework. Meanwhile, we systematically review the past five years' worth of technological advancements and trends in talking-head video generation, highlight the critical works and summarize the dataset.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Virtual Human Talking-Head Generation
    Song, Wenchao
    He, Qiang
    Chen, Guowei
    2023 2ND ASIA CONFERENCE ON ALGORITHMS, COMPUTING AND MACHINE LEARNING, CACML 2023, 2023, : 1 - 5
  • [2] A human-computer interaction system based on eye, eyebrow and head movements
    Tas, Muhammed Oguz
    Yavuz, Hasan Serhan
    PAMUKKALE UNIVERSITY JOURNAL OF ENGINEERING SCIENCES-PAMUKKALE UNIVERSITESI MUHENDISLIK BILIMLERI DERGISI, 2022, 28 (05): : 632 - 642
  • [3] A Survey on Talking Head Generation
    Song Y.
    Zhang W.
    Chen Z.
    Jiang Y.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (10): : 1457 - 1468
  • [4] Human-computer interaction for the generation of image processing applications
    Clouard, Regis
    Renouf, Arnaud
    Revenu, Marinette
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2011, 69 (04) : 201 - 219
  • [5] Generic System for Human-Computer Gesture Interaction
    Trigueiros, Paulo
    Ribeiro, Fernando
    Reis, Luis Paulo
    2014 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC), 2014, : 175 - 180
  • [6] Human-Computer Affective Interaction System Research and Application Based on Physiological Signals: A Survey
    Ping, An
    Wang, Zhiliang
    CCDC 2009: 21ST CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, PROCEEDINGS, 2009, : 5867 - 5870
  • [7] A literature survey on applications of neural networks for human-computer interaction
    Yasdi, R
    NEURAL COMPUTING & APPLICATIONS, 2000, 9 (04) : 245 - 258
  • [8] Talking Head Generation for Media Interaction System with Feature Disentanglement
    Zhang, Lei
    Chen, Qingyang
    Liu, Zhilei
    2022 IEEE 28TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, ICPADS, 2022, : 403 - 410
  • [9] Next generation of human-computer interaction technology based on Kinect
    Teng, Zhen Fang
    Teng, Z. F. (tengzhenfang0516@163.com), 2013, Trans Tech Publications Ltd, Kreuzstrasse 10, Zurich-Durnten, CH-8635, Switzerland (329) : 478 - 482
  • [10] Integrating Human-Computer Interaction Artifacts into System Development
    Moundalexis, Megan
    Deery, Janet
    Roberts, Kendal
    HUMAN CENTERED DESIGN, PROCEEDINGS, 2009, 5619 : 284 - 291