Human-Computer Communication Using Recognition and Synthesis of Facial Expression

被引:1
作者
Yoshitomi, Yasunari [1 ]
机构
[1] Kyoto Prefectural Univ, Grad Sch Life & Environm Sci, Sakyo Ku, 1-5 Nakaragi Cho, Kyoto 6068522, Japan
来源
JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE | 2021年 / 8卷 / 01期
关键词
Emotion; facial expression recognition; infrared-ray image; facial expression synthesis; personified agent; THERMAL IMAGE; VOWEL JUDGMENT; SYSTEM;
D O I
10.2991/jrnal.k.210521.003
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Y To develop a complex computer system such as a robot that can communicate smoothly with humans, it is necessary to equip the system with a function for both understanding human emotions and expressing emotional signals. From both perspectives, facial expression is a promising research area. In our research, we have explored both aspects of facial expression using infrared-ray images and visible-ray images and have developed a personified agent for expressing emotional signals to humans. A human-computer-human communication system using facial expression analysis and a music recommendation system using a personified agent with facial expression synthesis are reported in this paper. (C) 2021 The Author. Published by Atlantis Press B.V.
引用
收藏
页码:10 / 13
页数:4
相关论文
共 15 条
  • [1] Asada T., 2020, J ADV ARTIF LIFE ROB, V1, P59
  • [2] A System for Posting on an SNS an Author Portrait Selected using Facial Expression Analysis while Writing a Message
    Asada, Taro
    Yano, Yuiko
    Yoshitomi, Yasunari
    Tabuse, Masayoshi
    [J]. JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2019, 6 (03): : 199 - 202
  • [3] Facial Expression Analysis while Using Video Phone
    Asada, Taro
    Yoshitomi, Yasunari
    Tsuji, Airi
    Kato, Ryota
    Tabuse, Masayoshi
    Kuwahara, Noriaki
    Narumoto, Jin
    [J]. JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2016, 2 (04): : 258 - 262
  • [4] Quantitative Evaluation of Facial Expressions and Movements of Persons While Using Video Phone
    Asada, Taro
    Yoshitomi, Yasunari
    Kato, Ryota
    Tabuse, Masayoshi
    Narumoto, Jin
    [J]. JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2015, 2 (02): : 111 - 114
  • [5] Facial expression recognition of a speaker using front-view face judgment, vowel judgment, and thermal image processing
    Fujimura, Tomoko
    Yoshitomi, Yasunari
    Asada, Taro
    Tabuse, Masayoshi
    [J]. ARTIFICIAL LIFE AND ROBOTICS, 2011, 16 (03) : 411 - 417
  • [6] Speech Synthesis of Emotions in a Sentence using Vowel Features
    Makino, Rintaro
    Yoshitomi, Yasunari
    Asada, Taro
    Tabuse, Masayoshi
    [J]. JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2020, 7 (02): : 107 - 110
  • [7] Matsui A, 2021, PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB 2021), P28
  • [8] Emotion Recognition of a Speaker Using Facial Expression Intensity of Thermal Image and Utterance Time
    Oka, Yuuki
    Yoshitomi, Yasunari
    Asada, Taro
    Tabuse, Masayoshi
    [J]. JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2016, 3 (03): : 148 - 151
  • [9] Real-Time System for Horizontal Asymmetry Analysis on Facial Expression and its Visualization
    Shimada, Ryoichi
    Asada, Taro
    Yoshitomi, Yasunari
    Tabuse, Masayoshi
    [J]. JOURNAL OF ROBOTICS NETWORKING AND ARTIFICIAL LIFE, 2019, 6 (01): : 7 - 11
  • [10] Effect of sensor fusion for recognition of emotional states using voice, face image and thermal image of face
    Yoshitomi, Y
    Kim, SI
    Kawano, T
    Kitazoe, T
    [J]. IEEE RO-MAN 2000: 9TH IEEE INTERNATIONAL WORKSHOP ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, PROCEEDINGS, 2000, : 178 - 183