Considerations on Multimodal Human-Computer Interaction

被引:0
作者
Liu, Chang [1 ]
Xie, Wenjun [1 ]
Zhang, Peng [1 ]
Zhan, Jia [1 ]
Xiao, Zonghao [1 ]
机构
[1] Air Force Engn Univ, Equipment Management & Unmanned Aerial Vehicle En, Xian 710051, Shaanxi, Peoples R China
来源
PROCEEDINGS OF 2018 5TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS) | 2018年
关键词
Modalities; Human-computer interaction; Fusion technology; Artificial intelligence; INTERFACES;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper first briefly reviews some key issues in multimodal human-computer interaction (MMHCI), including the history, opportunities and challenges of this field. It also reviews that development history of multimodal human-computer interaction, explains the necessity and feasibility of developing MMHCI and emphasizes the fusion of MMHCI about related technologies and the problems which need to be solved. Finally, it describes the goal of MMHCI and the technological challenges faced in the researches. With the rapid development of artificial intelligence and high performance sensors, MMHCI will replace the unimodal human-computer interaction in the future.
引用
收藏
页码:331 / 335
页数:5
相关论文
共 50 条
[21]   Concept-based evidential reasoning for multimodal fusion in human-computer interaction [J].
Reddy, B. Srinath ;
Basir, Otman A. .
APPLIED SOFT COMPUTING, 2010, 10 (02) :567-577
[22]   Joint Interpretation of Input Speech and Pen Gestures for Multimodal Human-Computer Interaction [J].
Hui, Pui-Yu ;
Meng, Helen M. .
INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5, 2006, :1197-1200
[23]   Human-Computer Interaction in Bed [J].
Desouzart, Gustavo ;
Filgueiras, Ernesto .
DESIGN, USER EXPERIENCE, AND USABILITY: INTERACTIVE EXPERIENCE DESIGN (DUXU 2015), PT III, 2015, 9188 :596-605
[24]   AN OVERVIEW OF HUMAN-COMPUTER INTERACTION [J].
BEAUDOUINLAFON, M .
BIOCHIMIE, 1993, 75 (05) :321-329
[25]   Complexity and human-computer interaction [J].
Schlick, CM ;
Winkelholz, C ;
Motz, F ;
Brütting, M .
2003 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS, VOLS 1-5, CONFERENCE PROCEEDINGS, 2003, :2360-2367
[26]   Dual-task performance in multimodal human-computer interaction: a psychophysiological perspective [J].
Domen Novak ;
Matjaž Mihelj ;
Marko Munih .
Multimedia Tools and Applications, 2012, 56 :553-567
[27]   A Historiography of Human-Computer Interaction [J].
Petrick, Elizabeth R. .
IEEE ANNALS OF THE HISTORY OF COMPUTING, 2020, 42 (04) :8-23
[28]   Introduction to Human-Computer Interaction [J].
Lazar, Jonathan ;
Junqueira Barbosa, Simone Diniz .
CHI EA '19 EXTENDED ABSTRACTS: EXTENDED ABSTRACTS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
[29]   A novel gaze-supported multimodal human-computer interaction for ultrasound machines [J].
Zhu, Hongzhi ;
Salcudean, Septimiu E. ;
Rohling, Robert N. .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2019, 14 (07) :1107-1115
[30]   Dual-task performance in multimodal human-computer interaction: a psychophysiological perspective [J].
Novak, Domen ;
Mihelj, Matjaz ;
Munih, Marko .
MULTIMEDIA TOOLS AND APPLICATIONS, 2012, 56 (03) :553-567