The Affective Computing Approach to Affect Measurement

被引:67
作者
D'Mello, Sidney [1 ,2 ]
Kappas, Arvid [3 ]
Gratch, Jonathan [4 ,5 ]
机构
[1] Univ Notre Dame, Dept Comp Sci, 118 Haggar, Notre Dame, IN 46556 USA
[2] Univ Notre Dame, Dept Psychol, 118 Haggar, Notre Dame, IN 46556 USA
[3] Jacobs Univ, Dept Psychol, Bremen, Germany
[4] Univ Southern Calif, Inst Creat Technol, Los Angeles, CA USA
[5] Univ Southern Calif, Dept Comp Sci, Los Angeles, CA USA
基金
美国国家科学基金会;
关键词
affect detection; affective measurement; multimodal sensing; supervised classification; CULTURAL SPECIFICITY; EMOTION; EXPRESSION; CLASSIFICATION; UNIVERSALITY; RECOGNITION; MODELS;
D O I
10.1177/1754073917696583
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Affective computing (AC) adopts a computational approach to study affect. We highlight the AC approach towards automated affect measures that jointly model machine-readable physiological/behavioral signals with affect estimates as reported by humans or experimentally elicited. We describe the conceptual and computational foundations of the approach followed by two case studies: one on discrimination between genuine and faked expressions of pain in the lab, and the second on measuring nonbasic affect in the wild. We discuss applications of the measures, analyze measurement accuracy and generalizability, and highlight advances afforded by computational tipping points, such as big data, wearable sensing, crowdsourcing, and deep learning. We conclude by advocating for increasing synergies between AC and affective science and offer suggestions toward that direction.
引用
收藏
页码:174 / 183
页数:10
相关论文
共 61 条
[1]  
[Anonymous], FACET FAC EXPR REC S
[2]  
[Anonymous], 2010, Blueprint for affective computing: A sourcebook
[3]  
[Anonymous], 1997, Affective Computing
[4]  
[Anonymous], 2010, A Blueprint for Affective Computing: A Sourcebook and Manual
[5]  
Association for the Advancement of Affective Computing (AAAC), 2016, COLL EM DAT
[6]   The Conceptual Act Theory: A Precis [J].
Barrett, Lisa Feldman .
EMOTION REVIEW, 2014, 6 (04) :292-297
[7]   Automatic Decoding of Facial Movements Reveals Deceptive Pain Expressions [J].
Bartlett, Marian Stewart ;
Littlewort, Gwen C. ;
Frank, Mark G. ;
Lee, Kang .
CURRENT BIOLOGY, 2014, 24 (07) :738-743
[8]   A survey of context modelling and reasoning techniques [J].
Bettini, Claudio ;
Brdiczka, Oliver ;
Henricksen, Karen ;
Indulska, Jadwiga ;
Nicklas, Daniela ;
Ranganathan, Anand ;
Riboni, Daniele .
PERVASIVE AND MOBILE COMPUTING, 2010, 6 (02) :161-180
[9]   Using Video to Automatically Detect Learner Affect in Computer-Enabled Classrooms [J].
Bosch, Nigel ;
D'Mello, Sidney K. ;
Ocumpaugh, Jaclyn ;
Baker, Ryan S. ;
Shute, Valerie .
ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS, 2016, 6 (02)
[10]   Accuracy vs. Availability Heuristic in Multimodal Affect Detection in the Wild [J].
Bosch, Nigel ;
Chen, Huili ;
Baker, Ryan ;
Shute, Valerie ;
D'Mello, Sidney .
ICMI'15: PROCEEDINGS OF THE 2015 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2015, :267-274