Automatic recognition of eye blinking in spontaneously occurring behavior

被引:25
作者
Cohn, JF
Xiao, J
Moriyama, T
Ambadar, Z
Kanade, T
机构
[1] Univ Pittsburgh, Dept Psychol, Pittsburgh, PA 15260 USA
[2] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
来源
BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS | 2003年 / 35卷 / 03期
关键词
D O I
10.3758/BF03195519
中图分类号
B841 [心理学研究方法];
学科分类号
040201 ;
摘要
Previous research in automatic facial expression recognition has been limited to recognition of gross expression categories (e.g., joy or anger) in posed facial behavior under well-controlled conditions (e.g., frontal pose and minimal out-of-plane head motion). We have developed a system that detects a discrete and important facial action (e.g., eye blinking) in spontaneously occurring facial behavior that has been measured with a nonfrontal pose, moderate out-of-plane head motion, and occlusion. The system recovers three-dimensional motion parameters, stabilizes facial regions, extracts motion and appearance information, and recognizes discrete facial actions in spontaneous facial behavior. We tested the system in video data from a two-person interview. The 10 subjects were ethnically diverse, action units occurred during speech, and out-of-plane motion and occlusion from head motion and glasses were common. The video data were originally collected to answer substantive questions in psychology and represent a substantial challenge to automated action unit recognition. In analysis of blinks, the system achieved 98% accuracy.
引用
收藏
页码:420 / 428
页数:9
相关论文
共 52 条
[1]  
[Anonymous], 2001, TELLING LIES
[2]  
[Anonymous], OBSERVING BEHAV INTR
[3]   Measuring facial expressions by computer image analysis [J].
Bartlett, MS ;
Hager, JC ;
Ekman, P ;
Sejnowski, TJ .
PSYCHOPHYSIOLOGY, 1999, 36 (02) :253-263
[4]  
BARTLETT MS, 2001, MPLABTR200106 U CAL
[5]  
Black M, 1992, THESIS YALE U
[6]  
Bruce V., 1998, In the eye of the beholder: the science of face perception
[7]   EARLY EXPERIENCE AND EMOTIONAL DEVELOPMENT - THE EMERGENCE OF WARINESS OF HEIGHTS [J].
CAMPOS, JJ ;
BERTENTHAL, BI ;
KERMOIAN, R .
PSYCHOLOGICAL SCIENCE, 1992, 3 (01) :61-64
[8]   Infant ''surprise'' expressions as coordinative motor structures [J].
Camras, LA ;
Lambrecht, L ;
Michel, GF .
JOURNAL OF NONVERBAL BEHAVIOR, 1996, 20 (03) :183-195
[9]   EFFECT OF CONTINGENT CHANGES IN MOTHERS AFFECTIVE EXPRESSION ON THE ORGANIZATION OF BEHAVIOR IN 3-MONTH-OLD INFANTS [J].
COHN, JF ;
ELMORE, M .
INFANT BEHAVIOR & DEVELOPMENT, 1988, 11 (04) :493-505
[10]   Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding [J].
Cohn, JF ;
Zlochower, AJ ;
Lien, J ;
Kanade, T .
PSYCHOPHYSIOLOGY, 1999, 36 (01) :35-43