Realistic avatar eye and head animation using a neurobiological model of visual attention

被引:140
作者
Itti, L [1 ]
Dhavale, N [1 ]
Pighin, F [1 ]
机构
[1] Univ So Calif, Dept Comp Sci, Los Angeles, CA 90089 USA
来源
APPLICATIONS AND SCIENCE OF NEURAL NETWORKS, FUZZY SYSTEMS, AND EVOLUTIONARY COMPUTATION VI | 2003年 / 5200卷
关键词
D O I
10.1117/12.512618
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We describe a neurobiological model of visual attention and eye/head movements in primates, and its application to the automatic animation of a realistic virtual human head watching an unconstrained variety of visual inputs. The bottom-up (image-based) attention model is based on the known neurophysiology of visual processing along the occipito-parietal pathway of the primate brain, while the eye/head movement model is derived from recordings in freely behaving Rhesus monkeys. The system is successful at autonomously saccading towards and tracking salient targets in a variety of video clips, including synthetic stimuli, real outdoors scenes and gaming console outputs. The resulting virtual human eye/head animation yields realistic rendering of the simulation results, both suggesting applicability of this approach to avatar animation and reinforcing the plausibility of the neural model.
引用
收藏
页码:64 / 78
页数:15
相关论文
共 67 条
[1]  
[Anonymous], VIDERE J COMPUTER VI
[2]   VESTIBULO-OCULAR FUNCTION DURING COORDINATED HEAD AND EYE-MOVEMENTS TO ACQUIRE VISUAL TARGETS [J].
BARNES, GR .
JOURNAL OF PHYSIOLOGY-LONDON, 1979, 287 (FEB) :127-147
[3]   2 MODES OF ACTIVE EYE-HEAD COORDINATION IN MONKEYS [J].
BIZZI, E ;
KALIL, RE ;
MORASSO, P .
BRAIN RESEARCH, 1972, 40 (01) :45-&
[4]  
BIZZI E, 1974, SCI AM, V231, P100
[5]   DISTANCE TRANSFORMATIONS IN DIGITAL IMAGES - COMMENT [J].
BORGEFORS, G .
CVGIP-IMAGE UNDERSTANDING, 1991, 54 (02) :301-306
[6]  
Brand M, 1999, COMP GRAPH, P21, DOI 10.1145/311535.311537
[7]  
BREGLER C, 1997, SIGGRAPH 97, P353
[8]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[9]   SPATIAL INTERACTIONS IN APPARENT CONTRAST - INHIBITORY EFFECTS AMONG GRATING PATTERNS OF DIFFERENT SPATIAL-FREQUENCIES, SPATIAL POSITIONS AND ORIENTATIONS [J].
CANNON, MW ;
FULLENKAMP, SC .
VISION RESEARCH, 1991, 31 (11) :1985-&
[10]   Blink rate, neurocognitive impairments, and symptoms in schizophrenia [J].
Chen, EYH ;
Lam, LCW ;
Chen, RYL ;
Nguyen, DGH .
BIOLOGICAL PSYCHIATRY, 1996, 40 (07) :597-603