Realistic avatar eye and head animation using a neurobiological model of visual attention

被引:140
作者
Itti, L [1 ]
Dhavale, N [1 ]
Pighin, F [1 ]
机构
[1] Univ So Calif, Dept Comp Sci, Los Angeles, CA 90089 USA
来源
APPLICATIONS AND SCIENCE OF NEURAL NETWORKS, FUZZY SYSTEMS, AND EVOLUTIONARY COMPUTATION VI | 2003年 / 5200卷
关键词
D O I
10.1117/12.512618
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We describe a neurobiological model of visual attention and eye/head movements in primates, and its application to the automatic animation of a realistic virtual human head watching an unconstrained variety of visual inputs. The bottom-up (image-based) attention model is based on the known neurophysiology of visual processing along the occipito-parietal pathway of the primate brain, while the eye/head movement model is derived from recordings in freely behaving Rhesus monkeys. The system is successful at autonomously saccading towards and tracking salient targets in a variety of video clips, including synthetic stimuli, real outdoors scenes and gaming console outputs. The resulting virtual human eye/head animation yields realistic rendering of the simulation results, both suggesting applicability of this approach to avatar animation and reinforcing the plausibility of the neural model.
引用
收藏
页码:64 / 78
页数:15
相关论文
共 67 条
[41]  
NAVALPAKKAM V, 2002, P 2 WORKSH BIOL MOT, P453
[42]   Modeling the role of salience in the allocation of overt visual attention [J].
Parkhurst, D ;
Law, K ;
Niebur, E .
VISION RESEARCH, 2002, 42 (01) :107-123
[43]  
PETERS C, 2002, COMPUT GRAPH FORUM, V21, P1
[44]  
PETERS RJ, 2002, P SOC NEUR ANN M SFN
[45]  
PIGHIN F, 1998, SIGGRAPH P, P75
[46]   THE ARCHITECTURE OF PERCEPTUAL SPATIAL INTERACTIONS [J].
POLAT, U ;
SAGI, D .
VISION RESEARCH, 1994, 34 (01) :73-78
[47]   NEURAL SYSTEMS CONTROL OF SPATIAL ORIENTING [J].
POSNER, MI ;
COHEN, Y ;
RAFAL, RD .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY OF LONDON SERIES B-BIOLOGICAL SCIENCES, 1982, 298 (1089) :187-198
[49]  
Renault O., 1990, Journal of Visualization and Computer Animation, V1, P18, DOI 10.1002/vis.4340010106
[50]  
RIKERT T, 1998, INT C AUT FAC GEST R