A modular multi-chip neuromorphic architecture for real-time visual motion processing

被引:33
作者
Higgins, CM [1 ]
Koch, C [1 ]
机构
[1] CALTECH, Div Biol, Pasadena, CA 91125 USA
基金
美国国家科学基金会;
关键词
analog VLSI; vision chips; optical flow; stereo; neuromorphic;
D O I
10.1023/A:1008309524326
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The extent of pixel-parallel focal plane image processing is limited by pixel area and imager fill factor. In this paper, we describe a novel multi-chip neuromorphic VLSI visual motion processing system which combines analog circuitry with an asynchronous digital interchip communications protocol to allow more complex pixel-parallel motion processing than is possible in the focal plane. This multi-chip system retains the primary advantages of focal plane neuromorphic image processors: low-power consumption, continuous-time operation, and small size. The two basic VLSI building blocks are a photosensitive sender chip which incorporates a 2D imager array and transmits the position of moving spatial edges, and a receiver chip which computes a 2D optical flow vector field from the edge information. The elementary two-chip motion processing system consisting of a single sender and receiver is first characterized. Subsequently, two three-chip motion processing systems are described. The first three-chip system uses two sender chips to compute the presence of motion only at a particular stereoscopic depth from the imagers. The second three-chip system uses two receivers to simultaneously compute a linear and polar topographic mapping of the image plane, resulting in information about image translation, rotation, and expansion. These three-chip systems demonstrate the modularity and flexibility of the multi-chip neuromorphic approach.
引用
收藏
页码:195 / 211
页数:17
相关论文
共 31 条
  • [1] [Anonymous], 1992, THESIS CALTECH PASAD
  • [2] BOAHEN K, 1996, P INT C MICR NEUR NE
  • [3] BOAHEN K, 1996, NSF NEUROMORPHIC ENG
  • [4] BOAHEN K, 1999, P 20 C ADV RES VLSI
  • [5] BOAHEN K, 1999, P 7 INT C MICR NEUR
  • [6] Deiss SR, 1998, PULSED NEURAL NETWORKS, P157
  • [7] DELBRUCK T, 1993, 30 CALTECH DEP COMP
  • [8] DEUTSCHMANN RA, 1998, P INT C ADV FOC PLAN
  • [9] DEWEERTH S, 1997, P 17 C ADV RES VLSI
  • [10] ARTIFICIAL DENDRITIC TREES
    ELIAS, JG
    [J]. NEURAL COMPUTATION, 1993, 5 (04) : 648 - 664