Development of a multispectral active stereo vision system for video surveillance applications

In this paper, a multispectral active stereo vision system is developed for tracking the motion of moving objects in different environment. The development of such a multispectral surveillance system composed by combining visible(color) and infrared sensors. The aim is to behind proposing such a network of visible and thermal sensors is to give an optimal performance in various weather conditions (foggy, snowing, dark and rainy) and increase the detection performance. The detection of moving objects is performed by mean of the optical flow between the images of two different spectrum. The optical flow has been computed by formulating an energy minimization problem and subsequently solving it by a numerical optimization algorithm. The convergence of the numerical scheme is given in case of different images. Finally, a number of experimental results (optical flow from stereo images) are given to prove the applicability of such a system in various applications and situations where a robust surveillance and tracking system is needed.