Adaptive multiple video sensors fusion based on decentralized Kalman filter and sensor confidence

The fusion of multiple video sensors provides an effective way to improve the robustness and accuracy of video surveillance systems. In this paper, an adaptive fusion method based on a decentralized Kalman filter(DKF) and sensor confidence is presented for the fusion of multiple video sensors. The adaptive scheme is one of the approaches used for preventing the divergence problem of the filter when statistical values of the measurement noises of the system models are not available. By introducing the sensor confidence, we can adaptively adjust the measurement noise covariance matrix of the local DKFs and thus, determine the weight of each sensor more correctly in the fusion procedure. Also, the DKF applied here can make full use of redundant tracking data from multiple video sensors and give more accurate fusion results in an efficient manner. Finally,the fusion result with improved accuracy is obtained. Experimental results show that the proposed adaptive decentralized Kalman filter fusion(ADKFF) method works well in the case of real-world video sequences and exhibits more promising performance than single sensors and comparative fusion methods.