Real-time image processing for autonomous surveillance systems

Many airborne platforms have high performance electro optical sensor suites mounted on them. Such sensor systems can provide vital, real time reconnaissance information to users on the platform or on the ground. However such sensor systems require control and output large amounts of data of which the user may require only a relatively small amount for his decision processes. This paper describes a payload management system, designed to automatically control an airborne sensor suite to improve the 'quality' of the data provided to the user and other systems on the airborne platform. The system uses real time image-processing algorithms to provide low-level functions e.g. closed loop target tracking, image stabilization, automatic focus control and super-resolution. The system combines such real time outputs and incorporates contextual data inputs to provide higher-level surveillance functions such as recognition and ranging of navigational waypoints for geo-location; registration of image patches for large area terrain imaging. The paper outlines the physical and processing architecture of the system and also gives an overview of the algorithms and capabilities of the system. The issues surrounding the integration into existing airborne platforms are discussed.