A fusion of actual motion pictures of scenery and the 3D image constructed from GPS and gyro data and map database

EVS (Enhanced Vision System) and SVS (Synthesized Vision System) are known as effective tools for pilots to improve their situation awareness. ENRI has developed an integrated EVS/SVS experimental system to study the potential of both EVS and SVS in Japan. This paper presents the results of ground and flight experiments of the experimental system. It produces the three-dimensional (3D) artificial images. They are synthesized with the position data of GPS, the attitude data obtained by the gyro sensor and the digital map database, which is supplied from GSI (the Geographical Survey Institute) in Japan. The produced image is compared with the actual motion picture of scenery through HUD (Head Up Display) or a computer screen. The image uses the grid lines' expression for the simultaneous recognition of both the 3D image and the real picture. The picture is obtained from two sensors, that is, a visible ray color sensor and an infrared sensor. These two kinds of the picture are recorded into respective video recorder. The image recording subsystems are equipped to the ENRI's experimental aircraft with additional sensors for position and attitude data. The GPS receiver and gyro unit are chosen for additional sensors. Two methods are examined in the simulation of the fusion system. One is a method that the 3D image is overlapped with the picture of the time to acquire the image from video recorders and display it on a computer screen. The other is a method that the observer watches the image through HUD, where both the image and the picture are overlapped. This paper also discusses the difference of two methods for fusion systems and shows the results smoothed and predicted from the measured position data.