Exploration of Alternative Vision Modes Using Depth and Thermal Cameras

Human vision is limited to a small band of the electromagnetic spectrum. It has been shown that extending visual perception can be beneficial, but it is unclear if this is useful for a broader range of applications. In this paper, we explore user reactions to extended visual perception. We describe the design and implementation of TriSight, a head-mounted display that allows the user to perceive the environment in the visual spectrum, the thermal spectrum, and through depth maps. In a study, we asked participants to perform everyday tasks in a created home, kitchen, office and basement with TriSight. Through analyzing videos, interviews, questionnaires and logs we chart the users' feedback towards the augmented visual perception. Our findings, imply the positive impact of extended vision, as well as the potential of thermal vision as alternative perception mode in performing daily tasks. Finally, we discuss the implications for designing devices that extend human's visual perception beyond the visual spectrum.