Tangible multimodal interfaces for safety-critical applications

The use of tangible multimodal (TMM) systems, which let safety-critical systems users continue to employ the physical objects, language and symbology of their workplace are described. The TMM users are capable of updating digital systems and of collaborating digitally with colleagues as are users of more traditional systems. TMM has the portability, high resolution, scalability and physical properties of pen and paper and can meet the needs of officers in the field, in particular, robustness to computer failure. The TMM enable users to employ physical objects in their workplace along with natural spoken language, sketch, gesture and other input modalities to interact with information and with co-workers.