Shedding light on blind spots-Developing a reference architecture to leverage video data for process mining

Process mining is one of the most active research streams in business process management. In recent years, numerous methods have been proposed for analyzing structured process data. In many cases, however, only the digitized parts of processes are directly captured by process-aware information systems, whereas manual activities often leave blind spots in the process analysis. While video data can contain valuable process-related information that is not captured in information systems, a standardized approach to extracting event logs from unstructured video data remains lacking. To solve this problem and facilitate the systematic usage of video data in process mining, we have designed the ViProMiRA, a reference architecture that bridges the gap between computer vision and process mining. The various evaluation activities in our design science research process ensure that the proposed ViProMiRA allows flexible, use case-driven, and context-specific instantiations. Our results also show that a prototypical implementation of the ViProMiRA is capable of automatically extracting more than 70% of the process-relevant events from a real-world video dataset in a supervised learning scenario.