Testing IoT systems using a hybrid simulation based testing approach

This paper presents an extensive overview of the challenges that arise when testing large IoT applications at the system level. In order do that we start from analyzing behavior of local entities such as IoT devices or people interacting with the IoT system. The interactions of these local entities eventually leads to an emergent behavior. Both the emergent behavior and the local behavior need to be taken into account when testing IoT systems. Therefore, we present a novel hybrid simulation based testing approach that is able to effectively facilitate interactions of these local entities. Furthermore, we introduce various solutions to the challenges that arise when implementing this hybrid methodology. These challenges are mainly related to the IoT development pipeline, synchronization between real-life and simulation environment and the scalability constraints of modern simulation techniques.