Deep Insight: A Cloud Based Big Data Analytics Platform For Naturalistic Driving Studies

Naturalistic driving studies (NDS) are an increasingly popular method to research driving behavior. They often result in large amounts of data varying in source and format (videos, spatial, and time-series data). Traditional data processing systems and analytical methods are not equipped to handle the large influx of data, often ranging from terabytes to petabytes. Previously, big data analytics platforms have been designed to address specific use cases of intelligent transport systems such as traffic flow prediction, transportation planning, and traffic safety. Similarly, there is a need for robust data systems for storing, mining, visualizing, and analyzing big naturalistic data. This paper presents a comprehensive cloud-based AI platform, Deep Insight, designed for data management, modeling, and enhanced annotations of naturalistic driving data. The platform capitalizes on Amazon Web Services, hosting a repository of public and privately collected NDS datasets with tool integration for data annotation and machine learning modeling that permits data analysis and inference. This end-to-end framework provides effective and reliable tools for storing, processing, annotating, and modeling NDS datasets. Additionally, the platform hosts a metric dashboard for benchmarking and displaying the performance of diverse analytical models using a standard dataset. The authors present a case study classifying a driver's head movement to demonstrate this framework’s workflow using Deep Insight and integrated tools. This cloud-based platform offers a wide range of cost, access, scalability, and security benefits, supporting goals to create a one-stop, standardized destination for analyzing naturalistic driving data and studying driver behavior. © 2023 Society of Automotive Engineers of Japan, Inc. All rights reserved