Scalable data pipeline architecture to support the industrial internet of things

Managing manufacturing data remains challenging despite the growth of the Industrial Internet of Things (IIoT). While various standards and technologies enable greater access to data, scaling data processing and distribution can be difficult given the increasing variety of data from an increasing variety of sources in global production networks. This paper proposes an architecture for a scalable pipeline to process and distribute data from a mix of shop-floor sources. The feasibility of this approach is explored by implementing the architecture to bring together MTConnect-compliant machine and ad-hoc power data to support analytics applications. Published by Elsevier Ltd on behalf of CIRP.