Device Data Ingestion for Industrial Big Data Platforms with a Case Study

被引：32
|
作者：
Ji, Cun [1 ]
Shao, Qingshi [1 ]
Sun, Jiao [1 ]
Liu, Shijun [1 ,2 ]
Pan, Li [1 ,2 ]
Wu, Lei [1 ,3 ]
Yang, Chenglei [1 ,2 ]
机构：
[1] Shandong Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[2] Shandong Univ, Engn Res Ctr Digital Media Technol, Jinan 250101, Peoples R China
[3] North China Univ Technol, Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing 100144, Peoples R China
来源：
SENSORS | 2016年 / 16卷 / 03期
基金：
国家高技术研究发展计划(863计划); 中国国家自然科学基金;
关键词：
device data ingestion; big data; internet of things; industrial internet of things; INTERNET;
D O I：
10.3390/s16030279
中图分类号：
O65 [分析化学];
学科分类号：
070302 ; 081704 ;
摘要：
Despite having played a significant role in the Industry 4.0 era, the Internet of Things is currently faced with the challenge of how to ingest large-scale heterogeneous and multi-type device data. In response to this problem we present a heterogeneous device data ingestion model for an industrial big data platform. The model includes device templates and four strategies for data synchronization, data slicing, data splitting and data indexing, respectively. We can ingest device data from multiple sources with this heterogeneous device data ingestion model, which has been verified on our industrial big data platform. In addition, we present a case study on device data-based scenario analysis of industrial big data.
引用
收藏
页数：15
相关论文
共 50 条
  • [31] Stream Processing of Scientific Big Data on Heterogeneous Platforms - Image Analytics on Big Data in Motion
    Najmabadi, S. M.
    Klaiber, M.
    Wang, Z.
    Baroud, Y.
    Simon, S.
    2013 IEEE 16TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE 2013), 2013, : 965 - 970
  • [32] The role of big data analytics in industrial Internet of Things
    Rehman, Muhammad Habib Ur
    Yaqoob, Ibrar
    Salah, Khaled
    Imran, Muhammad
    Jayaraman, Prem Prakash
    Perera, Charith
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 99 : 247 - 259
  • [33] Integrated Understanding of Big Data, Big Data Analysis, and Business Intelligence: A Case Study of Logistics
    Jin, Dong-Hui
    Kim, Hyun-Jung
    SUSTAINABILITY, 2018, 10 (10)
  • [34] Study on Mechanism of Big Data to Promote the Upgrading of Industrial Structure
    Lei, Ting
    2016 ICMIBI INTERNATIONAL CONFERENCE ON HUMANITY, EDUCATION AND SOCIAL SCIENCE (ICMIBI-HESS 2016), 2016, 62 : 156 - 161
  • [35] Intelligent Data Collaboration in Heterogeneous-device IoT Platforms
    Sun, Danfeng
    Wu, Jia
    Yang, Jian
    Wu, Huifeng
    ACM TRANSACTIONS ON SENSOR NETWORKS, 2021, 17 (03)
  • [36] Big Data-Based Improved Data Acquisition and Storage System for Designing Industrial Data Platform
    Geng, Daoqu
    Zhang, Chengyun
    Xia, Chengjing
    Xia, Xue
    Liu, Qilin
    Fu, Xinshuai
    IEEE ACCESS, 2019, 7 : 44574 - 44582
  • [37] Improving Data Quality Through Big Data: Case Study on Big Data-Mobile Positioning Data in Indonesia Tourism Statistics
    Uluwiyah, Ana
    Setiadi, Yazid
    2017 INTERNATIONAL WORKSHOP ON BIG DATA AND INFORMATION SECURITY (IWBIS 2017), 2017, : 43 - 48
  • [38] Big Data Real Time Ingestion and Machine Learning
    Pal, Gautam
    Li, Gangmin
    Atkinson, Katie
    2018 IEEE SECOND INTERNATIONAL CONFERENCE ON DATA STREAM MINING & PROCESSING (DSMP), 2018, : 25 - 31
  • [39] Towards Big Data Solutions for Industrial Tomography Data Processing
    Kowalska, Aleksandra
    Luczak, Piotr
    Sielski, Dawid
    Kowalski, Tomasz
    Romanowski, Andrzej
    Sankowski, Dominik
    PROCEEDINGS OF THE 2019 FEDERATED CONFERENCE ON COMPUTER SCIENCE AND INFORMATION SYSTEMS (FEDCSIS), 2019, : 427 - 431
  • [40] Enhancement of the K-Means Algorithm for Mixed Data in Big Data Platforms
    Koren, Oded
    Hallin, Carina Antonia
    Perel, Nir
    Bendet, Dror
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, 2019, 868 : 1025 - 1040
12345