Application of Batch and Stream Collaborative Computing in Urban Traffic Data Processing

被引:0
|
作者
Zhang, Tao [1 ]
Zhao, Shuai [1 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
关键词
Batch computing; Stream computing; Collaborative computing; Urban traffic data processing; MAPREDUCE;
D O I
10.1007/978-3-319-65482-9_58
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Analysis of urban traffic data has obtained a great attention in recent years. In the study of urban traffic data processing, the batch computing based on historical data and the stream computing based on real-time data are isolated, and the two computing frameworks are not synergized. Therefore, a method of urban traffic data processing based on batch and stream collaborative computing is proposed. Batch computing has the advantage of high throughput, so it is more suitable for calculating the historical data of urban traffic and the results of stream computing deeply. Stream computing with the advantage of low delay can be used to calculate the traffic data in real time, combined with the results of batch computing, then the conclusion of urban traffic data processing are more comprehensive and accurate.
引用
收藏
页码:725 / 734
页数:10
相关论文
共 50 条
  • [21] Graph Constraints in Urban Computing: Dealing with conditions in processing urban data
    D'Orazio, Laurent
    Halfeld-Ferrari, Mirian
    Hara, Carmem Satie
    Section, Nadia P. Kozievitch
    Musicante, Martin A.
    2017 IEEE INTERNATIONAL CONFERENCE ON INTERNET OF THINGS (ITHINGS) AND IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) AND IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) AND IEEE SMART DATA (SMARTDATA), 2017, : 1118 - 1124
  • [22] The Modeling of Big Traffic Data Processing Based on Cloud Computing
    Zhang, Dongbo
    YanfangShou
    Xu, Jianmin
    PROCEEDINGS OF THE 2016 12TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2016, : 2394 - 2399
  • [23] Pec: Proactive Elastic Collaborative Resource Scheduling in Data Stream Processing
    Wei, Xiaohui
    Li, Lina
    Li, Xiang
    Wang, Xingwang
    Gao, Shang
    Li, Hongliang
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (07) : 1628 - 1642
  • [24] Implementation of a Distributed Processing Engine for Spatial Big-Data Processing based on Batch and Stream
    Kim, Sang-Su
    Song, Kwaun-Sik
    2017 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2017, : 1196 - 1198
  • [25] Lessons Learned from Integrating Batch and Stream Processing using IoT Data
    Cao, Hung
    Brown, Marcel
    Chen, Lizhi
    Smith, Riley
    Wachowicz, Monica
    2019 SIXTH INTERNATIONAL CONFERENCE ON INTERNET OF THINGS: SYSTEMS, MANAGEMENT AND SECURITY (IOTSMS), 2019, : 32 - 34
  • [26] Micro-batch and data frequency for stream processing on multi-cores
    Garcia, Adriano Marques
    Griebler, Dalvan
    Schepke, Claudio
    Fernandes, Luiz Gustavo
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (08): : 9206 - 9244
  • [27] Micro-batch and data frequency for stream processing on multi-cores
    Adriano Marques Garcia
    Dalvan Griebler
    Claudio Schepke
    Luiz Gustavo Fernandes
    The Journal of Supercomputing, 2023, 79 : 9206 - 9244
  • [28] Kuruma: The Vehicle Automatic Data Capture for Urban Computing Collaborative Systems
    Cueva-Fernandez, Guillermo
    Pascual Espada, Jordan
    Garcia-Diaz, Vicente
    Gonzalez-Rodriguez, Martin
    INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2013, 2 (02): : 28 - 32
  • [29] Application of the Weibull Function on Processing Traffic Flow Data
    Ci, Yusheng
    Wu, Lina
    Pei, Yulong
    TRAFFIC AND TRANSPORTATION STUDIES, 2008, : 862 - 869
  • [30] The application of parallel computing to data processing in geophysical methods
    Xue, Wang
    Hao, Jin
    ITESS: 2008 PROCEEDINGS OF INFORMATION TECHNOLOGY AND ENVIRONMENTAL SYSTEM SCIENCES, PT 1, 2008, : 667 - 671