Application of Batch and Stream Collaborative Computing in Urban Traffic Data Processing

被引:0
|
作者
Zhang, Tao [1 ]
Zhao, Shuai [1 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
关键词
Batch computing; Stream computing; Collaborative computing; Urban traffic data processing; MAPREDUCE;
D O I
10.1007/978-3-319-65482-9_58
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Analysis of urban traffic data has obtained a great attention in recent years. In the study of urban traffic data processing, the batch computing based on historical data and the stream computing based on real-time data are isolated, and the two computing frameworks are not synergized. Therefore, a method of urban traffic data processing based on batch and stream collaborative computing is proposed. Batch computing has the advantage of high throughput, so it is more suitable for calculating the historical data of urban traffic and the results of stream computing deeply. Stream computing with the advantage of low delay can be used to calculate the traffic data in real time, combined with the results of batch computing, then the conclusion of urban traffic data processing are more comprehensive and accurate.
引用
收藏
页码:725 / 734
页数:10
相关论文
共 50 条
  • [31] The application of parallel computing to data processing in geophysical methods
    Wang, Xue
    Jin, Hao
    2008 PROCEEDINGS OF INFORMATION TECHNOLOGY AND ENVIRONMENTAL SYSTEM SCIENCES: ITESS 2008, VOL 2, 2008, : 512 - 515
  • [32] Resilient Stream Processing in Edge Computing
    Xu, Jinlai
    Palanisamy, Balaji
    Wang, Qingyang
    21ST IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2021), 2021, : 504 - 513
  • [33] Dependable IoT Data Stream Processing for Monitoring and Control of Urban Infrastructures
    Geldenhuys, Morgan K.
    Will, Jonathan
    Pfister, Benjamin J. J.
    Haug, Martin
    Scharmann, Alexander
    Thamsen, Lauritz
    2021 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING, IC2E 2021, 2021, : 244 - 250
  • [34] A Cloud Platform for Big IoT Data Analytics by Combining Batch and Stream Processing Technologies
    Dissanayake, D. M. C.
    Jayasena, K. P. N.
    2017 NATIONAL INFORMATION TECHNOLOGY CONFERENCE (NITC), 2017, : 40 - 45
  • [35] SPSC: Stream Processing Framework Atop Serverless Computing for Industrial Big Data
    Cai, Zinuo
    Chen, Zebin
    Chen, Xinglei
    Ma, Ruhui
    Guan, Haibing
    Buyya, Rajkumar
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, : 1 - 9
  • [36] Evaluation of IoT stream processing at edge computing layer for semantic data enrichment
    Xhafa, Fatos
    Kilic, Burak
    Krause, Paul
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 105 (730-736): : 730 - 736
  • [37] ELM Meets Urban Computing: Ensemble Urban Data for Smart City Application
    Zhang, Ningyu
    Chen, Huajun
    Chen, Xi
    Chen, Jiaoyan
    PROCEEDINGS OF ELM-2015, VOL 1: THEORY, ALGORITHMS AND APPLICATIONS (I), 2016, 6 : 51 - 63
  • [38] A computing environment for urban traffic systems
    Khalil, M
    Peytchev, E
    Al-Dabass, D
    7TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY, VOLS 1 AND 2, PROCEEDINGS, 2005, : 807 - 812
  • [39] Trajectory Data Processing and Mobility Performance Evaluation for Urban Traffic Networks
    Wang, Xingmin
    Jerome, Zachary
    Zhang, Chenhao
    Shen, Shengyin
    Kumar, Vivek Vijaya
    Liu, Henry X.
    TRANSPORTATION RESEARCH RECORD, 2023, 2677 (03) : 355 - 370
  • [40] Computing Urban Traffic Congestions by Incorporating Sparse GPS Probe Data and Social Media Data
    Wang, Senzhang
    Zhang, Xiaoming
    Cao, Jianping
    He, Lifang
    Stenneth, Leon
    Yu, Philip S.
    Li, Zhoujun
    Huang, Zhiqiu
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2017, 35 (04)