Application of Batch and Stream Collaborative Computing in Urban Traffic Data Processing

被引:0
|
作者
Zhang, Tao [1 ]
Zhao, Shuai [1 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
关键词
Batch computing; Stream computing; Collaborative computing; Urban traffic data processing; MAPREDUCE;
D O I
10.1007/978-3-319-65482-9_58
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Analysis of urban traffic data has obtained a great attention in recent years. In the study of urban traffic data processing, the batch computing based on historical data and the stream computing based on real-time data are isolated, and the two computing frameworks are not synergized. Therefore, a method of urban traffic data processing based on batch and stream collaborative computing is proposed. Batch computing has the advantage of high throughput, so it is more suitable for calculating the historical data of urban traffic and the results of stream computing deeply. Stream computing with the advantage of low delay can be used to calculate the traffic data in real time, combined with the results of batch computing, then the conclusion of urban traffic data processing are more comprehensive and accurate.
引用
收藏
页码:725 / 734
页数:10
相关论文
共 50 条
  • [1] A Distributed Collaborative Urban Traffic Big Data System Based on Cloud Computing
    Zhang, Jianqin
    Chen, Zhihong
    Xu, Zhijie
    Du, Mingyi
    Yang, Weijun
    Guo, Liang
    IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2019, 11 (04) : 37 - 47
  • [2] DCVP: Distributed Collaborative Video Stream Processing in Edge Computing
    Yuan, Shijing
    Li, Jie
    Wu, Chentao
    Ji, Yusheng
    Zhang, Yongbing
    2020 IEEE 26TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2020, : 625 - 632
  • [3] Distributed Collaborative Filtering for Batch and Stream Processing-Based Recommendations
    Zaouali, Kais
    Haddad, Mohamed Ramzi
    Zghal, Hajer Baazaoui
    ON THE MOVE TO MEANINGFUL INTERNET SYSTEMS, OTM 2018, PT I, 2018, 11229 : 243 - 260
  • [4] Efficient Processing of Continuous Skyline Query over Smarter Traffic Data Stream for Cloud Computing
    Wang Hanning
    Xu Weixiang
    Yang, Jiulin
    Wei, Lili
    Jia Chaolong
    DISCRETE DYNAMICS IN NATURE AND SOCIETY, 2013, 2013
  • [5] Traffic data processing based on granular computing
    2015, Aracne Editrice (01):
  • [6] Urban DAS Data Processing and Its Preliminary Application to City Traffic Monitoring
    Wang, Hang
    Chen, Yunfeng
    Min, Rui
    Chen, Yangkang
    SENSORS, 2022, 22 (24)
  • [7] Live Traffic Data Analysis Using Stream Processing
    Weissbach, Manuel
    2018 IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING COMPANION (UCC COMPANION), 2018, : 65 - 70
  • [8] Big Data Processing: Batch-based processing and stream-based processing
    Benjelloun, Sarah
    El Aissi, Mohamed El Mehdi
    Loukili, Yassine
    Lakhrissi, Younes
    Ben Ali, Safae Elhaj
    Chougrad, Hiba
    El Boushaki, Abdessamad
    2020 FOURTH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING IN DATA SCIENCES (ICDS), 2020,
  • [9] Challenges of Using Trusted Computing for Collaborative Data Processing
    Wagner, Paul Georg
    Birnstill, Pascal
    Beyerer, Juergen
    SECURITY AND TRUST MANAGEMENT, STM 2019, 2019, 11738 : 107 - 123
  • [10] Towards collaborative data reduction in stream-processing systems
    Li, Ming
    Kotz, David
    INTERNATIONAL JOURNAL OF COMMUNICATION NETWORKS AND DISTRIBUTED SYSTEMS, 2009, 2 (04) : 375 - 400