TrafficCAM: A Versatile Dataset for Traffic Flow Segmentation

被引:0
作者
Deng, Zhongying [1 ]
Cheng, Yanqi [1 ]
Liu, Lihao [1 ]
Wang, Shujun [2 ]
Ke, Rihuan [3 ]
Schonlieb, Carola-Bibiane [1 ]
Aviles-Rivero, Angelica I. [4 ]
机构
[1] Univ Cambridge, DAMTP, Cambridge CB3 0WA, England
[2] Hong Kong Polytech Univ, Dept Biomed Engn, Hong Kong, Peoples R China
[3] Univ Bristol, Sch Math, Bristol BS8 1UG, England
[4] Tsinghua Univ, Yau Math Sci Ctr, Beijing 100084, Peoples R China
基金
英国工程与自然科学研究理事会; 英国惠康基金;
关键词
Cameras; Annotations; Urban areas; Semantics; Benchmark testing; Vehicle-to-everything; Traffic control; Vehicles; Real-time systems; Pedestrians; TrafficCAM dataset; traffic flow analysis; semantic segmentation; instance segmentation; semi-supervised learning;
D O I
10.1109/TITS.2024.3510551
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Traffic flow analysis is revolutionising traffic management. By leveraging traffic flow data, traffic control bureaus could provide drivers with real-time alerts, advising the fastest routes and therefore optimising transportation logistics and reducing congestion. The existing traffic flow datasets have two major limitations. They feature a limited number of classes, usually limited to one type of vehicle, and the scarcity of unlabelled data. In this paper, we introduce a new benchmark traffic flow image dataset called TrafficCAM. Our dataset distinguishes itself by two major highlights. Firstly, TrafficCAM provides both pixel-level and instance-level semantic labelling along with a large range of types of vehicles and pedestrians. It is composed of a large and diverse set of video sequences recorded in streets from eight Indian cities with stationary cameras. Secondly, TrafficCAM aims to establish a new benchmark for developing fully-supervised tasks, and importantly, semi-supervised learning techniques. It is the first dataset that provides a vast amount of unlabelled data, helping to better capture traffic flow qualification under a low-cost annotation requirement. More precisely, our dataset has 4,364 image frames with semantic and instance annotations along with 58,689 unlabelled image frames. We validate our new dataset through a large and comprehensive range of experiments on several state-of-the-art approaches under four different settings: fully-supervised semantic and instance segmentation, and semi-supervised semantic and instance segmentation tasks. Our benchmark dataset and official toolkit are released at https://math-ml-x.github.io/TrafficCAM/.
引用
收藏
页码:2747 / 2759
页数:13
相关论文
共 47 条
  • [1] Spatio-temporal traffic queue detection for uninterrupted flows
    Bae, Bumjoon
    Liu, Yuandong
    Han, Lee D.
    Bozdogan, Hamparsum
    [J]. TRANSPORTATION RESEARCH PART B-METHODOLOGICAL, 2019, 129 : 20 - 34
  • [2] Bahnsen C. H., 2018, AAU RAINSNOW TRAFFIC
  • [3] Cascade R-CNN: High Quality Object Detection and Instance Segmentation
    Cai, Zhaowei
    Vasconcelos, Nuno
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) : 1483 - 1498
  • [4] Hybrid Task Cascade for Instance Segmentation
    Chen, Kai
    Pang, Jiangmiao
    Wang, Jiaqi
    Xiong, Yu
    Li, Xiaoxiao
    Sun, Shuyang
    Feng, Wansen
    Liu, Ziwei
    Shi, Jianping
    Ouyang, Wanli
    Loy, Chen Change
    Lin, Dahua
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4969 - 4978
  • [5] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
    Chen, Liang-Chieh
    Zhu, Yukun
    Papandreou, George
    Schroff, Florian
    Adam, Hartwig
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 833 - 851
  • [6] Cheng B, 2021, ADV NEUR IN, V34
  • [7] Contributors M., 2020, MMSEGMENTATIONOPENMM
  • [8] The Cityscapes Dataset for Semantic Urban Scene Understanding
    Cordts, Marius
    Omran, Mohamed
    Ramos, Sebastian
    Rehfeld, Timo
    Enzweiler, Markus
    Benenson, Rodrigo
    Franke, Uwe
    Roth, Stefan
    Schiele, Bernt
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3213 - 3223
  • [9] Dosovitskiy A, 2020, ARXIV
  • [10] The Pascal Visual Object Classes (VOC) Challenge
    Everingham, Mark
    Van Gool, Luc
    Williams, Christopher K. I.
    Winn, John
    Zisserman, Andrew
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 88 (02) : 303 - 338