A Computer Vision Approach for Detecting Discrepancies in Map Textual Labels

被引:0
作者
Salama, Abdulrahman [1 ]
Elkamhawy, Mahmoud [1 ]
Hendawi, Abdeltawab [2 ]
Sabour, Adel [1 ]
Al-Masri, Eyhab [1 ]
Tan, Ming [3 ]
Agrawal, Vashutosh [3 ]
Prakash, Ravi [3 ]
Ali, Mohamed [1 ]
机构
[1] Univ Washington, Tacoma, WA 98402 USA
[2] Univ Rhode Isl, Kingston, RI USA
[3] Microsoft Corp, Redmond, WA 98052 USA
来源
35TH INTERNATIONAL CONFERENCE ON SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, SSDBM 2023 | 2023年
关键词
detectron2; azure cognitive services; maps discrepancies; computer-vision; geospatial data; textual labels; faster-rcnn; neural networks;
D O I
10.1145/3603719.3603722
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Maps provide various sources of information. An important example of such information is textual labels such as cities, neighborhoods, and street names. Althoughwe treat this information as facts, and despite the massive effort done by providers to continuously improve their accuracy, this data is far from perfect. Discrepancies in textual labels rendered on the map are one of the major sources of inconsistencies across map providers. These discrepancies can have significant impacts on the reliability of the derived information and decision-making processes. Thus, it is important to validate the accuracy and consistency in such data. Most providers treat this data as their propriety data and it is not available to the public, thus we cannot compare the data directly. To address these challenges, we introduce a novel computer vision-based approach for automatically extracting and classifying labels based on the visual characteristics of the label, which indicates its category based on the format convention used by the specific map provider. Based on the extracted data, we detect the degree of discrepancies across map providers. We consider three map providers: Bing Maps, Google Maps, and OpenStreetMaps. The neural network we develop classifies the text labels with an accuracy up to 93% in all providers. We leverage our system to analyze randomly selected regions in different markets. The studied markets are USA, Germany, France, and Brazil. Experimental results and statistical analysis reveal the amount of discrepancies across map providers per region. We calculate the Jaccard distance between the extracted text sets for each pair of map providers, which represents the discrepancy percentage. Discrepancies percentages as high as 90% were found in some markets.
引用
收藏
页数:9
相关论文
共 20 条
  • [1] Azure, 2022, Azure Cognitive Services-Add Cognitive Capabilities to apps With APIs and AI Services
  • [2] Bandil Ayush, 2020, SIGSPATIAL '20: Proceedings of the 28th International Conference on Advances in Geographic Information Systems, P425, DOI 10.1145/3397536.3422348
  • [3] GeoDart: A System for Discovering Maps Discrepancies
    Bandil, Ayush
    Girdhar, Vaishali
    Chau, Hieu
    Ali, Mohamed
    Hendawi, Abdeltawab
    Govind, Harsh
    Cao, Peiwei
    Song, Ashley
    [J]. 2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 2535 - 2546
  • [4] Bing Maps, 2022, Bing Maps Tile System
  • [5] Boottho P, 2017, INT ELECT ENG CONGR
  • [6] Towards an Automated Comparison of OpenStreetMap with Authoritative Road Datasets
    Brovelli, Maria Antonia
    Minghini, Marco
    Molinari, Monia
    Mooney, Peter
    [J]. TRANSACTIONS IN GIS, 2017, 21 (02) : 191 - 206
  • [7] CVAT.ai Corporation, 2022, Computer Vision Annotation Tool (CVAT)
  • [8] Character string recognition on maps, a rotation-invariant recognition method
    Deseilligny, MP
    LeMen, H
    Stamon, G
    [J]. PATTERN RECOGNITION LETTERS, 1995, 16 (12) : 1297 - 1310
  • [9] Helbich Marco., 2012, P GI FORUM, V4, P24, DOI DOI 10.1080/13658816
  • [10] Assessing Completeness and Spatial Error of Features in Volunteered Geographic Information
    Jackson, Steven P.
    Mullen, William
    Agouris, Peggy
    Crooks, Andrew
    Croitoru, Arie
    Stefanidis, Anthony
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2013, 2 (02) : 507 - 530