People Flow Trend Estimation Approach and Quantitative Explanation Based on the Scene Level Deep Learning of Street View Images

被引:0
作者
Zhao, Chenbo [1 ]
Ogawa, Yoshiki [2 ]
Chen, Shenglong [1 ]
Oki, Takuya [3 ]
Sekimoto, Yoshihide [2 ]
机构
[1] Univ Tokyo, Dept Civil Engn, Tokyo 1538505, Japan
[2] Univ Tokyo, Ctr Spatial Informat Sci CSIS, Tokyo 1538505, Japan
[3] Tokyo Inst Technol, Sch Environm & Soc, Tokyo 1528550, Japan
关键词
deep learning; deep learning explanation; people flow estimation; street view images; streetscape impact analysis; POPULATION-DISTRIBUTION; LAND-COVER; ENVIRONMENT; INDEX; MODEL;
D O I
10.3390/rs15051362
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
People flow trend estimation is crucial to traffic and urban safety planning and management. However, owing to privacy concerns, the collection of individual location data for people flow statistical analysis is difficult; thus, an alternative approach is urgently needed. Furthermore, the trend in people flow is reflected in streetscape factors, yet the relationship between them remains unclear in the existing literature. To address this, we propose an end-to-end deep-learning approach that combines street view images and human subjective score of each street view. For a more detailed people flow study, estimation and analysis were implemented using different time and movement patterns. Consequently, we achieved a 78% accuracy on the test set. We also implemented the gradient-weighted class activation mapping deep learning visualization and L1 based statistical methods and proposed a quantitative analysis approach to understand the land scape elements and subjective feeling of street view and to identify the effective elements for the people flow estimation based on a gradient impact method. In summary, this study provides a novel end-to-end people flow trend estimation approach and sheds light on the relationship between streetscape, human subjective feeling, and people flow trend, thereby making an important contribution to the evaluation of existing urban development.
引用
收藏
页数:26
相关论文
共 44 条
  • [1] Development of a system for assessing the quality of urban street-level greenery using street view images and deep learning
    Xia, Yixi
    Yabuki, Nobuyoshi
    Fukuda, Tomohiro
    URBAN FORESTRY & URBAN GREENING, 2021, 59
  • [2] An automatic approach for tree species detection and profile estimation of urban street trees using deep learning and Google street view images
    Choi, Kwanghun
    Lim, Wontaek
    Chang, Byungwoo
    Jeong, Jinah
    Kim, Inyoo
    Park, Chan-Ryul
    Ko, Dongwook W.
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 190 : 165 - 180
  • [3] An integrated deep learning approach for assessing the visual qualities of built environments utilizing street view images
    Zhao, Xukai
    Lu, Yuxing
    Lin, Guangsi
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 130
  • [4] Image Augmentation Approaches for Building Dimension Estimation in Street View Images Using Object Detection and Instance Segmentation Based on Deep Learning
    Hwang, Dongjin
    Kim, Jae-Jun
    Moon, Sungkon
    Wang, Seunghyeon
    APPLIED SCIENCES-BASEL, 2025, 15 (05):
  • [5] Mapping human perception of urban landscape from street-view images: A deep-learning approach
    Wei, Jingxian
    Yue, Wenze
    Li, Mengmeng
    Gao, Jiabin
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 112
  • [6] The influence of urban campus landscape on college students' exercise participation and mental health: an approach using deep learning and street view images
    Zheng, Zhenhua
    Chen, Linquan
    Zeng, Min
    Liu, Wanting
    Chen, Hong
    ARCHNET-IJAR INTERNATIONAL JOURNAL OF ARCHITECTURAL RESEARCH, 2024,
  • [7] Beyond here and now: Evaluating pollution estimation across space and time from street view images with deep learning
    Nathvani R.
    D. V.
    Clark S.N.
    Alli A.S.
    Muller E.
    Coste H.
    Bennett J.E.
    Nimo J.
    Moses J.B.
    Baah S.
    Hughes A.
    Suel E.
    Metzler A.B.
    Rashid T.
    Brauer M.
    Baumgartner J.
    Owusu G.
    Agyei-Mensah S.
    Arku R.E.
    Ezzati M.
    Science of the Total Environment, 2023, 903
  • [8] Building height calculation for an urban area based on street view images and deep learning
    Xu, Zhen
    Zhang, Furong
    Wu, Yingying
    Yang, Yajun
    Wu, Yuan
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2023, 38 (07) : 892 - 906
  • [9] Deep Learning Based Channel Covariance Matrix Estimation With User Location and Scene Images
    Xu, Weihua
    Gao, Feifei
    Zhang, Jianhua
    Tao, Xiaoming
    Alkhateeb, Ahmed
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (12) : 8145 - 8158
  • [10] A news picture geo-localization pipeline based on deep learning and street view images
    Chu, Tianyou
    Chen, Yumin
    Su, Heng
    Xu, Zhenzhen
    Chen, Guodong
    Zhou, Annan
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2022, 15 (01) : 1485 - 1505