People Flow Trend Estimation Approach and Quantitative Explanation Based on the Scene Level Deep Learning of Street View Images

被引:0
作者
Zhao, Chenbo [1 ]
Ogawa, Yoshiki [2 ]
Chen, Shenglong [1 ]
Oki, Takuya [3 ]
Sekimoto, Yoshihide [2 ]
机构
[1] Univ Tokyo, Dept Civil Engn, Tokyo 1538505, Japan
[2] Univ Tokyo, Ctr Spatial Informat Sci CSIS, Tokyo 1538505, Japan
[3] Tokyo Inst Technol, Sch Environm & Soc, Tokyo 1528550, Japan
关键词
deep learning; deep learning explanation; people flow estimation; street view images; streetscape impact analysis; POPULATION-DISTRIBUTION; LAND-COVER; ENVIRONMENT; INDEX; MODEL;
D O I
10.3390/rs15051362
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
People flow trend estimation is crucial to traffic and urban safety planning and management. However, owing to privacy concerns, the collection of individual location data for people flow statistical analysis is difficult; thus, an alternative approach is urgently needed. Furthermore, the trend in people flow is reflected in streetscape factors, yet the relationship between them remains unclear in the existing literature. To address this, we propose an end-to-end deep-learning approach that combines street view images and human subjective score of each street view. For a more detailed people flow study, estimation and analysis were implemented using different time and movement patterns. Consequently, we achieved a 78% accuracy on the test set. We also implemented the gradient-weighted class activation mapping deep learning visualization and L1 based statistical methods and proposed a quantitative analysis approach to understand the land scape elements and subjective feeling of street view and to identify the effective elements for the people flow estimation based on a gradient impact method. In summary, this study provides a novel end-to-end people flow trend estimation approach and sheds light on the relationship between streetscape, human subjective feeling, and people flow trend, thereby making an important contribution to the evaluation of existing urban development.
引用
收藏
页数:26
相关论文
共 44 条
  • [21] A deep learning-based approach to automatic proximal femur segmentation in quantitative CT images
    Yu Deng
    Ling Wang
    Chen Zhao
    Shaojie Tang
    Xiaoguang Cheng
    Hong-Wen Deng
    Weihua Zhou
    Medical & Biological Engineering & Computing, 2022, 60 : 1417 - 1429
  • [22] A deep learning-based approach to automatic proximal femur segmentation in quantitative CT images
    Deng, Yu
    Wang, Ling
    Zhao, Chen
    Tang, Shaojie
    Cheng, Xiaoguang
    Deng, Hong-Wen
    Zhou, Weihua
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2022, 60 (05) : 1417 - 1429
  • [23] Perceptions of built environment and health outcomes for older Chinese in Beijing: A big data approach with street view images and deep learning technique
    Wang, Ruoyu
    Liu, Ye
    Lu, Yi
    Zhang, Jinbao
    Liu, Penghua
    Yao, Yao
    Grekousis, George
    COMPUTERS ENVIRONMENT AND URBAN SYSTEMS, 2019, 78
  • [24] Deep Learning Approach for Classifying the Built Year and Structure of Individual Buildings by Automatically Linking Street View Images and GIS Building Data
    Ogawa, Yoshiki
    Zhao, Chenbo
    Oki, Takuya
    Chen, Shenglong
    Sekimoto, Yoshihide
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 1740 - 1755
  • [25] Deep Learning-Based Building Attribute Estimation from Google Street View Images for Flood Risk Assessment Using Feature Fusion and Task Relation Encoding
    Chen, Fu-Chen
    Subedi, Abhishek
    Jahanshahi, Mohammad R.
    Johnson, David R.
    Delp, Edward J.
    JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2022, 36 (06)
  • [26] Automatic detection of unreinforced masonry buildings from street view images using deep learning-based image segmentation
    Wang, Chaofeng
    Antos, Sarah Elizabeth
    Triveno, Luis Miguel
    AUTOMATION IN CONSTRUCTION, 2021, 132
  • [27] Deep learning-based estimation of whole-body kinematics from multi-view images
    Nguyen, Kien X.
    Zheng, Liying
    Hawke, Ashley L.
    Carey, Robert E.
    Breloff, Scott P.
    Li, Kang
    Peng, Xi
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 235
  • [28] Point cloud-based scene flow estimation on realistically deformable objects: A benchmark of deep learning-based methods
    Hermesa, Niklas
    Bigalkea, Alexander
    Heinricha, Mattias P.
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [29] A Multi-Scale and Multi-Level Fusion Approach for Deep Learning-Based Liver Lesion Diagnosis in Magnetic Resonance Images with Visual Explanation
    Wan, Yuchai
    Zheng, Zhongshu
    Liu, Ran
    Zhu, Zheng
    Zhou, Hongen
    Zhang, Xun
    Boumaraf, Said
    LIFE-BASEL, 2021, 11 (06):
  • [30] A Robust Deep Learning Approach for the Quantitative Characterization and Clustering of Peach Tree Crowns Based on UAV Images
    Hu, Jun
    Zhang, Yanfeng
    Zhao, Dandan
    Yang, Guijun
    Chen, Feiyun
    Zhou, Chengquan
    Chen, Wenxuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60