Transfer Learning of a Deep Learning Model for Exploring Tourists' Urban Image Using Geotagged Photos

被引:41
作者
Kang, Youngok [1 ]
Cho, Nahye [1 ]
Yoon, Jiyoung [1 ]
Park, Soyeon [1 ]
Kim, Jiyeon [1 ]
机构
[1] Ewha Womans Univ, Dept Social Studies, Seoul 03760, South Korea
关键词
deep learning model; convolutional neural network; Inception-v3; model; transfer learning; tourists’ photo classification; SOCIAL MEDIA; DESTINATION; PERCEPTIONS; NETWORKS; SERVICES;
D O I
10.3390/ijgi10030137
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, as computer vision and image processing technologies have rapidly advanced in the artificial intelligence (AI) field, deep learning technologies have been applied in the field of urban and regional study through transfer learning. In the tourism field, studies are emerging to analyze the tourists' urban image by identifying the visual content of photos. However, previous studies have limitations in properly reflecting unique landscape, cultural characteristics, and traditional elements of the region that are prominent in tourism. With the purpose of going beyond these limitations of previous studies, we crawled 168,216 Flickr photos, created 75 scenes and 13 categories as a tourist' photo classification by analyzing the characteristics of photos posted by tourists and developed a deep learning model by continuously re-training the Inception-v3 model. The final model shows high accuracy of 85.77% for the Top 1 and 95.69% for the Top 5. The final model was applied to the entire dataset to analyze the regions of attraction and the tourists' urban image in Seoul. We found that tourists feel attracted to Seoul where the modern features such as skyscrapers and uniquely designed architectures and traditional features such as palaces and cultural elements are mixed together in the city. This work demonstrates a tourist photo classification suitable for local characteristics and the process of re-training a deep learning model to effectively classify a large volume of tourists' photos.
引用
收藏
页数:20
相关论文
共 56 条
[1]   CrowdNet: A Deep Convolutional Network for Dense Crowd Counting [J].
Boominathan, Lokesh ;
Kruthiventi, Srinivas S. S. ;
Babu, R. Venkatesh .
MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, :640-644
[2]   Identification of tourist hot spots based on social networks: A comparative analysis of European metropolises using photo-sharing services and GIS [J].
Carlos Garcia-Palomares, Juan ;
Gutierrez, Javier ;
Minguez, Carmen .
APPLIED GEOGRAPHY, 2015, 63 :408-417
[3]   Quantifying the Characteristics of the Local Urban Environment through Geotagged Flickr Photographs and Image Recognition [J].
Chen, Meixu ;
Arribas-Bel, Dani ;
Singleton, Alex .
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (04)
[4]   Feeling a destination through the "right" photos: A machine learning model for DMOs' photo selection [J].
Deng, Ning ;
Li, Xiang .
TOURISM MANAGEMENT, 2018, 65 :267-278
[5]   Tourist clusters from Flickr travel photography [J].
Donaire, Jose A. ;
Camprubi, Raquel ;
Gali, Nuria .
TOURISM MANAGEMENT PERSPECTIVES, 2014, 11 :26-33
[6]   Deep Learning the City: Quantifying Urban Perception at a Global Scale [J].
Dubey, Abhimanyu ;
Naik, Nikhil ;
Parikh, Devi ;
Raskar, Ramesh ;
Hidalgo, Cesar A. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :196-212
[7]  
Ester M., 1996, P 2 INT C KNOWL DISC, P226, DOI DOI 10.5555/3001460.3001507
[8]  
Fotheringham A.S., 2000, Quantitative Geography: Perspectives on Spatial Data Analysis
[9]  
Gu Y., 2019, P ICIS
[10]   A Survey on Deep Learning-Driven Remote Sensing Image Scene Understanding: Scene Classification, Scene Retrieval and Scene-Guided Object Detection [J].
Gu, Yating ;
Wang, Yantian ;
Li, Yansheng .
APPLIED SCIENCES-BASEL, 2019, 9 (10)