Image Retrieval for Local Architectural Heritage Recommendation Based on Deep Hashing

被引:13
作者
Ma, Kai [1 ,2 ]
Wang, Bowen [3 ]
Li, Yunqin [2 ,4 ]
Zhang, Jiaxin [2 ,4 ]
机构
[1] Tianjin Univ, Sch Architecture, 92 Weijin Rd, Tianjin 300072, Peoples R China
[2] Nanchang Univ, Sch Civil Engn & Architecture, 999 Xuefu Ave, Nanchang 330031, Jiangxi, Peoples R China
[3] Osaka Univ, Grad Sch Informat, Sci & Technol, 1-1 Yamadaoka, Osaka 5650871, Japan
[4] Osaka Univ, Grad Sch Informat, Div Sustainable Energy & Environm Engn, 1-1 Yamadaoka, Osaka 5650871, Japan
关键词
deep learning; architectural heritage; image retrieval;
D O I
10.3390/buildings12060809
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Propagating architectural heritage is of great significance to the inheritance and protection of local culture. Recommendations based on user preferences can greatly benefit the promotion of local architectural heritage so as to better protect and inherit historical culture. Thus, a powerful tool is necessary to build such a recommendation system. Recently, deep learning methods have proliferated as a means to analyze data in architectural domains. In this paper, based on a case study of Jiangxi, China, we explore a recommendation system for the architectural heritage of a local area. To organize our experiments, a dataset for traditional Chinese architecture heritage is constructed and a deep hashing retrieval method is proposed for the recommendation task. By utilizing a data fine-tuning strategy, our retrieval method can realize high-accuracy recommendation and break the model training restriction caused by insufficient data on local architectural heritage. Furthermore, we analyze the retrieval answers and map the data into a two-dimensional space to reveal the relationships between different architectural heritage categories. An image-to-location application is also provided for a better user experience.
引用
收藏
页数:16
相关论文
共 51 条
  • [1] Baeza-Yates R., 1999, MODERN INFORM RETRIE
  • [2] Belhi Abdelhak, 2020, 2020 IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT), P95, DOI 10.1109/ICIoT48696.2020.9089643
  • [3] Optimizing the evaluation of thermal transmittance with the thermometric method using multilayer perceptrons
    Bienvenido-Huertas, David
    Rubio-Bellido, Carlos
    Luis Perez-Ordonez, Juan
    Moyano, Juan
    [J]. ENERGY AND BUILDINGS, 2019, 198 : 395 - 411
  • [4] A Conceptual Design Approach for Archaeological Structures, a Challenging Issue between Innovation and Conservation: A Studied Case in Ancient Pompeii
    Calvanese, Vincenzo
    Zambrano, Alessandra
    [J]. BUILDINGS, 2021, 11 (04)
  • [5] Deep Cauchy Hashing for Hamming Space Retrieval
    Cao, Yue
    Long, Mingsheng
    Liu, Bin
    Wang, Jianmin
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1229 - 1237
  • [6] Cao Y, 2016, AAAI CONF ARTIF INTE, P3457
  • [7] HashNet: Deep Learning to Hash by Continuation
    Cao, Zhangjie
    Long, Mingsheng
    Wang, Jianmin
    Yu, Philip S.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 5609 - 5618
  • [8] Chen W, 2021, ARXIV
  • [9] A Neural Networks Approach to Detecting Lost Heritage in Historical Video
    Condorelli, Francesca
    Rinaudo, Fulvio
    Salvadore, Francesco
    Tagliaventi, Stefano
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (05)
  • [10] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848