Mobile visual search model for Dunhuang murals in the smart library

被引:21
作者
Zeng, Ziming [1 ,2 ]
Sun, Shouqiang [2 ]
Li, Tingting [2 ]
Yin, Jie [2 ]
Shen, Yueyan [2 ]
机构
[1] Wuhan Univ, Ctr Studies Informat Resources, Wuhan, Peoples R China
[2] Wuhan Univ, Sch Informat Management, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Mobile visual search; Smart library; Dunhuang murals; BOW; Semantic association; Cultural heritage; RECOGNITION; SYSTEM; SURF;
D O I
10.1108/LHT-03-2021-0079
中图分类号
G25 [图书馆学、图书馆事业]; G35 [情报学、情报工作];
学科分类号
1205 ; 120501 ;
摘要
Purpose - The purpose of this paper is to build a mobile visual search service system for the protection of Dunhuang cultural heritage in the smart library. A novel mobile visual search model for Dunhuang murals is proposed to help users acquire rich knowledge and services conveniently. Design/methodology/approach - First, local and global features of images are extracted, and the visual dictionary is generated by the k-means clustering. Second, the mobile visual search model based on the bag-ofwords (BOW) and multiple semantic associations is constructed. Third, the mobile visual search service system of the smart library is designed in the cloud environment. Furthermore, Dunhuang mural images are collected to verify this model. Findings - The findings reveal that the BOW_SIFT_HSV_MSA model has better search performance for Dunhuang mural images when the scale-invariant feature transform (SIFT) and the hue, saturation and value (HSV) are used to extract local and global features of the images. Compared with different methods, this model is the most effective way to search images with the semantic association in the topic, time and space dimensions. Research limitations/implications - Dunhuang mural image set is a part of the vast resources stored in the smart library, and the fine-grained semantic labels could be applied to meet diverse search needs. Originality/value - The mobile visual search service system is constructed to provide users with Dunhuang cultural services in the smart library. A novel mobile visual search model based on BOW and multiple semantic associations is proposed. This study can also provide references for the protection and utilization of other cultural heritages.
引用
收藏
页码:1796 / 1818
页数:23
相关论文
共 73 条
[1]   The role of personal digital library in supporting research collaboration [J].
Aghakhani, Navid ;
Lagzian, Fatemeh ;
Hazarika, Bidyut .
ELECTRONIC LIBRARY, 2013, 31 (05) :548-560
[2]  
Aittola M, 2003, LECT NOTES COMPUT SC, V2795, P411
[3]   Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces [J].
Alcantarilla, Pablo F. ;
Nuevo, Jesus ;
Bartoli, Adrien .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2013, 2013,
[4]   KAZE Features [J].
Alcantarilla, Pablo Fernandez ;
Bartoli, Adrien ;
Davison, Andrew J. .
COMPUTER VISION - ECCV 2012, PT VI, 2012, 7577 :214-227
[5]  
[Anonymous], 2009, P 5 INT C MOB MULT C
[6]  
[Anonymous], 2009, P 18 INT C WORLD WID
[7]   The smart library project: Development of information and library services for educational and scientific activity [J].
Baryshev, Ruslan Aleksandrovich ;
Verkhovets, Sergey Vladimirovich ;
Babina, Olga Ivanovna .
ELECTRONIC LIBRARY, 2018, 36 (03) :535-549
[8]   Speeded-Up Robust Features (SURF) [J].
Bay, Herbert ;
Ess, Andreas ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 110 (03) :346-359
[9]  
Burgess J. T. F., 2010, Computers in Libraries, V30, P12
[10]   How to make the library smart? The conceptualization of the smart library [J].
Cao, Gaohui ;
Liang, Mengli ;
Li, Xuguang .
ELECTRONIC LIBRARY, 2018, 36 (05) :811-825