Mobile Application for Archaeological Site Image Content Retrieval and Automated Generating Image Descriptions with Neural Network

被引:8
作者
Prasomphan, Sathit [1 ]
Jung, Jai E. [2 ]
机构
[1] King Mongkuts Univ Technol North Bangkok, Fac Sci Appl, Dept Comp & Informat Sci, 1518 Pracharat 1 Rd, Bangkok 10800, Thailand
[2] Chung Ang Univ, Dept Comp Sci, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Automated generating image descriptions; Neural network; SIFT algorithms; Feature extraction;
D O I
10.1007/s11036-016-0805-6
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a novel algorithm for generating descriptions of stupa image such as stupa's era, stupa's architecture and other description in mobile application by using key points generated from SIFT algorithms and learning stupa description from the generated key points with artificial neural network. Neural network was used for being the classifier for generating the description. We have presented a new approach to feature extraction based on analysis of key points and descriptors of an image. The algorithms were tested with stupa image dataset in Phra Nakhon Si Ayutta province, Sukhothai province and Bangkok. The experimental results show that the proposed framework can efficiently give the correct descriptions to the stupa image compared to using the traditional method.
引用
收藏
页码:642 / 649
页数:8
相关论文
共 15 条
[1]   Social big data: Recent achievements and new challenges [J].
Bello-Orgaz, Gema ;
Jung, Jason J. ;
Camacho, David .
INFORMATION FUSION, 2016, 28 :45-59
[2]  
Chareonla C., 1981, THESIS MAGADH U INDI
[3]   Every Picture Tells a Story: Generating Sentences from Images [J].
Farhadi, Ali ;
Hejrati, Mohsen ;
Sadeghi, Mohammad Amin ;
Young, Peter ;
Rashtchian, Cyrus ;
Hockenmaier, Julia ;
Forsyth, David .
COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 :15-+
[4]   Framing Image Description as a Ranking Task: Data, Models and Evaluation Metrics [J].
Hodosh, Micah ;
Young, Peter ;
Hockenmaier, Julia .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2013, 47 :853-899
[5]   Exploiting geotagged resources for spatial clustering on social network services [J].
Jung, Jason J. .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (04) :1356-1367
[6]   Big Bibliographic Data Analytics by Random Walk Model [J].
Jung, Jason J. .
MOBILE NETWORKS & APPLICATIONS, 2015, 20 (04) :533-537
[7]  
Karpathy A, 2015, PROC CVPR IEEE, P3128, DOI 10.1109/CVPR.2015.7298932
[8]   Sequence Clustering-based Automated Rule Generation for Adaptive Complex Event Processing [J].
Lee, O-Joun ;
Jung, Jai E. .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 66 :100-109
[9]  
Lowe D. G., 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision, P1150, DOI 10.1109/ICCV.1999.790410
[10]   Distinctive image features from scale-invariant keypoints [J].
Lowe, DG .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) :91-110