Image Annotation based on Semantic Structure and Graph Learning

被引:1
作者
Chen, Zhikui [1 ]
Wang, Meng [1 ]
Gao, Jing [1 ]
Li, Peng [1 ]
机构
[1] Dalian Univ Technol, Sch Software Technol, Dalian, Peoples R China
来源
2020 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH) | 2020年
基金
中国国家自然科学基金;
关键词
Image annotation; Graph learning; Semantic structure; INTEGRATION; RELEVANCE; MODEL;
D O I
10.1109/DASC-PICom-CBDCom-CyberSciTech49142.2020.00085
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image annotation is an important method to mine semantic information of images. The current methods do not fully consider the semantic repetitiveness and the imbalance hidden in labels, resulting in the unsatisfied image annotation. To address those problems, a semantic-independent nearestneighbor graph model is proposed based on semantic structure and graph learning. Specifically, graph learning is used for producing the pre-annotation of images on the basis of label propagation of nearest-neighbor images, which can improve accuracy of weak labels. Then, the semantic structure and the word graph are introduced to fine-tune the image annotation, which can reduce the redundancy of the predicted labels. Finally, two-representative datasets are used to evaluate the proposed method. The results show that the proposed method outperforms the compared methods in terms of precision, recall, F1 and N+.
引用
收藏
页码:451 / 456
页数:6
相关论文
共 50 条
[21]   Region-based supervised annotation for semantic image retrieval [J].
Shi, Fei ;
Wang, Jiajun ;
Wang, Zhiyong .
AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2011, 65 (11) :929-936
[22]   A Negative Sample Image Selection Method Referring to Semantic Hierarchical Structure for Image Annotation [J].
Chan, Shan-Bin ;
Yamana, Hayato ;
Satoh, Shin'ichi .
2013 INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS (SITIS), 2013, :162-167
[23]   A Semantic Distance Based Nearest Neighbor Method for Image Annotation [J].
Wu, Wei ;
Gao, Guanglai ;
Nie, Jianyun .
JOURNAL OF COMPUTERS, 2014, 9 (10) :2274-2280
[24]   Semantic annotation and retrieval of image collections [J].
Osman, Taha ;
Thakker, Dhavalkumar ;
Schaefer, Gerald ;
Leroy, Maxime ;
Fournier, Alain .
21ST EUROPEAN CONFERENCE ON MODELLING AND SIMULATION ECMS 2007: SIMULATIONS IN UNITED EUROPE, 2007, :324-+
[25]   A Hybrid Approach for Semantic Image Annotation [J].
Sezen, Arda ;
Turhan, Cigdem ;
Sengul, Gokhan .
IEEE ACCESS, 2021, 9 :131977-131994
[26]   Deep CRF-Graph Learning for Semantic Image Segmentation [J].
Ding, Fuguang ;
Wang, Zhenhua ;
Guo, Dongyan ;
Chen, Shengyong ;
Zhang, Jianhua ;
Shao, Zhanpeng .
PRICAI 2018: TRENDS IN ARTIFICIAL INTELLIGENCE, PT II, 2018, 11013 :360-368
[27]   Semantic hierarchies for image annotation: A survey [J].
Tousch, Anne-Marie ;
Herbin, Stephane ;
Audibert, Jean-Yves .
PATTERN RECOGNITION, 2012, 45 (01) :333-345
[28]   Image Semantic Distance Metric Learning Approach for Large-scale Automatic Image Annotation [J].
Jin, Cong ;
Jin, Shu-Wei .
IOTBD: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTERNET OF THINGS AND BIG DATA, 2016, :277-283
[29]   Learning Semantic Concepts from Noisy Media Collection for Automatic Image Annotation [J].
TIAN Feng ;
SHEN Xukun .
ChineseJournalofElectronics, 2015, 24 (04) :790-794
[30]   Learning Semantic Concepts from Noisy Media Collection for Automatic Image Annotation [J].
Tian Feng ;
Shen Xukun .
CHINESE JOURNAL OF ELECTRONICS, 2015, 24 (04) :790-794