Research on image text generation based on word2vec visual vocabulary attention

被引:0
|
作者
Li, Danyang [1 ]
Zhao, Yahui [1 ]
Cui, Rongyi [1 ]
Zhao, Linlin [1 ]
机构
[1] Yanbian Univ, Intelligent Informat Proc Lab, Dept Comp Sci & Technol, Yanji, Jilin, Peoples R China
来源
2021 ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE (ACCTCS 2021) | 2021年
关键词
word2vec; Image2text; Image captions; Attention;
D O I
10.1109/ACCTCS52002.2021.00075
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A method of image text generation based on the combination of word2vec keyword extraction and attention mechanism is proposed. First, the co-occurring words with visual entities in the description set were extracted for each image in the dataset; Then the similarity was calculated for the extracted keywords, the similar words were filtered out to expand the keyword list, and the words in the vocabulary were retained to create new descriptions for the images. Finally, the test set images were combined with attention mechanism to generate description text. The experiments prove that the method proposed in this paper can achieve automatic annotation of images and can effectively solve the attention diffusion problem in the process of image text generation.
引用
收藏
页码:344 / 348
页数:5
相关论文
共 50 条
  • [1] Research on Chinese Text Classification Based on Word2vec
    Yang, Zhi-Tong
    Zheng, Jun
    2016 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2016, : 1166 - 1170
  • [2] Text Classification Research Based on Improved Word2vec and CNN
    Gao, Mengyuan
    Li, Tinghui
    Huang, Peifang
    SERVICE-ORIENTED COMPUTING, ICSOC 2018, 2019, 11434 : 126 - 135
  • [3] Research on patent text classification based on Word2Vec and LSTM
    Xiao, Lizhong
    Wang, Guangzhong
    Zuo, Yang
    2018 11TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2018, : 71 - 74
  • [4] Research on Semantic Prediction Analysis of Tibetan Text Based on Word2Vec
    Ding Hai-lan
    Yu Hong-zhi
    Qi Kun-yu
    2018 INTERNATIONAL SYMPOSIUM ON POWER ELECTRONICS AND CONTROL ENGINEERING (ISPECE 2018), 2019, 1187
  • [5] Microblogging Short Text Classification based on Word2Vec
    Zhang, Yonghui
    Liu, Jingang
    PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON ELECTRONIC, MECHANICAL, INFORMATION AND MANAGEMENT SOCIETY (EMIM), 2016, 40 : 395 - 401
  • [6] Chinese Text Summarization Algorithm Based on Word2vec
    Xu Chengzhang
    Liu Dan
    2018 INTERNATIONAL CONFERENCE ON CONTROL ENGINEERING AND ARTIFICIAL INTELLIGENCE (CCEAI 2018), 2018, 976
  • [7] Text Coverless Information Hiding Based on Word2vec
    Long, Yi
    Liu, Yuling
    CLOUD COMPUTING AND SECURITY, PT IV, 2018, 11066 : 463 - 472
  • [8] Short Text Classification Based on Wikipedia and Word2vec
    Liu Wensen
    Cao Zewen
    Wang Jun
    Wang Xiaoyi
    2016 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2016, : 1195 - 1200
  • [9] Characterizing Diseases from Unstructured Text: A Vocabulary Driven Word2vec Approach
    Ghosh, Saurav
    Chakraborty, Prithwish
    Cohn, Emily
    Brownstein, John S.
    Ramakrishnan, Naren
    CIKM'16: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2016, : 1129 - 1138
  • [10] Duplicate Short Text Detection Based on Word2vec
    Gao, Jin
    He, Yahao
    Zhang, Xiaoyan
    Xia, Yamei
    PROCEEDINGS OF 2017 8TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2017), 2017, : 33 - 37