Image and Text Correlation Judgement Based on Deep Learning

被引:0
作者
Liu, Yinyang [1 ]
Xu, Xiaobin [1 ]
Li, Feixiang [1 ]
机构
[1] Beijing Univ Technol, Beijing Adv Innovat Ctr Future Internet Technol, Beijing, Peoples R China
来源
PROCEEDINGS OF 2018 IEEE 9TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS) | 2018年
关键词
deep learning; image processing; natural language processing; classification;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep learning have achieved great success both in image and natural language processing, When to search similar images, there are some data occur which image and image title are not related To deal with this problem which involves the process of both image and natural language, we propose a convolutional neural network model. The model both uses the feature of images and texts to judge the similarity. In the model, the two type of feature extracted respectively and then give the probability of the relationship between images and titles. This probability is added to the search strategy as a score to improve search quality.
引用
收藏
页码:844 / 847
页数:4
相关论文
共 16 条
[1]  
[Anonymous], LEARNING DEEP STRUCT
[2]  
[Anonymous], 2014, INF SOFTW TECHNOL
[3]  
[Anonymous], 2014, 52 ANN M ASS COMP LI
[4]  
[Anonymous], 2016, Learning Text Representation Using Recurrent Convolutional Neural Network with Highway Layers
[5]  
[Anonymous], CONVOLUTIONAL NEURAL
[6]  
[Anonymous], 2015, CVPR, DOI DOI 10.48550/ARXIV.1411.4952
[7]   A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems [J].
Elkahky, Ali ;
Song, Yang ;
He, Xiaodong .
PROCEEDINGS OF THE 24TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW 2015), 2015, :278-288
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]  
Karpathy A, 2015, PROC CVPR IEEE, P3128, DOI 10.1109/CVPR.2015.7298932
[10]  
Krizhevsky A., 2017, COMMUN ACM, V60, P84, DOI [DOI 10.1145/3065386, 10.1145/3065386]