A picture tells a thousand words-About you! User interest profiling from user generated visual content

被引:35
作者
You, Quanzeng [1 ]
Bhatia, Sumit [2 ]
Luo, Jiebo [1 ]
机构
[1] Univ Rochester, Dept Comp Sci, Rochester, NY 14627 USA
[2] IBM Almaden Res Ctr, San Jose, CA USA
关键词
User profiling; Social multimedia; Multimedia analysis; IMAGE;
D O I
10.1016/j.sigpro.2015.10.032
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Inference of online social network users' attributes and interests has been an active research topic. Accurate identification of users' attributes and interests is crucial for improving the performance of personalization and recommender systems. Most of the existing works have focused on textual content generated by the users and have successfully used it for predicting users' interests and other identifying attributes. However, little attention has been paid to user generated visual content (images) that is becoming increasingly popular and pervasive in recent times. We posit that images posted by users on online social networks are a reflection of topics they are interested in and propose an approach to infer user attributes from images posted by them. We analyze the content of individual images and then aggregate the image-level knowledge to infer user-level interest distribution. We employ image-level similarity to propagate the label information between images, as well as utilize the image category information derived from the user created organization structure to further propagate the category-level knowledge for all images. A large scale social network dataset of 1.5+ million images created from Pinterest is used for evaluation and the experimental results demonstrate the effectiveness of our proposed approach. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:45 / 53
页数:9
相关论文
共 29 条
[1]  
[Anonymous], 2010, P 3 ACM INT C WEB SE
[2]  
[Anonymous], 2012, NIPS
[3]  
[Anonymous], 2010, Search engines: Information retrieval in practice
[4]  
[Anonymous], 2008, Advances in neural information processing systems
[5]  
[Anonymous], 2013, Caffe: An Open Source Convolutional Architecture for Fast Feature Embedding
[6]   Gender identity and lexical variation in social media [J].
Bamman, David ;
Eisenstein, Jacob ;
Schnoebelen, Tyler .
JOURNAL OF SOCIOLINGUISTICS, 2014, 18 (02) :135-160
[7]   Learning Deep Architectures for AI [J].
Bengio, Yoshua .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 2 (01) :1-127
[8]  
Burger J.D, 2011, P 2011 C EMPIRICAL M, P1301, DOI DOI 10.1007/S00256-005-0933-8
[9]   Predicting ReTweet Count Using Visual Cues [J].
Can, Ethem F. ;
Oktay, Huseyin ;
Manmatha, R. .
PROCEEDINGS OF THE 22ND ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM'13), 2013, :1481-1484
[10]  
Cheng Zhiyuan, 2010, PROC 19 ACM INT C IN, P759, DOI DOI 10.1145/1871437.1871535