Image Appeal Revisited: Analysis, New Dataset, and Prediction Models

被引:1
作者
Goering, Steve [1 ]
Raake, Alexander [1 ]
机构
[1] Tech Univ Ilmenau, Audiovisual Technol Grp, D-98693 Ilmenau, Germany
关键词
Predictive models; Social networking (online); Art; Visualization; Multimedia Web sites; Analytical models; Image quality; Image processing; Machine learning; INDEX TERMS; Data models; Image appeal; image aesthetic; image popularity; machine learning; image dataset; QUALITY;
D O I
10.1109/ACCESS.2023.3292588
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There are more and more photographic images uploaded to social media platforms such as Instagram, Flickr, or Facebook on a daily basis. At the same time, attention and consumption for such images is high, with image views and liking as one of the success factors for users and driving forces for social media algorithms. Here, "liking" can be assumed to be driven by image appeal and further factors such as who is posting the images and what they may show and reveal about the posting person. It is therefore of high research interest to evaluate the appeal of such images in the context of social media platforms. Such an appeal evaluation may help to improve image quality or could be used as an additional filter criterion to select good images. To analyze image appeal, various datasets have been established over the past years. However, not all datasets contain high-resolution images, are up to date, or include additional data, such as meta-data or social-media-type data such as likes and views. We created our own dataset "AVT-ImageAppeal-Dataset", which includes images from different photo-sharing platforms. The dataset also includes a subset of other state-of-the-art datasets and is extended by social-media-type data, meta-data, and additional images. In this paper, we describe the dataset and a series of laboratory- and crowd-tests we conducted to evaluate image appeal. These tests indicate that there is only a small influence when likes and views are included in the presentation of the images in comparison to when these are not shown, and also the appeal ratings are only a little correlated to likes and views. Furthermore, it is shown that lab and crowd tests are highly similar considering the collected appeal ratings. In addition to the dataset, we also describe various machine learning models for the prediction of image appeal, using only the photo itself as input. The models have a similar or slightly better performance than state-of-the-art models. The evaluation indicates that there is still an improvement in image appeal prediction and furthermore, other aspects, such as the presentation context could be evaluated.
引用
收藏
页码:69563 / 69585
页数:23
相关论文
共 99 条
[1]  
Abdenebaoui L., 2018, 2018 INT C CONT CBMI, P1, DOI DOI 10.1109/CBMI.2018
[2]  
Amirshahi Seyed Ali, 2016, arXiv
[3]  
[Anonymous], 1976, PHOTOGRAPHIC COMPOSI
[4]  
[Anonymous], 2018, EXTENDED FEATURES US
[5]  
[Anonymous], Transfer learning and fine-tuning | TensorFlow Core
[6]  
[Anonymous], 1999, ITU-T Recommendation H.320
[7]  
[Anonymous], 2013, European Network on Quality of Experience in in Multimedia Systems and Services (COST Action IC 1003)
[8]  
[Anonymous], 2014, BT50013 ITUR
[9]   Automated Aesthetic Analysis of Photographic Images [J].
Aydin, Tunc Ozan ;
Smolic, Aljoscha ;
Gross, Markus .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2015, 21 (01) :31-42
[10]  
Bhattacharya S., 2010, PROC 18 ACM INT C MU, P271