A Deep Learning-Based Multidimensional Aesthetic Quality Assessment Method for Mobile Game Images

被引:4
作者
Wang, Tao [1 ]
Sun, Wei [1 ]
Wu, Wei [2 ]
Chen, Ying [2 ]
Min, Xiongkuo [1 ]
Lu, Wei [1 ]
Zhang, Zicheng [1 ]
Zhai, Guangtao [1 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Commun & Network Engn, Shanghai 200240, Peoples R China
[2] Alibaba Grp, Hangzhou 310052, Peoples R China
关键词
Aesthetic quality assessment (AQA); convolution neural network (CNN); deep learning; mobile game images; multitask learning;
D O I
10.1109/TG.2022.3212201
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Mobile games have played an increasingly significant role in people's leisure lives in recent years, thanks to the fast expansion of the gaming industry and the widespread use of mobile devices. The aesthetic quality of game pictures is a very important factor that attracts users' interest. However, evaluating the aesthetic quality of mobile game pictures is difficult since the painting styles of games vary greatly and the evaluation criteria are also diversified. In this article, we propose a multitask deep learning-based method, which is able to predict the aesthetic quality of mobile game images in multiple dimensions. The proposed model consists of two modules, a feature extraction module and a quality regression module. We extract quality-aware features from intermediate layers of the deep convolution neural network and then incorporate them into the final feature representation in the feature extraction module, allowing the model to fully use visual information from low to high levels. The quality regression module uses fully connected layers to map quality-aware features into quality scores across multiple dimensions. The multidimensional aesthetic quality scores are trained using a multitask learning approach, in which quality-aware features are shared across multiple dimensional quality prediction tasks. Finally, several key factors which help the proposed model perform better are analyzed. The experimental results indicate that our proposed method not only achieves the greatest performance on mobile game images, but also is applicable to natural scene images.
引用
收藏
页码:658 / 668
页数:11
相关论文
共 54 条
[1]  
[Anonymous], 2009, Adv. Mod. Radioelectronics
[2]  
[Anonymous], 2005, LIVE image quality assessment database release 2
[3]  
[Anonymous], 2010, P 18 ACM INT C MULT
[4]   REAL: Reality-Enhanced Applied Games [J].
Bellotti, Francesco ;
Berta, Riccardo ;
Paranthaman, Pratheep ;
Dange, Gautam ;
De Gloria, Alessandro .
IEEE TRANSACTIONS ON GAMES, 2020, 12 (03) :281-290
[5]  
Datta R, 2006, LECT NOTES COMPUT SC, V3953, P288, DOI 10.1007/11744078_23
[6]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[7]   Image Aesthetic Assessment An experimental survey [J].
Deng, Yubin ;
Loy, Chen Change ;
Tang, Xiaoou .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (04) :80-106
[8]   Perceptual Quality Assessment of Smartphone Photography [J].
Fang, Yuming ;
Zhu, Hanwei ;
Zeng, Yan ;
Ma, Kede ;
Wang, Zhou .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3674-3683
[9]   DeepSim: Deep similarity for image quality assessment [J].
Gao, Fei ;
Wang, Yi ;
Li, Panpeng ;
Tan, Min ;
Yu, Jun ;
Zhu, Yani .
NEUROCOMPUTING, 2017, 257 :104-114
[10]   Impact of Visual and Sound Orchestration on Physiological Arousal and Tension in a Horror Game [J].
Graja, Sarra ;
Lopes, Phil ;
Chanel, Guillaume .
IEEE TRANSACTIONS ON GAMES, 2021, 13 (03) :287-299