AI Art Neural Constellation: Revealing the Collective and Contrastive State of AI-Generated and Human Art

被引:1
作者
Khan, Faizan Farooq [1 ]
Kim, Diana [1 ]
Jha, Divyansh [1 ]
Mohamed, Youssef [1 ]
Chang, Hanna H. [1 ]
Elgammal, Ahmed [2 ]
Elliott, Luba [3 ]
Elhoseiny, Mohamed [1 ]
机构
[1] KAUST, Thuwal, Saudi Arabia
[2] Rutgers State Univ, New Brunswick, NJ USA
[3] ELLUBA, London, England
来源
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW | 2024年
关键词
D O I
10.1109/CVPRW63382.2024.00742
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Discovering the creative potentials of a random signal to various artistic expressions in aesthetic and conceptual richness is a ground for the recent success of generative machine learning as a way of art creation. To understand the new artistic medium better, in this work, we comprehensively analyze AI-generated art within the context of human art heritage using our dataset, "ArtConstellation," comprising annotations for 6,000 WikiArt and 3,200 AI-generated artworks. After training various generative models, we compare the produced art samples withWikiArt data using the last hidden layer of a deep-CNN trained for style classification. By interpreting neural representations with important artistic concepts like Wolfflin's principles, we find that AI-generated artworks align with modern period art concepts (1800 - 2000). Out-Of-Distribution (OOD) and In-Distribution (ID) detection in CLIP space reveal that AI-generated art is ID to human art with landscapes and geometric abstract figures but OOD with deformed and twisted figures, showcasing unique characteristics. A human survey on emotional experience indicates color composition and familiar subjects as key factors in likability and emotions. We introduce our methodologies and dataset, "ArtNeural-Constellation," as a framework for contrasting human and AI-generated art. Code and data are available here.
引用
收藏
页码:7470 / 7478
页数:9
相关论文
共 21 条
[1]  
Achlioptas Panos, 2021, ARXIV
[2]   A Deep Learning Perspective on Beauty, Sentiment, and Remembrance of Art [J].
Cetinic, Eva ;
Lipic, Tomislav ;
Grgic, Sonja .
IEEE ACCESS, 2019, 7 :73694-73710
[3]  
Elgammal A., 2017, ICCC
[4]  
Elgammal Ahmed, 2018, AAAI
[5]   Taming Transformers for High-Resolution Image Synthesis [J].
Esser, Patrick ;
Rombach, Robin ;
Ommer, Bjoern .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12868-12878
[6]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[7]  
Hertzmann Aaron, 2022, Toward modeling creative processes for algorithmic painting
[8]  
Ho J, 2020, P 34 INT C NEUR INF, P6840
[9]  
Jha Divyansh, 2022, INT C COMP CREAT
[10]   Analyzing and Improving the Image Quality of StyleGAN [J].
Karras, Tero ;
Laine, Samuli ;
Aittala, Miika ;
Hellsten, Janne ;
Lehtinen, Jaakko ;
Aila, Timo .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8107-8116