Image Recommendation System Based on Environmental and Human Face Information

被引:0
作者
Won, Hye-min [1 ]
Heo, Yong Seok [1 ]
Kwak, Nojun [2 ]
机构
[1] Ajou Univ, Dept Elect & Comp Engn, Suwon 16499, South Korea
[2] Seoul Natl Univ, Grad Sch Convergence Sci & Technol, RICS, Seoul 08826, South Korea
关键词
recommendation system; image recommendation system; human face; emotion recognition; HCI; COLOR;
D O I
10.3390/s23115304
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With the advancement of computer hardware and communication technologies, deep learning technology has made significant progress, enabling the development of systems that can accurately estimate human emotions. Factors such as facial expressions, gender, age, and the environment influence human emotions, making it crucial to understand and capture these intricate factors. Our system aims to recommend personalized images by accurately estimating human emotions, age, and gender in real time. The primary objective of our system is to enhance user experiences by recommending images that align with their current emotional state and characteristics. To achieve this, our system collects environmental information, including weather conditions and user-specific environment data through APIs and smartphone sensors. Additionally, we employ deep learning algorithms for real-time classification of eight types of facial expressions, age, and gender. By combining this facial information with the environmental data, we categorize the user's current situation into positive, neutral, and negative stages. Based on this categorization, our system recommends natural landscape images that are colorized using Generative Adversarial Networks (GANs). These recommendations are personalized to match the user's current emotional state and preferences, providing a more engaging and tailored experience. Through rigorous testing and user evaluations, we assessed the effectiveness and user-friendliness of our system. Users expressed satisfaction with the system's ability to generate appropriate images based on the surrounding environment, emotional state, and demographic factors such as age and gender. The visual output of our system significantly impacted users' emotional responses, resulting in a positive mood change for most users. Moreover, the system's scalability was positively received, with users acknowledging its potential benefits when installed outdoors and expressing a willingness to continue using it. Compared to other recommender systems, our integration of age, gender, and weather information provides personalized recommendations, contextual relevance, increased engagement, and a deeper understanding of user preferences, thereby enhancing the overall user experience. The system's ability to comprehend and capture intricate factors that influence human emotions holds promise in various domains, including human-computer interaction, psychology, and social sciences.
引用
收藏
页数:22
相关论文
共 44 条
  • [1] Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions
    Adomavicius, G
    Tuzhilin, A
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (06) : 734 - 749
  • [2] Reinforcement Learning based Recommender Systems: A Survey
    Afsar, M. Mehdi
    Crump, Trafford
    Far, Behrouz
    [J]. ACM COMPUTING SURVEYS, 2023, 55 (07)
  • [3] A novel multi-feature fusion deep neural network using HOG and VGG-Face for facial expression classification
    Ahadit, Alagesan Bhuvaneswari
    Jatoth, Ravi Kumar
    [J]. MACHINE VISION AND APPLICATIONS, 2022, 33 (04)
  • [4] [Anonymous], 2002, INT ORG STANDARDIZAT
  • [5] Aslam M.M., 2006, J MARK COMMUN, V12, P15, DOI [10.1080/13527260500247827, DOI 10.1080/13527260500247827]
  • [6] Babanne V., 2020, International Research Journal of Engineering and Technology IRJET, V7, P701
  • [7] Bokhare A., 2023, SN Comput. Sci, V4, P215, DOI DOI 10.1007/S42979-022-01619-7
  • [8] Bridger R., 2017, Introduction to Human Factors and Ergonomics
  • [9] TPE-GAN: Thumbnail Preserving Encryption Based on GAN With Key
    Chai, Xiuli
    Wang, Yinjing
    Chen, Xiuhui
    Gan, Zhihua
    Zhang, Yushu
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 972 - 976
  • [10] Facial Expression Recognition Method Based on Improved VGG Convolutional Neural Network
    Cheng, Shuo
    Zhou, Guohui
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2020, 34 (07)