Application of multi-level adaptive neural network based on optimization algorithm in image style transfer

被引:3
|
作者
Li, Hong-an [1 ,2 ]
Wang, Lanye [1 ]
Liu, Jun [3 ]
机构
[1] Xian Univ Sci & Technol, Coll Comp Sci & Technol, Xian 710054, Peoples R China
[2] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[3] Shaanxi Tech Coll Finance & Econ, Xianyang 712099, Peoples R China
关键词
Arbitrary image style transfer; Multi-level strategy; Convolution block attention module; Adaptive weight skip connection;
D O I
10.1007/s11042-024-18451-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Arbitrary image style transfer is the process of inputting any set of images to generate images with a certain artistic style. Aiming at the problem of how to adapt both global style and local style and maintain spatial consistency based on the arbitrary style transfer algorithm. This paper proposed a multi-level adaptive arbitrary style transfer network and adopted a multi-level strategy to integrate multi-level context information in a progressive manner. First, the convolution block attention module CBAM\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\left( CBAM \right) }$$\end{document} is referenced to the encoder to improve the semantic matching of the algorithm and maintain spatial consistency. Secondly, the multi-branch content is integrated with the style features, quantifying the local similarity between content and style features in a non-local way, rearranges the distribution of style representation according to the content representation. Finally, the multi-layer features after alignment are provided to the decoder module by the Adaptive Weight Skip Connection AWSC\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\varvec{\left( AWSC \right) }$$\end{document}, which can integrate local and global styles efficiently and flexibly. In addition, the identity loss is used to eliminate image artifacts and better retain the content structure information. Qualitative and quantitative experiments show that the proposed method is superior to the most advanced CNN-based method, and can generate high-quality stylized images with arbitrary styles and better visual effects.
引用
收藏
页码:73127 / 73149
页数:23
相关论文
共 50 条
  • [1] Application of a neural network based space vector PWM algorithm to multi-level inverters
    Kocalmis, Ayse
    Suenter, Sedat
    INTERNATIONAL AEGEAN CONFERENCE ON ELECTRICAL MACHINES AND POWER ELECTRONICS & ELECTROMOTION, PROCEEDINGS, 2007, : 181 - 185
  • [2] Image segmentation algorithm based on multi-level feature adaptive fusion
    Yuan X.-P.
    He X.
    Wang X.-Q.
    Hu Y.-M.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2022, 56 (10): : 1958 - 1966
  • [3] Interactive Multi-level Stroke Control for Neural Style Transfer
    Reimann, Max
    Buchheim, Benito
    Semmo, Amir
    Doellner, Jurgen
    Trapp, Matthias
    2021 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW 2021), 2021, : 1 - 8
  • [4] Multi-level image thresholding based on social spider algorithm for global optimization
    Rahkar Farshi T.
    Orujpour M.
    International Journal of Information Technology, 2019, 11 (4) : 713 - 718
  • [5] AMLR: An Adaptive Multi-Level Routing Algorithm for Dragonfly Network
    Zhu, Lijing
    Gu, Huaxi
    Yu, Xiaoshan
    Sun, Wenhao
    IEEE COMMUNICATIONS LETTERS, 2021, 25 (11) : 3533 - 3536
  • [6] Thangka mural style transfer based on progressive style-attentional network and multi-level loss function
    Fang, Jie
    Li, Hang
    Jia, Ying
    Ji, Liqi
    Chen, Xin
    Wang, Nianyi
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (04)
  • [7] Optimization model and algorithm for design of multi-level distribution network
    Qin, Jin
    Shi, Feng
    Wuhan Ligong Daxue Xuebao (Jiaotong Kexue Yu Gongcheng Ban)/Journal of Wuhan University of Technology (Transportation Science and Engineering), 2007, 31 (05): : 819 - 822
  • [8] Multi-level region-based Convolutional Neural Network for image emotion classification
    Rao, Tianrong
    Li, Xiaoxu
    Zhang, Haimin
    Xu, Min
    NEUROCOMPUTING, 2019, 333 : 429 - 439
  • [9] The Contour Image Style Transfer based Convolutional Neural Network
    Deng, Nan
    Li, Jing
    Wang, Xingce
    Wu, Zhongke
    Fu, Yan
    Shui, Wuyang
    Zhou, Mingquan
    Korkhov, Vladimir
    Gaspary, Luciano Paschoal
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT) 2019, 2019, 11049
  • [10] Research Progress of Image Style Transfer Based on Neural Network
    Lian, Lu
    Tian, Qichuan
    Tan, Run
    Zhang, Xiaohang
    Computer Engineering and Applications, 2024, 60 (09) : 30 - 47