Interactive Multi-level Stroke Control for Neural Style Transfer

被引:2
|
作者
Reimann, Max [1 ]
Buchheim, Benito [1 ]
Semmo, Amir [2 ]
Doellner, Jurgen [1 ]
Trapp, Matthias [1 ]
机构
[1] Univ Potsdam, Hasso Plattner Inst, Potsdam, Germany
[2] Digital Masterpieces GmbH, Potsdam, Germany
来源
2021 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW 2021) | 2021年
关键词
neural style transfer; local adjustments; mobile devices; artistic rendering; interaction;
D O I
10.1109/CW52790.2021.00009
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present StyleTune, a mobile app for interactive multi-level control of neural style transfers that facilitates creative adjustments of style elements and enables high output fidelity. In contrast to current mobile neural style transfer apps, StyleTune supports users to adjust both the size and orientation of style elements, such as brushstrokes and texture patches, on a global as well as local level. To this end, we propose a novel stroke-adaptive feed-forward style transfer network, that enables control over stroke size and intensity and allows a larger range of edits than current approaches. For additional level-of-control, we propose a network-agnostic method for stroke-orientation adjustment by utilizing the rotation-variance of Convolutional Neural Networks (CNNs). To achieve high output fidelity, we further add a patch-based style transfer method that enables users to obtain output resolutions of more than 20 Megapixel (Mpix). Our approach empowers users to create many novel results that are not possible with current mobile neural style transfer apps.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 50 条
  • [31] Contained Neural Style Transfer for Decorated Logo Generation
    Atarsaikhan, Gantugs
    Iwana, Brian Kenji
    Uchida, Seiichi
    2018 13TH IAPR INTERNATIONAL WORKSHOP ON DOCUMENT ANALYSIS SYSTEMS (DAS), 2018, : 317 - 322
  • [32] Stroke Controllable Fast Style Transfer with Adaptive Receptive Fields
    Jing, Yongcheng
    Liu, Yang
    Yang, Yezhou
    Feng, Zunlei
    Yu, Yizhou
    Tao, Dacheng
    Song, Mingli
    COMPUTER VISION - ECCV 2018, PT XIII, 2018, 11217 : 244 - 260
  • [33] Robust Nonparametric Distribution Transfer with Exposure Correction for Image Neural Style Transfer
    Liu, Shuai
    Hong, Caixia
    He, Jing
    Tian, Zhiqiang
    SENSORS, 2020, 20 (18) : 1 - 19
  • [34] Neural Style Transfer for Picture with Gradient Gram Matrix Description
    Jin, Heng
    Wang, Tian
    Zhang, Mengyi
    Li, Mingmin
    Wang, Yan
    Snoussi, Hichem
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7026 - 7030
  • [35] Employing Neural Style Transfer for Generating Deep Dream Images
    Al-Khazraji, Lafta R.
    Abbas, Ayad R.
    Jamil, Abeer S.
    ARO-THE SCIENTIFIC JOURNAL OF KOYA UNIVERSITY, 2022, 10 (02): : 134 - 141
  • [36] Towards Compact Reversible Image Representations for Neural Style Transfer
    Liu, Xiyao
    Yang, Siyu
    Zhang, Jian
    Schaefer, Gerald
    Li, Jiya
    Fang, Xunli
    Wu, Songtao
    Fang, Hui
    COMPUTER VISION - ECCV 2024, PT LXVI, 2025, 15124 : 252 - 268
  • [37] Transport-Based Neural Style Transfer for Smoke Simulations
    Kim, Byungsoo
    Azevedo, Vinicius C.
    Gross, Markus
    Solenthaler, Barbara
    ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (06):
  • [38] Improving Domain Generalization in Segmentation Models with Neural Style Transfer
    Kline, Timothy L.
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 1324 - 1328
  • [39] Comparison of Neural Style Transfer Performance of Deep Learning Models
    Karadag, Batuhan
    Ari, Ali
    Karadag, Muge
    JOURNAL OF POLYTECHNIC-POLITEKNIK DERGISI, 2021, 24 (04): : 1611 - 1622
  • [40] A comprehensive framework of multiple semantics preservation in neural style transfer
    Ye, Wujian
    Zhu, Xueke
    Xu, Zuoteng
    Liu, Yijun
    Chang, Chin-Chen
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 82