DoBMark: A double-branch network for screen-shooting resilient image watermarking

被引:11
作者
Guo, Daidou [1 ]
Zhu, Xuan [1 ]
Li, Fengyong [2 ]
Yao, Heng [1 ]
Qin, Chuan [1 ]
机构
[1] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
[2] Shanghai Univ Elect Power, Coll Comp Sci & Technol, Shanghai 200090, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Robust watermarking; Screen-shooting; JND constraint; Alternate-fusion mechanism; SIGNAL COMPRESSION;
D O I
10.1016/j.eswa.2024.123159
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The dramatic changes in cross -media information transmission modes, especially screen -shooting, have made traditional robust image watermarking for digital channels less resistant to various physical noises from the real world. To address this problem, we propose a double -branch network for screen -shooting resilient image watermarking. Specifically, two weights conforming to a Gaussian distribution are assigned to the doublebranch encoder, and by jointly training, two residual images containing watermark information are produced to generate the fused watermarked image. A dual frame alternate -fusion mechanism and a just noticeable difference (JND) constraint function on residual images are employed to improve the watermark invisibility and the quality of watermarked images. A differentiable distortion network is introduced to enhance the robustness of the end -to -end network. Additionally, the decoder integrates a quality enhancement module (QEM) that can correct distortions and apply de -noising to the distorted images, thereby improving the accuracy of watermark information extraction. Experimental results show that the proposed scheme can achieve high robustness against the screen -shooting process while maintaining a satisfactory watermark capacity and visual quality of the watermarked image.
引用
收藏
页数:13
相关论文
共 43 条
[21]   Microsoft COCO: Common Objects in Context [J].
Lin, Tsung-Yi ;
Maire, Michael ;
Belongie, Serge ;
Hays, James ;
Perona, Pietro ;
Ramanan, Deva ;
Dollar, Piotr ;
Zitnick, C. Lawrence .
COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 :740-755
[22]   An invisible and robust watermarking scheme using convolutional neural networks [J].
Liu, Gang ;
Xiang, Ruotong ;
Liu, Jing ;
Pan, Rong ;
Zhang, Ziyi .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 210
[23]   A Novel Two-stage Separable Deep Learning Framework for Practical Blind Watermarking [J].
Liu, Yang ;
Guo, Mengxi ;
Zhang, Jian ;
Zhu, Yuesheng ;
Xie, Xiaodong .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :1509-1517
[24]  
Lu J., 2022, 2022 IEEE INT C MULT, P1
[25]   Distortion Agnostic Deep Watermarking [J].
Luo, Xiyang ;
Zhan, Ruohan ;
Chang, Huiwen ;
Yang, Feng ;
Milanfar, Peyman .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :13545-13554
[26]  
Luo Yuanjing, 2023, WWW '23: Proceedings of the ACM Web Conference 2023, P2340, DOI 10.1145/3543507.3583489
[27]   ADAPTIVE QUANTIZATION OF PICTURE SIGNALS USING SPATIAL MASKING [J].
NETRAVALI, AN ;
PRASADA, B .
PROCEEDINGS OF THE IEEE, 1977, 65 (04) :536-548
[28]   Robust template matching for affine resistant image watermarks [J].
Pereira, S ;
Pun, T .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2000, 9 (06) :1123-1129
[29]  
Qian K, 2021, PROCEEDINGS OF THE 18TH USENIX SYMPOSIUM ON NETWORKED SYSTEM DESIGN AND IMPLEMENTATION, P457
[30]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241