An adversarial contrastive learning based cross-modality zero-watermarking scheme for DIBR 3D video copyright protection

被引:0
作者
Liu, Xiyao [1 ]
Dang, Qingyu [1 ]
Wang, Huiyi [1 ]
Deng, Xiaoheng [2 ]
Fan, Xunli [3 ]
Yang, Cundian [4 ]
Chen, Zhihong [5 ]
Fang, Hui [6 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha, Peoples R China
[2] Cent South Univ, Sch Elect Informat, Changsha, Peoples R China
[3] Northwest Univ, Sch Informat Sci & Technol, Xian, Peoples R China
[4] Peking Univ, Shenzhen Grad Sch, Shenzhen, Peoples R China
[5] Univ Sci & Technol China, Sch Data Sci, Hefei, Peoples R China
[6] Loughborough Univ, Dept Comp Sci, Loughborough, England
基金
中国国家自然科学基金;
关键词
Zero-watermarking; DIBR 3D videos; Contrastive learning; Adversarial distortion simulator; Cross-modality feature fusion; ROBUST;
D O I
10.1016/j.neucom.2025.130068
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Copyright protection of depth image-based rendering (DIBR) videos has raised significant concerns due to their increasing popularity. Zero-watermarking, emerging as a powerful tool to protect the copyright of DIBR 3D videos, mainly relies on traditional feature extraction methods, thus necessitating improvements in robustness against complex geometric attacks and its ability to strike a balance between robustness and distinguishability. This paper presents a novel zero-watermarking scheme based on cross-modality feature fusion within a contrastive learning framework. Our approach integrates complementary information from 2D frames and depth maps using a cross-modality attention feature fusion mechanism to obtain discriminative features. Moreover, our features achieve a better trade-off between robustness and distinguishability by leveraging a designed contrastive learning strategy with an adversarial distortion simulator. Experimental results demonstrate our remarkable performance by reducing the false negative rates to around 0.2% when the false positive rate is equal to 0.5%, which is superior to the state-of-the-art zero-watermarking methods.
引用
收藏
页数:11
相关论文
共 42 条
[1]  
[Anonymous], 2012, 3D movie making: stereoscopic digital cinema from script to screen
[2]   A robust blind watermarking algorithm for depth-image-based rendering 3D images [J].
Chen, Lei ;
Zhao, Jiying .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 87 (87)
[3]  
Chen T, 2020, PR MACH LEARN RES, V119
[4]   Reversible data hiding for depth maps using the depth no-synthesis-error model [J].
Chung, Kuo-Liang ;
Yang, Wei-Jen ;
Yang, Wei-Ning .
INFORMATION SCIENCES, 2014, 269 :159-175
[5]   A novel hashing scheme for Depth-image-based-rendering 3D images [J].
Cui, Chen ;
Mao, Haokun ;
Niu, Xiamu ;
Zhang, Lixian ;
Hayat, Tasawar ;
Alsaedi, Ahmed .
NEUROCOMPUTING, 2016, 191 :1-11
[6]   ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes [J].
Dai, Angela ;
Chang, Angel X. ;
Savva, Manolis ;
Halber, Maciej ;
Funkhouser, Thomas ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2432-2443
[7]  
DAndrea A., 2022, Copyright and legal issues surrounding 3D data
[8]   Color stereo image encryption and local zero-watermarking schemes using octonion Hahn moments and modified Henon map [J].
Daoui, Achraf ;
Yamni, Mohamed ;
Karmouni, Hicham ;
Sayyouri, Mhamed ;
Qjidaa, Hassan ;
Ahmad, Musheer ;
Abd El-Latif, Ahmed A. .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (10) :8927-8954
[9]   A robust and imperceptible watermarking method for 3D DIBR images [J].
Etoom, Wala ;
Al-Haj, Ali .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (20) :28165-28182
[10]   TMCIH: Perceptual Robust Image Hashing with Transformer-based Multi-layer Constraints [J].
Fang, Yaodong ;
Zhou, Yuanding ;
Li, Xinran ;
Kong, Ping ;
Qin, Chuan .
PROCEEDINGS OF THE 2023 ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, IH&MMSEC 2023, 2023, :7-12