RETINA-INSPIRED SPATIO-TEMPORAL FILTERING FOR DYNAMIC VIDEO CODING

被引:0
作者
Doutsi, Effrosyni [1 ,2 ]
Antonini, Marc [1 ]
Tsakalides, Panagiotis [2 ]
机构
[1] Univ Cote dAzur, CNRS, I3S, Nice, France
[2] FORTH, Inst Comp Sci, Iraklion, Greece
来源
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2022年
关键词
Center-surround filter; dynamic transform; video compression; retina; neuro-inspired filtering; perception-based processing; IMAGE;
D O I
10.1109/ICIP46576.2022.9897355
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The goal of this work is to propose a simple yet efficient way to dynamically transform a sequence of images according to the functional properties of the visual system. To achieve this goal, we extend to video sequences the Retina-Inspired Filter (RIF), which we have recently proposed for still images. Under the assumption that the input signal remains constant for a given time, the RIF decomposition was proven to be invertible, meaning that the image could be perfectly recovered. In this paper, we relax this assumption into a piece-wise constant input and we prove that RIF can be applied to a Group Of Pictures (GOP). Under the condition that a GOP consists of frames without strong pixel motion, we mathematically prove and experimentally show that when RIF is applied to GOP, whatever the size of the GOP is, we are still able to perfectly recover the video frames and at the same time simplify the complexity of the whole process. In addition, we show that while the GOP size increases, the memory cost required to store this amount of frames is sufficiently reduced.
引用
收藏
页码:3321 / 3325
页数:5
相关论文
共 50 条
[31]   Spatio-temporal analysis of light-induced Fos expression in the retina of rd mutant mice [J].
Huerta, JJ ;
Llamosas, MM ;
Cernuda-Cernuda, R ;
García-Fernández, JM .
BRAIN RESEARCH, 1999, 834 (1-2) :122-127
[32]   Smoke detection in video using convolutional neural networks and efficient spatio-temporal features [J].
Hashemzadeh, Mahdi ;
Farajzadeh, Nacer ;
Heydari, Milad .
APPLIED SOFT COMPUTING, 2022, 128
[33]   Undetectable video steganography by considering spatio-temporal steganalytic features in the embedding cost function [J].
Ghamsarian, Negin ;
Khademi, Morteza .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (27-28) :18909-18939
[34]   Undetectable video steganography by considering spatio-temporal steganalytic features in the embedding cost function [J].
Negin Ghamsarian ;
Morteza Khademi .
Multimedia Tools and Applications, 2020, 79 :18909-18939
[35]   STD-Net: Spatio-Temporal Decomposition Network for Video Demoiring With Sparse Transformers [J].
Niu, Yuzhen ;
Xu, Rui ;
Lin, Zhihua ;
Liu, Wenxi .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (09) :8562-8575
[36]   Saliency-Aware Spatio-Temporal Artifact Detection for Compressed Video Quality Assessment [J].
Lin, Liqun ;
Zheng, Yang ;
Chen, Weiling ;
Lan, Chengdong ;
Zhao, Tiesong .
IEEE SIGNAL PROCESSING LETTERS, 2023, 30 :693-697
[37]   Video-based salient object detection via spatio-temporal difference and coherence [J].
Huang, Lei ;
Luo, Bin .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (09) :10685-10699
[38]   Adaptive Spatio-Temporal Graph Enhanced Vision-Language Representation for Video QA [J].
Jin, Weike ;
Zhao, Zhou ;
Cao, Xiaochun ;
Zhu, Jieming ;
He, Xiuqiang ;
Zhuang, Yueting .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :5477-5489
[39]   Dynamic scene novel view synthesis via deferred spatio-temporal consistency [J].
Fulop-Balogh, Beatrix-Emoke ;
Tursman, Eleanor ;
Tompkin, James ;
Digne, Julie ;
Bonneel, Nicolas .
COMPUTERS & GRAPHICS-UK, 2022, 107 :220-230
[40]   BiC-Net: Learning Efficient Spatio-temporal Relation for Text-Video Retrieval [J].
Han, Ning ;
Zeng, Yawen ;
Shi, Chuhao ;
Xiao, Guangyi ;
Chen, Hao ;
Chen, Jingjing .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (03)