RETINA-INSPIRED SPATIO-TEMPORAL FILTERING FOR DYNAMIC VIDEO CODING

被引:0
作者
Doutsi, Effrosyni [1 ,2 ]
Antonini, Marc [1 ]
Tsakalides, Panagiotis [2 ]
机构
[1] Univ Cote dAzur, CNRS, I3S, Nice, France
[2] FORTH, Inst Comp Sci, Iraklion, Greece
来源
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2022年
关键词
Center-surround filter; dynamic transform; video compression; retina; neuro-inspired filtering; perception-based processing; IMAGE;
D O I
10.1109/ICIP46576.2022.9897355
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The goal of this work is to propose a simple yet efficient way to dynamically transform a sequence of images according to the functional properties of the visual system. To achieve this goal, we extend to video sequences the Retina-Inspired Filter (RIF), which we have recently proposed for still images. Under the assumption that the input signal remains constant for a given time, the RIF decomposition was proven to be invertible, meaning that the image could be perfectly recovered. In this paper, we relax this assumption into a piece-wise constant input and we prove that RIF can be applied to a Group Of Pictures (GOP). Under the condition that a GOP consists of frames without strong pixel motion, we mathematically prove and experimentally show that when RIF is applied to GOP, whatever the size of the GOP is, we are still able to perfectly recover the video frames and at the same time simplify the complexity of the whole process. In addition, we show that while the GOP size increases, the memory cost required to store this amount of frames is sufficiently reduced.
引用
收藏
页码:3321 / 3325
页数:5
相关论文
共 50 条
  • [21] A TEMPORAL PRE-FILTER FOR VIDEO CODING BASED ON BILATERAL FILTERING
    Enhorn, Jack
    Sjoberg, Rickard
    Wennersten, Per
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1161 - 1165
  • [22] Learned Wavelet Video Coding Using Motion Compensated Temporal Filtering
    Meyer, Anna
    Brand, Fabian
    Kaup, Andre
    IEEE ACCESS, 2023, 11 : 113390 - 113401
  • [23] Adaptive Global Motion Temporal Filtering for High Efficiency Video Coding
    Krutz, Andreas
    Glantz, Alexander
    Tok, Michael
    Esche, Marko
    Sikora, Thomas
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (12) : 1802 - 1812
  • [24] Video retargeting through spatio-temporal seam carving using Kalman filter
    Kaur, Harpreet
    Kour, Swarnjeet
    Sen, Debashis
    IET IMAGE PROCESSING, 2019, 13 (11) : 1862 - 1871
  • [25] Panoramic video stitching of dual cameras based on spatio-temporal seam optimization
    Liu, Qiongxin
    Su, Xiangyang
    Zhang, Lei
    Huang, Hua
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (5-6) : 3107 - 3124
  • [26] High performance holographic video compression using spatio-temporal phase unwrapping
    Gonzalez, Sorayda Trejos
    Velez-Zea, Alejandro
    Barrera-Ramirez, John Fredy
    OPTICS AND LASERS IN ENGINEERING, 2024, 181
  • [27] Multi-Scale Spatio-Temporal Memory Network for Lightweight Video Denoising
    Sun, Lu
    Wu, Fangfang
    Ding, Wei
    Li, Xin
    Lin, Jie
    Dong, Weisheng
    Shi, Guangming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5810 - 5823
  • [28] End-to-End Learning of Video Compression Using Spatio-Temporal Autoencoders
    Pessoa, Jorge
    Aidos, Helena
    Tomas, Pedro
    Figueiredo, Mario A. T.
    2020 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS), 2020, : 276 - 281
  • [29] Heterogeneous Video Transcoding to Lower Spatio-Temporal Resolutions and Different Encoding Formats
    Shanableh, Tamer
    Ghanbari, Mohammed
    IEEE TRANSACTIONS ON MULTIMEDIA, 2000, 2 (02) : 101 - 110
  • [30] Motion-adaptive spatio-temporal regularization for accelerated dynamic MRI
    Asif, M. Salman
    Hamilton, Lei
    Brummer, Marijn
    Romberg, Justin
    MAGNETIC RESONANCE IN MEDICINE, 2013, 70 (03) : 800 - 812