RETINA-INSPIRED SPATIO-TEMPORAL FILTERING FOR DYNAMIC VIDEO CODING

被引:0
|
作者
Doutsi, Effrosyni [1 ,2 ]
Antonini, Marc [1 ]
Tsakalides, Panagiotis [2 ]
机构
[1] Univ Cote dAzur, CNRS, I3S, Nice, France
[2] FORTH, Inst Comp Sci, Iraklion, Greece
来源
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2022年
关键词
Center-surround filter; dynamic transform; video compression; retina; neuro-inspired filtering; perception-based processing; IMAGE;
D O I
10.1109/ICIP46576.2022.9897355
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The goal of this work is to propose a simple yet efficient way to dynamically transform a sequence of images according to the functional properties of the visual system. To achieve this goal, we extend to video sequences the Retina-Inspired Filter (RIF), which we have recently proposed for still images. Under the assumption that the input signal remains constant for a given time, the RIF decomposition was proven to be invertible, meaning that the image could be perfectly recovered. In this paper, we relax this assumption into a piece-wise constant input and we prove that RIF can be applied to a Group Of Pictures (GOP). Under the condition that a GOP consists of frames without strong pixel motion, we mathematically prove and experimentally show that when RIF is applied to GOP, whatever the size of the GOP is, we are still able to perfectly recover the video frames and at the same time simplify the complexity of the whole process. In addition, we show that while the GOP size increases, the memory cost required to store this amount of frames is sufficiently reduced.
引用
收藏
页码:3321 / 3325
页数:5
相关论文
共 50 条
  • [1] SPATIO-TEMPORAL VIDEO FILTERING FOR VIDEO SURVEILLANCE APPLICATIONS
    Ben Hamida, Amal
    Koubaa, Mohamed
    Nicolas, Henri
    Ben Amar, Chokri
    ELECTRONIC PROCEEDINGS OF THE 2013 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2013,
  • [2] Video Quality Assessment for Spatio-Temporal Resolution Adaptive Coding
    Zhu, Hanwei
    Chen, Baoliang
    Zhu, Lingyu
    Chen, Peilin
    Song, Linqi
    Wang, Shiqi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 6403 - 6415
  • [3] A spatio-temporal pyramid matching for video retrieval
    Choi, Jaesik
    Wang, Ziyu
    Lee, Sang-Chul
    Jeon, Won J.
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2013, 117 (06) : 660 - 669
  • [4] CFA Video Denoising and Demosaicking Chain via Spatio-Temporal Patch-Based Filtering
    Buades, Antoni
    Duran, Joan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (11) : 4143 - 4157
  • [5] Fast Disparity Estimation Using Spatio-temporal Correlation of Disparity Field for Multiview Video Coding
    Zhu, Wei
    Tian, Xiang
    Zhou, Fan
    Chen, Yaowu
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2010, 56 (02) : 957 - 964
  • [6] A RETINA-INSPIRED ENCODER: AN INNOVATIVE STEP ON IMAGE CODING USING LEAKY INTEGRATE-AND-FIRE NEURONS
    Dimopoulou, Melpomeni
    Doutsi, Effrosyni
    Antonini, Marc
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 694 - 698
  • [7] Spatio-temporal constrained tone mapping operator for HDR video compression
    Ozcinar, Cagri
    Lauga, Paul
    Valenzise, Giuseppe
    Dufaux, Frederic
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 55 : 166 - 178
  • [8] Video Compression Based on Spatio-Temporal Resolution Adaptation
    Afonso, Mariana
    Zhang, Fan
    Bull, David R.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (01) : 275 - 280
  • [9] Video Watermarking Based on Spatio-temporal JND Profile
    Xu, Dawen
    Wang, Rangding
    Wang, Jicheng
    DIGITAL WATERMARKING, 2009, 5450 : 327 - +
  • [10] Fast spatio-temporal digital paths video filter
    Szczepanski, Marek
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2019, 16 (02) : 477 - 489