Real-Time Light Field Signal Processing Using 4D/5D Linear Digital Filter FPGA Circuits

被引:8
作者
Edussooriya, C. U. S. [1 ]
Wijenayake, C. [2 ]
Madanayake, A. [3 ]
Liyanage, N. [4 ]
Premaratne, S. [5 ]
Vorhies, J. T. [6 ]
Dansereau, D. G. [7 ]
Agathoklis, P. [5 ]
Bruton, L. T. [8 ]
机构
[1] Univ Moratuwa, Dept Elect & Telecommun Engn, Moratuwa 10400, Sri Lanka
[2] Univ Queensland, Sch Informat Technol & Elect Engn, St Lucia, Qld 4072, Australia
[3] Florida Int Univ, Dept Elect & Comp Engn, Miami, FL 33199 USA
[4] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
[5] Univ Victoria, Dept Elect & Comp Engn, Victoria, BC V8P 5C2, Canada
[6] Univ Akron, Dept Elect & Comp Engn, Akron, OH 44325 USA
[7] Univ Sydney, Sydney Inst Robot & Intelligent Syst, Camperdown, NSW 2006, Australia
[8] Univ Calgary, Dept Elect & Comp Engn, Calgary, AB T2N 1N4, Canada
关键词
Real-time systems; Finite impulse response filters; Light fields; Field programmable gate arrays; Videos; Manganese; Signal processing algorithms; light field videos; multi-dimensional filters; real-time processing; FPGA; MOVING-OBJECTS; DEPTH; DESIGN; ENHANCEMENT; IMAGES; BANK;
D O I
10.1109/TCSII.2021.3057388
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Light fields (LFs) and light field videos (LFVs) capture both angular and spatial variation of light rays emanating from scenes. This richness of information leads to novel applications such as post-capture refocusing, depth estimation and depth-velocity filtering which are not possible with images and videos. These capabilities come, however, with a significant increase in data to be processed. In order to fully exploit opportunities provided by LFs and LFVs, low-complexity signal processing algorithms that process LF and LFV data in real-time are required. In this brief, we survey such state-of-the-art algorithms, in particular for depth filtering, refocusing and denoising of LFs and depth-velcoty filtering for LFVs, and future directions for these real-time LF an LFV processing algorithms.
引用
收藏
页码:2735 / 2741
页数:7
相关论文
共 77 条
  • [51] Liu Y, 2018, IEEE IMAGE PROC, P3209, DOI 10.1109/ICIP.2018.8451105
  • [52] Liyanage Namalka, 2020, 2020 IEEE Region 10 Conference (TENCON), P538, DOI 10.1109/TENCON50793.2020.9293774
  • [53] Liyanage N., 2018, P IEEE INT S CIRC SY, P1
  • [54] Liyanage N., 2019, P IEEE INT S CIRC SY, P1
  • [55] Liyanage N, 2020, MERCON 2020: 6TH INTERNATIONAL MULTIDISCIPLINARY MORATUWA ENGINEERING RESEARCH CONFERENCE (MERCON), P230, DOI [10.1109/mercon50084.2020.9185284, 10.1109/MERCon50084.2020.9185284]
  • [56] Multi-depth filtering and occlusion suppression in 4-D light fields: Algorithms and architectures
    Liyanage, Namalka
    Wijenayake, Chamith
    Edussooriya, Chamira
    Madanayake, Arjuna
    Agathoklis, Pan
    Bruton, Len T.
    Ambikairajah, Eliathamby
    [J]. SIGNAL PROCESSING, 2020, 167
  • [57] Madanayake A., 2011, 2011 IEEE 54th international midwest symposium on circuits and systems (MWSCAS), P1
  • [58] VLSI architecture for 4-D depth filtering
    Madanayake, Arjuna
    Wimalagunarathne, Randeel
    Dansereau, Donald G.
    Cintra, Renato J.
    Bruton, Len T.
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2015, 9 (04) : 809 - 818
  • [59] Multidimensional (MD) Circuits and Systems for Emerging Applications Including Cognitive Radio, Radio Astronomy, Robot Vision and Imaging
    Madanayake, Arjuna
    Wijenayake, Chamith
    Dansereau, Donald G.
    Gunaratne, Thushara K.
    Bruton, Leonard T.
    Williams, Stefan B.
    [J]. IEEE CIRCUITS AND SYSTEMS MAGAZINE, 2013, 13 (01) : 10 - 43
  • [60] Video Denoising, Deblocking, and Enhancement Through Separable 4-D Nonlocal Spatiotemporal Transforms
    Maggioni, Matteo
    Boracchi, Giacomo
    Foi, Alessandro
    Egiazarian, Karen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (09) : 3952 - 3966