Real-Time Light Field Signal Processing Using 4D/5D Linear Digital Filter FPGA Circuits

被引:8
作者
Edussooriya, C. U. S. [1 ]
Wijenayake, C. [2 ]
Madanayake, A. [3 ]
Liyanage, N. [4 ]
Premaratne, S. [5 ]
Vorhies, J. T. [6 ]
Dansereau, D. G. [7 ]
Agathoklis, P. [5 ]
Bruton, L. T. [8 ]
机构
[1] Univ Moratuwa, Dept Elect & Telecommun Engn, Moratuwa 10400, Sri Lanka
[2] Univ Queensland, Sch Informat Technol & Elect Engn, St Lucia, Qld 4072, Australia
[3] Florida Int Univ, Dept Elect & Comp Engn, Miami, FL 33199 USA
[4] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
[5] Univ Victoria, Dept Elect & Comp Engn, Victoria, BC V8P 5C2, Canada
[6] Univ Akron, Dept Elect & Comp Engn, Akron, OH 44325 USA
[7] Univ Sydney, Sydney Inst Robot & Intelligent Syst, Camperdown, NSW 2006, Australia
[8] Univ Calgary, Dept Elect & Comp Engn, Calgary, AB T2N 1N4, Canada
关键词
Real-time systems; Finite impulse response filters; Light fields; Field programmable gate arrays; Videos; Manganese; Signal processing algorithms; light field videos; multi-dimensional filters; real-time processing; FPGA; MOVING-OBJECTS; DEPTH; DESIGN; ENHANCEMENT; IMAGES; BANK;
D O I
10.1109/TCSII.2021.3057388
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Light fields (LFs) and light field videos (LFVs) capture both angular and spatial variation of light rays emanating from scenes. This richness of information leads to novel applications such as post-capture refocusing, depth estimation and depth-velocity filtering which are not possible with images and videos. These capabilities come, however, with a significant increase in data to be processed. In order to fully exploit opportunities provided by LFs and LFVs, low-complexity signal processing algorithms that process LF and LFV data in real-time are required. In this brief, we survey such state-of-the-art algorithms, in particular for depth filtering, refocusing and denoising of LFs and depth-velcoty filtering for LFVs, and future directions for these real-time LF an LFV processing algorithms.
引用
收藏
页码:2735 / 2741
页数:7
相关论文
共 77 条
  • [1] Adelson E. H., 1991, PLENOPTIC FUNCTION E, V2
  • [2] SINGLE LENS STEREO WITH A PLENOPTIC CAMERA
    ADELSON, EH
    WANG, JYA
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) : 99 - 106
  • [3] PRACTICAL-BIBO STABILITY OF N-DIMENSIONAL DISCRETE-SYSTEMS
    AGATHOKLIS, P
    BRUTON, LT
    [J]. IEE PROCEEDINGS-G CIRCUITS DEVICES AND SYSTEMS, 1983, 130 (06): : 236 - 242
  • [4] Allain P, 2019, INT CONF ACOUST SPEE, P1692, DOI 10.1109/ICASSP.2019.8682709
  • [5] Alrabeiah M., 2020, P IEEE 91 VEH TECHN, P1, DOI [DOI 10.1109/VTC2020-SPRING48590.2020.9128579, 10.1109/VTC2020-Spring48590.2020.9128579]
  • [6] [Anonymous], 2008, THESIS U CALGARY CAL
  • [7] [Anonymous], 2017, P IEEE INT S CIRC SY
  • [8] [Anonymous], 2017, MMSP IEEE
  • [9] [Anonymous], 2018, P INT C DIG SIGN PRO
  • [10] Bajpayee A, 2018, IEEE INT C INT ROBOT, P4218, DOI 10.1109/IROS.2018.8594477