Five-Dimensional Depth-Velocity Filtering for Enhancing Moving Objects in Light Field Videos

被引：42

作者：

Edussooriya, Chamira U. S. ^{[1
]}

Dansereau, Donald G. ^{[2
]}

Bruton, Len T. ^{[3
]}

Agathoklis, Panajotis ^{[1
]}

机构：

[1] Univ Victoria, Dept Elect & Comp Engn, Victoria, BC V8W 2Y2, Canada

[2] Queensland Univ Technol, ARC Ctr Excellence Robot Vis, Brisbane, Qld 4000, Australia

[3] Univ Calgary, Dept Elect & Comp Engn, Calgary, AB T2N 1N4, Canada

来源：

IEEE TRANSACTIONS ON SIGNAL PROCESSING | 2015年 / 63卷 / 08期

基金：

加拿大自然科学与工程研究理事会;

关键词：

Depth-velocity filters; multidimensional filtering; light field videos; plenoptic videos; plenoptic function; spectral analysis; linear-trajectory signals; IMAGE; BANK; TRACKING; DESIGN;

D O I：

10.1109/TSP.2015.2408559

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

Five-dimensional (5-D) light field video (LFV) (also known as plenoptic video) is a more powerful form of representing information of dynamic scenes compared to conventional three-dimensional (3-D) video. In this paper, the 5-D spectrum of an object in an LFV is derived for the important practical case of objects moving with constant velocity and at constant depth. In particular, it is shown that the region of support (ROS) of the 5-D spectrum is a skewed 3-D hyperfan in the 5-D frequency domain, with the degree of skew depending on the velocity and depth of the moving object. Based on this analysis, a 5-D depth-velocity digital filter to enhance moving objects in LFVs is proposed, described and implemented. Further, by means of the commercially available Lytro light-field camera, LFVs of real scenes are generated and used to test and confirm the performance of the 5-D depth-velocity filters for enhancing such objects.

引用

页码：2151 / 2163

页数：13

共 55 条

[11] EPIPOLAR-PLANE IMAGE-ANALYSIS - AN APPROACH TO DETERMINING STRUCTURE FROM MOTION [J].

BOLLES, RC ;

BAKER, HH ;

MARIMONT, DH .

INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (01) :7-55

[12]

Bruton L. T., 1995, P 29 AS C SIGN SYST, V2, P1006

[13] 3-DIMENSIONAL IMAGE-PROCESSING USING THE CONCEPT OF NETWORK RESONANCE [J].

BRUTON, LT ;

BARTLEY, NR .

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS, 1985, 32 (07) :664-672

[14] THE ENHANCEMENT AND TRACKING OF MOVING-OBJECTS IN DIGITAL IMAGES USING ADAPTIVE 3-DIMENSIONAL RECURSIVE FILTERS [J].

BRUTON, LT ;

BARTLEY, NR .

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS, 1986, 33 (06) :604-612

[15]

Chai JX, 2000, COMP GRAPH, P307, DOI 10.1145/344779.344932

[16] The plenoptic video [J].

Chan, SC ;

Ng, KT ;

Gan, ZF ;

Chan, KL ;

Shum, HY .

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2005, 15 (12) :1650-1659

[17] A spectral analysis for light field rendering [J].

Chan, SC ;

Shum, HY .

2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2000, :25-28

[18] Relative depth layer extraction for monoscopic video by use of multidimensional filter [J].

Chang, Jing-Ying ;

Cheng, Chao-Chung ;

Chien, Shao-Yi ;

Chen, Liang-Gee .

2006 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO - ICME 2006, VOLS 1-5, PROCEEDINGS, 2006, :221-+

[19]

Dansereau D, 2003, PROCEEDINGS OF THE 2003 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL IV, P476

[20] A 4-D dual-fan filter bank for depth filtering in light fields [J].

Dansereau, Don ;

Bruton, Len T. .

IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2007, 55 (02) :542-549

← 1 2 3 4 5 6 →