Motion characterization using optical flow and fractal complexity

被引:22
作者
Borneman, Joshua D. [1 ]
Malaia, Evie [4 ,5 ]
Wilbur, Ronnie B. [2 ,3 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
[2] Purdue Univ, Linguist, W Lafayette, IN 47907 USA
[3] Purdue Univ, Speech Language & Hearing Sci, W Lafayette, IN 47907 USA
[4] Freiburg Inst Adv Studies, Freiburg, Germany
[5] Univ Alabama, Dept Communicat Disorders, Tuscaloosa, AL USA
关键词
optical flow; fractal complexity; communication; information transfer; sign language; biological motion; SIGN-LANGUAGE; INFORMATION-TRANSFER; EVENT SEGMENTATION; BIOLOGICAL MOTION;
D O I
10.1117/1.JEI.27.5.051229
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We developed a technique, using fractal complexity analysis of optical flow in two-dimensional (2-D) videos, to characterize information content in observed motion. Several lines of evidence demonstrate that visually available properties of motion can characterize the state of a system. This paper will describe the method used and will present a test case regarding the accuracy of the method. An analytical comparison of simple human movement (arranging items on a table) and American Sign Language (ASL) will be given as an example application. The normalized spectral density in the range of 0.1 to 15 Hz indicated significantly higher fractal complexity in the optical flow of ASL video data, indicating that information content in 2-D video data can be characterized using complexity analysis of optical flow. The technique used for quantification of information content in visual motion data is likely to be applicable for distinguishing biological versus nonbiological motion in 2-D video data, making inferences about the states of biological objects from the dynamics of optical flow, and in assessing likelihood of information content in a video stream. (C) 2018 SPIE and IS&T
引用
收藏
页数:6
相关论文
共 36 条
[1]  
[Anonymous], 1977, Fractals, Form, Chance, and Dimension
[2]  
[Anonymous], COMPUTER VISION CONC
[3]  
[Anonymous], IS T SPIE S EL IM IM
[4]  
Barbu A, 2014, LECT NOTES COMPUT SC, V8693, P612, DOI 10.1007/978-3-319-10602-1_40
[5]  
Chaudhry Rizwan., 2009, IEEE C COMPUTER VISI
[6]   Seeing sentence boundaries [J].
Fenlon, Jordan ;
Denmark, Tanya ;
Campbell, Ruth ;
Woll, Bencie .
SIGN LANGUAGE & LINGUISTICS, 2007, 10 (02) :177-200
[7]   Automated derivation of primitives for movement classification [J].
Fod, A ;
Mataric, MJ ;
Jenkins, OC .
AUTONOMOUS ROBOTS, 2002, 12 (01) :39-54
[8]  
Hochuli A.G., 2007, ADV IMAGE VIDEO TECH, V4872
[9]   DETERMINING OPTICAL-FLOW [J].
HORN, BKP ;
SCHUNCK, BG .
ARTIFICIAL INTELLIGENCE, 1981, 17 (1-3) :185-203
[10]   DISCRETE SIMULATION OF COLORED NOISE AND STOCHASTIC-PROCESSES AND 1/F(ALPHA) POWER-LAW NOISE GENERATION [J].
KASDIN, NJ .
PROCEEDINGS OF THE IEEE, 1995, 83 (05) :802-827