Pixel-wise structural motion tracking from rectified repurposed videos

被引:37
作者
Khaloo, Ali [1 ]
Lattanzi, David [1 ]
机构
[1] George Mason Univ, Dept Civil Environm & Infrastruct Engn, Fairfax, VA 22030 USA
基金
美国国家科学基金会;
关键词
computer vision; forensics; motion analysis; optical flow; structural dynamics; video analysis; VISION; SYSTEM;
D O I
10.1002/stc.2009
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
After any disaster, there is an immediate need to assess the integrity of local structures. When available, the displacement time history of a structure during the event can provide an invaluable source of triage assessment information. Although conventional sensors such as accelerometers readily provide this information, many structures are not instrumented and in these cases an alternative is needed. This paper presents such an alternative: a flexible, low-cost, and target-free approach to extracting motion time histories from video recordings of structures during an event. The approach is designed for scenarios where video recordings have inadvertently captured a dynamic event, with the goal of repurposing them for structural triage assessment through a combination of computer vision and signal processing techniques. A combination of parametric video stabilization, 3D denoising, and outlier robust camera motion estimation are employed to mitigate of the effects of camera motion and video encoding artifacts. The approach leverages the computer vision concept of optical flow to provide motion estimates, and 4 canonical optical flow algorithms are assessed as part of this study. The developed approach was validated on the records of the Network for Earthquake Simulation database. The overall findings indicate that the developed method is effective at reconstructing dynamic structural time histories, though the choice of optical flow algorithm plays a significant role in the overall performance. In particular, any employed optical flow algorithm must not overpenalize the high motion gradients that occur at the boundary of in-motion buildings and the image background.
引用
收藏
页数:15
相关论文
共 49 条
[1]   Real-time video stabilization without phantom movements for micro aerial vehicles [J].
Aguilar, Wilbert G. ;
Angulo, Cecilio .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2014,
[2]   Effects of texture addition on optical flow performance in images with poor texture [J].
Andalibi, Mehran ;
Hoberock, Lawrence L. ;
Mohamadipanah, Hossein .
IMAGE AND VISION COMPUTING, 2015, 40 :1-15
[3]  
[Anonymous], 13 WORLD C EARTHQ EN
[4]  
[Anonymous], 1981, P 7 INT JOINT C ARTI
[5]   A Database and Evaluation Methodology for Optical Flow [J].
Baker, Simon ;
Scharstein, Daniel ;
Lewis, J. P. ;
Roth, Stefan ;
Black, Michael J. ;
Szeliski, Richard .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 92 (01) :1-31
[6]   PERFORMANCE OF OPTICAL-FLOW TECHNIQUES [J].
BARRON, JL ;
FLEET, DJ ;
BEAUCHEMIN, SS .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1994, 12 (01) :43-77
[7]   Target-less computer vision for traffic signal structure vibration studies [J].
Bartilson, Daniel T. ;
Wieghaus, Kyle T. ;
Hurlebaus, Stefan .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2015, 60-61 :571-582
[8]   SURF: Speeded up robust features [J].
Bay, Herbert ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2006 , PT 1, PROCEEDINGS, 2006, 3951 :404-417
[9]  
Black M., BLACK SOFTWARE
[10]   The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields [J].
Black, MJ ;
Anandan, P .
COMPUTER VISION AND IMAGE UNDERSTANDING, 1996, 63 (01) :75-104