20, 000-fps Visual Motion Magnification on Pixel-parallel Vision Chip

被引:0
作者
He, Junxian [1 ]
Zhou, Xichuan [1 ]
Lin, Yingcheng [1 ]
Sun, Chonglei [1 ]
Shi, Cong [1 ]
Wu, Nanjian [2 ]
Luo, Gang [3 ]
机构
[1] Chongqing Univ, Sch Microelect & Commun Engn, Chongqing 400044, Peoples R China
[2] Chinese Acad Sci, Inst Semicond, Beijing 100083, Peoples R China
[3] Harvard Med Sch, Schepens Eye Res Inst, Massachusetts Eye & Ear, Boston, MA 02114 USA
来源
2019 IEEE 13TH INTERNATIONAL CONFERENCE ON ASIC (ASICON) | 2019年
基金
中国国家自然科学基金;
关键词
motion magnification; pixel-parallel array processor; vision chip; in-sensor computing; near-sensor computing;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a pixel-parallel Eulerian Video Magnification (EVM) algorithm for vision chips. The proposed algorithm is optimized for the stereotyped programmable pixel-parallel array processor architecture favored by high-speed vision chips. We also propose an improved pixel-parallel array processor with alternative image border padding modes to satisfy various algorithm requirements. We implemented an FPGA prototype of an improved 128 x 128 pixel-parallel array processor to run the proposed optimized EVM algorithm with a 120 MHz clock. Experimental results show that our pixel-parallel system can magnify subtle motion clues at a very high speed up to 20, 000 frames per second (fps).
引用
收藏
页数:4
相关论文
共 9 条
  • [1] [Anonymous], 2017, DIGITAL IMAGE PROCES
  • [2] Computationally Efficient Face Spoofing Detection with Motion Magnification
    Bharadwaj, Samarth
    Dhamecha, Tejas I.
    Vatsa, Mayank
    Singh, Richa
    [J]. 2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2013, : 105 - 110
  • [3] Motion magnification
    Liu, C
    Torralba, A
    Freeman, WT
    Durand, F
    Adelson, EH
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03): : 519 - 526
  • [4] Lopich A., 2011, IEEE T CIRCUITS-I, V58, P13
  • [5] Motion Magnification for Endoscopic Surgery
    McLeod, A. Jonathan
    Baxter, John S. H.
    de Ribaupierre, Sandrine
    Peters, Terry M.
    [J]. MEDICAL IMAGING 2014: IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, 2014, 9036
  • [6] Ngo L., 2018, IEEE INT C AUT FAC G
  • [7] A Streaming Motion Magnification Core for Smart Image Sensors
    Shi, Cong
    Luo, Gang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2018, 65 (09) : 1229 - 1233
  • [8] A 1000 fps Vision Chip Based on a Dynamically Reconfigurable Hybrid Architecture Comprising a PE Array Processor and Self-Organizing Map Neural Network
    Shi, Cong
    Yang, Jie
    Han, Ye
    Cao, Zhongxiang
    Qin, Qi
    Liu, Liyuan
    Wu, Nan-Jian
    Wang, Zhihua
    [J]. IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2014, 49 (09) : 2067 - 2082
  • [9] Eulerian Video Magnification for Revealing Subtle Changes in the World
    Wu, Hao-Yu
    Rubinstein, Michael
    Shih, Eugene
    Guttag, John
    Durand, Fredo
    Freeman, William
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04):