Depth estimation from infrared video using local-feature-flow neural network

被引:0
|
作者
Shouchuan Wu
Haitao Zhao
Shaoyuan Sun
机构
[1] East China University of Science and Technology,Automation Department, School of Information Science and Engineering
[2] Donghua University,Automation Department
来源
International Journal of Machine Learning and Cybernetics | 2019年 / 10卷
关键词
Infrared video; Depth estimation; Neural network; Sequence learning;
D O I
暂无
中图分类号
学科分类号
摘要
Depth estimation is essential for infrared video processing. In this paper, a novel depth estimation method, called local-feature-flow neural network (LFFNN), is proposed for generating depth maps for each frame of an infrared video. LFFNN extracts local features of a frame with the addition of inter-frame features, which is extracted from the previous frames on the corresponding region in the infrared video. LFFNN is designed for extracting the local features flow in the infrared video, learning better depth-related features through three control gates by inter-frame features propagation as the video progresses. After feature extraction, a pixel-level classifier is created to estimate depth level of different pixels in the infrared video. Our proposed approach achieves state-of-the-art depth estimation performances on the test dataset.
引用
收藏
页码:2563 / 2572
页数:9
相关论文
共 50 条
  • [1] Depth estimation from infrared video using local-feature-flow neural network
    Wu, Shouchuan
    Zhao, Haitao
    Sun, Shaoyuan
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (09) : 2563 - 2572
  • [2] Depth Estimation from Tilted Optics Blur by Using Neural Network
    Ikeoka, Hiroshi
    Hamamoto, Takayuki
    2018 INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT), 2018,
  • [3] Defects depth estimation in a CFRP material by active infrared thermography using neural network
    Halloua, H.
    Elhassnaoui, A.
    Zrhaiba, A.
    Kraibaa, S.
    Obbadi, A.
    Errami, Y.
    Sahnoun, S.
    JOURNAL OF OPTOELECTRONICS AND ADVANCED MATERIALS, 2020, 22 (3-4): : 156 - 162
  • [4] Depth Estimation from Monocular Infrared Images Based on BP Neural Network Model
    Sun, Shaoyuan
    Li, Linna
    Xi, Lin
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTER VISION IN REMOTE SENSING, 2012, : 237 - 241
  • [5] Defect depth estimation in passive thermography using neural network paradigm
    Heriansyah, Rudi
    Abu-Bakar, S. A. R.
    PROCEEDINGS OF THE WSEAS INTERNATIONAL CONFERENCE ON CIRCUITS, SYSTEMS, ELECTRONICS, CONTROL & SIGNAL PROCESSING: SELECTED TOPICS ON CIRCUITS, SYSTEMS, ELECTRONICS, CONTROL & SIGNAL PROCESSING, 2007, : 421 - 425
  • [6] Object Depth Estimation from a Single Image using Fully Convolutional Neural Network
    Afifi, Ahmed J.
    Hellwich, Olaf
    2016 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2016, : 605 - 611
  • [7] Multiple Faces Tracking Using Feature Fusion and Neural Network in Video
    Hu, Boxia
    Zhao, Huihuang
    Yang, Yufei
    Zhou, Bo
    Raj, Alex Noel Joseph
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2020, 26 (06) : 1549 - 1560
  • [8] Zero-Shot Depth Estimation From Light Field Using A Convolutional Neural Network
    Peng, Jiayong
    Xiong, Zhiwei
    Wang, Yicheng
    Zhang, Yueyi
    Liu, Dong
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 682 - 696
  • [9] Depth estimation of features in video frames with improved feature matching technique using Kinect sensor
    Sharma, Kajal
    Moon, Inkyu
    Kim, Sung Gaun
    OPTICAL ENGINEERING, 2012, 51 (10)
  • [10] Estimation of Racket Grip Vibration from Tennis Video by Neural Network
    Yoshida, Kentaro
    Horiuchi, Yuuki
    Ichiyama, Tomohiro
    Inoue, Seki
    Makino, Yasutoshi
    Shinoda, Hiroyuki
    HAPTIC INTERACTION: PERCEPTION, DEVICES AND ALGORITHMS, 2019, 535 : 33 - 45