Learning-based light field imaging: an overview

被引:2
|
作者
Mahmoudpour, Saeed [1 ,2 ]
Pagliari, Carla [3 ]
Schelkens, Peter [1 ,2 ]
机构
[1] Vrije Univ Brussel VUB, Dept Elect & Informat ETRO, Pleinlaan 2, B-1050 Brussels, Belgium
[2] Imec, Kapeldreef 75, B-3001 Leuven, Belgium
[3] Inst Mil Engn, PGEE, PGED, IME, Rio De Janeiro, Brazil
关键词
Light fields; Depth estimation; Image reconstruction; Compression; Machine learning; Deep learning; DEPTH ESTIMATION; QUALITY ASSESSMENT; PERCEPTUAL QUALITY; EPIPOLAR GEOMETRY; RECONSTRUCTION; SUPERRESOLUTION; NETWORK; IMAGES; COMPRESSION; RESOLUTION;
D O I
10.1186/s13640-024-00628-1
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Conventional photography can only provide a two-dimensional image of the scene, whereas emerging imaging modalities such as light field enable the representation of higher dimensional visual information by capturing light rays from different directions. Light fields provide immersive experiences, a sense of presence in the scene, and can enhance different vision tasks. Hence, research into light field processing methods has become increasingly popular. It does, however, come at the cost of higher data volume and computational complexity. With the growing deployment of machine-learning and deep architectures in image processing applications, a paradigm shift toward learning-based approaches has also been observed in the design of light field processing methods. Various learning-based approaches are developed to process the high volume of light field data efficiently for different vision tasks while improving performance. Taking into account the diversity of light field vision tasks and the deployed learning-based frameworks, it is necessary to survey the scattered learning-based works in the domain to gain insight into the current trends and challenges. This paper aims to review the existing learning-based solutions for light field imaging and to summarize the most promising frameworks. Moreover, evaluation methods and available light field datasets are highlighted. Lastly, the review concludes with a brief outlook for future research directions.
引用
收藏
页数:36
相关论文
共 50 条
  • [21] Measurement Technologies of Light Field Camera: An Overview
    Hu, Xiaoming
    Li, Zhuotong
    Miao, Li
    Fang, Fengzhou
    Jiang, Zhongjie
    Zhang, Xiaodong
    SENSORS, 2023, 23 (15)
  • [22] Deep Learning-based Volumetric Image Generation from Projection Imaging for Prostate Radiotherapy
    Dai, Xianjin
    Lei, Yang
    Tian, Zhen
    Wang, Tonghe
    Liu, Tian
    Curran, Walter J.
    Yang, Xiaofeng
    MEDICAL IMAGING 2021: IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, 2021, 11598
  • [23] Deep learning-based protocols to enhance infrared imaging systems
    Falahkheirkhah, Kianoush
    Yeh, Kevin
    Mittal, Shachi
    Pfister, Luke
    Bhargava, Rohit
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2021, 217
  • [24] Matching entropy based disparity estimation from light field data
    Shi, Ligen
    Liu, Chang
    He, Di
    Zhao, Xing
    Qiu, Jun
    OPTICS EXPRESS, 2023, 31 (04): : 6111 - 6131
  • [25] Deep Learning-Based Attribute Graph Clustering: An Overview
    Li, Jimei
    Zeng, Faqiang
    Cheng, Jieren
    Li, Yaoyu
    Feng, Xinran
    BIG DATA AND SECURITY, ICBDS 2023, PT I, 2024, 2099 : 211 - 224
  • [26] Efficient Near-Field Radiofrequency Imaging of Impact Damage on CFRP Materials with Learning-Based Compressed Sensing
    Song, Huadong
    Wang, Zijun
    Zeng, Yanli
    Guo, Xiaoting
    Tang, Chaoqing
    MATERIALS, 2022, 15 (17)
  • [27] An Overview of Machine Learning, Deep Learning, and Reinforcement Learning-Based Techniques in Quantitative Finance: Recent Progress and Challenges
    Sahu, Santosh Kumar
    Mokhade, Anil
    Bokde, Neeraj Dhanraj
    APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [28] A Deep Learning-Based Model That Reduces Speed of Sound Aberrations for Improved In Vivo Photoacoustic Imaging
    Jeon, Seungwan
    Choi, Wonseok
    Park, Byullee
    Kim, Chulhong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8773 - 8784
  • [29] Machine learning-based event recognition in SiFi Compton camera imaging for proton therapy monitoring
    Kazemi Kozani, Majid
    Magiera, Andrzej
    PHYSICS IN MEDICINE AND BIOLOGY, 2022, 67 (15):
  • [30] Overview of 4D Light Field Representation
    Li Yaning
    Wang Xue
    Zhou Guoqing
    Wang Qing
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (18)