3D positioning and autofocus of the particle field based on the depth-from-defocus method and the deep networks

被引:2
作者
Zhang, Xiaolei [1 ]
Dong, Zhao [1 ,2 ]
Wang, Huaying [1 ,2 ]
Sha, Xiaohui [3 ]
Wang, Wenjian [4 ]
Su, Xinyu [1 ]
Hu, Zhengsheng [1 ]
Yang, Shaokai [5 ]
机构
[1] Hebei Univ Engn, Sch Math & Phys, Handan 056038, Hebei, Peoples R China
[2] Hebei Univ Engn, Hebei Computat Opt Imaging & Photoelect Detect Tec, Handan 056038, Hebei, Peoples R China
[3] Hebei Univ Engn, Inst Sci & Technol Res, Handan 056038, Hebei, Peoples R China
[4] Xidian Univ, Sch Phys, Xian 710000, Shaanxi, Peoples R China
[5] Univ Alberta, Dept Phys, Edmonton, AB T6G ZE9, Canada
来源
MACHINE LEARNING-SCIENCE AND TECHNOLOGY | 2023年 / 4卷 / 02期
基金
中国国家自然科学基金;
关键词
particle field; deep learning; 3D reconstruction; depth from defocus; autofocus;
D O I
10.1088/2632-2153/acdb2e
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate three-dimensional positioning of particles is a critical task in microscopic particle research, with one of the main challenges being the measurement of particle depths. In this paper, we propose a method for detecting particle depths from their blurred images using the depth-from-defocus technique and a deep neural network-based object detection framework called you-only-look-once. Our method provides simultaneous lateral position information for the particles and has been tested and evaluated on various samples, including synthetic particles, polystyrene particles, blood cells, and plankton, even in a noise-filled environment. We achieved autofocus for target particles in different depths using generative adversarial networks, obtaining clear-focused images. Our algorithm can process a single multi-target image in 0.008 s, allowing real-time application. Our proposed method provides new opportunities for particle field research.
引用
收藏
页数:13
相关论文
共 37 条
  • [1] Akpinar U, 2019, IEEE IMAGE PROC, P4315, DOI [10.1109/ICIP.2019.8803419, 10.1109/icip.2019.8803419]
  • [2] Defocus particle tracking: a comparison of methods based on model functions, cross-correlation, and neural networks
    Barnkob, Rune
    Cierpka, Christian
    Chen, Minqian
    Sachs, Sebastian
    Maeder, Patrick
    Rossi, Massimiliano
    [J]. MEASUREMENT SCIENCE AND TECHNOLOGY, 2021, 32 (09)
  • [3] Holographic 3D Particle Imaging With Model-Based Deep Network
    Chen, Ni
    Wang, Congli
    Heidrich, Wolfgang
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2021, 7 (07) : 288 - 296
  • [4] Particle imaging techniques for volumetric three-component (3D3C) velocity measurements in microfluidics
    Cierpka, C.
    Kaehler, C. J.
    [J]. JOURNAL OF VISUALIZATION, 2012, 15 (01) : 1 - 31
  • [5] Precise calibration of binocular vision system used for vision measurement
    Cui, Yi
    Zhou, Fuqiang
    Wang, Yexin
    Liu, Liu
    Gao, He
    [J]. OPTICS EXPRESS, 2014, 22 (08): : 9134 - 9149
  • [6] An improved computation method for asphalt pavement texture depth based on multiocular vision 3D reconstruction technology
    Dan, Han-Cheng
    Bai, Ge-Wen
    Zhu, Zhi-Heng
    Liu, Xiang
    Cao, Wei
    [J]. CONSTRUCTION AND BUILDING MATERIALS, 2022, 321
  • [7] Particle detection by means of neural networks and synthetic training data refinement in defocusing particle tracking velocimetry
    Dreisbach, Maximilian
    Leister, Robin
    Probst, Matthias
    Friederich, Pascal
    Stroh, Alexander
    Kriegseis, Jochen
    [J]. MEASUREMENT SCIENCE AND TECHNOLOGY, 2022, 33 (12)
  • [8] Cut, overlap and locate: a deep learning approach for the 3D localization of particles in astigmatic optical setups
    Franchini, Simon
    Krevor, Samuel
    [J]. EXPERIMENTS IN FLUIDS, 2020, 61 (06)
  • [9] Image Analysis for In-line Measurement of Multidimensional Size, Shape, and Polymorphic Transformation of L-Glutamic Acid Using Deep Learning-Based Image Segmentation and Classification
    Gao, Zhenguo
    Wu, Yuanyi
    Bao, Ying
    Gong, Junbo
    Wang, Jingkang
    Rohani, Sohrab
    [J]. CRYSTAL GROWTH & DESIGN, 2018, 18 (08) : 4275 - 4281
  • [10] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976