3D positioning and autofocus of the particle field based on the depth-from-defocus method and the deep networks

被引:2
作者
Zhang, Xiaolei [1 ]
Dong, Zhao [1 ,2 ]
Wang, Huaying [1 ,2 ]
Sha, Xiaohui [3 ]
Wang, Wenjian [4 ]
Su, Xinyu [1 ]
Hu, Zhengsheng [1 ]
Yang, Shaokai [5 ]
机构
[1] Hebei Univ Engn, Sch Math & Phys, Handan 056038, Hebei, Peoples R China
[2] Hebei Univ Engn, Hebei Computat Opt Imaging & Photoelect Detect Tec, Handan 056038, Hebei, Peoples R China
[3] Hebei Univ Engn, Inst Sci & Technol Res, Handan 056038, Hebei, Peoples R China
[4] Xidian Univ, Sch Phys, Xian 710000, Shaanxi, Peoples R China
[5] Univ Alberta, Dept Phys, Edmonton, AB T6G ZE9, Canada
来源
MACHINE LEARNING-SCIENCE AND TECHNOLOGY | 2023年 / 4卷 / 02期
基金
中国国家自然科学基金;
关键词
particle field; deep learning; 3D reconstruction; depth from defocus; autofocus;
D O I
10.1088/2632-2153/acdb2e
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate three-dimensional positioning of particles is a critical task in microscopic particle research, with one of the main challenges being the measurement of particle depths. In this paper, we propose a method for detecting particle depths from their blurred images using the depth-from-defocus technique and a deep neural network-based object detection framework called you-only-look-once. Our method provides simultaneous lateral position information for the particles and has been tested and evaluated on various samples, including synthetic particles, polystyrene particles, blood cells, and plankton, even in a noise-filled environment. We achieved autofocus for target particles in different depths using generative adversarial networks, obtaining clear-focused images. Our algorithm can process a single multi-target image in 0.008 s, allowing real-time application. Our proposed method provides new opportunities for particle field research.
引用
收藏
页数:13
相关论文
共 37 条
  • [11] Deep learning-based accurate and rapid tracking of 3D positional information of microparticles using digital holographic microscopy
    Lee, Sang Joon
    Yoon, Gun Young
    Go, Taesik
    [J]. EXPERIMENTS IN FLUIDS, 2019, 60 (11)
  • [12] Underwater Target Detection Algorithm Based on Improved YOLOv5
    Lei, Fei
    Tang, Feifei
    Li, Shuhan
    [J]. JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2022, 10 (03)
  • [13] Learning local depth regression from defocus blur by soft-assignment encoding
    Leroy, Remy
    Trouve-Peloux, Pauline
    Le Saux, Bertrand
    Buat, Benjamin
    Champagnat, Frederic
    [J]. APPLIED OPTICS, 2022, 61 (29) : 8843 - 8849
  • [14] Improved YOLOv3 Network for Insulator Detection in Aerial Images with Diverse Background Interference
    Liu, Chuanyang
    Wu, Yiquan
    Liu, Jingjing
    Sun, Zuo
    [J]. ELECTRONICS, 2021, 10 (07)
  • [15] Augmented Reality Maintenance Assistant Using YOLOv5
    Malta, Ana
    Mendes, Mateus
    Farinha, Torres
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (11):
  • [16] Nehme E, 2020, NAT METHODS, V17, P734, DOI 10.1038/s41592-020-0853-5
  • [17] A NEW SENSE FOR DEPTH OF FIELD
    PENTLAND, AP
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1987, 9 (04) : 523 - 531
  • [18] An improved YOLOv5 model based on visual attention mechanism: Application to recognition of tomato virus disease
    Qi, Jiangtao
    Liu, Xiangnan
    Liu, Kai
    Xu, Farong
    Guo, Hui
    Tian, Xinliang
    Li, Mao
    Bao, Zhiyuan
    Li, Yang
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 194
  • [19] A fast and robust algorithm for general defocusing particle tracking
    Rossi, Massimiliano
    Barnkob, Rune
    [J]. MEASUREMENT SCIENCE AND TECHNOLOGY, 2021, 32 (01)
  • [20] Synthetic image generator for defocusing and astigmatic PIV/PTV
    Rossi, Massimiliano
    [J]. MEASUREMENT SCIENCE AND TECHNOLOGY, 2020, 31 (01)