Rethinking low-cost microscopy workflow: Image enhancement using deep based Extended Depth of Field methods

被引:3
作者
Albuquerque, Tome [1 ,2 ]
Rosado, Luis [3 ]
Cruz, Ricardo [1 ,2 ]
Vasconcelos, Maria Joao M. [3 ]
Oliveira, Tiago [4 ]
Cardoso, Jaime S. [1 ,2 ]
机构
[1] INESC TEC, Rua Dr Roberto Frias, P-4200465 Porto, Portugal
[2] FEUP, Rua Dr Roberto Frias, P-4200465 Porto, Portugal
[3] Fraunhofer Portugal AICOS, Rua Alfredo Allen 455-461, P-4200135 Porto, Portugal
[4] First Solut Sistemas Informacao SA, Rua Conselheiro Costa Braga 502, P-4450102 Matosinhos, Portugal
来源
INTELLIGENT SYSTEMS WITH APPLICATIONS | 2023年 / 17卷
关键词
Extended Depth of Field; CNN; Microscopy workflow; Mobile health; Cervical cytology; FUSION; SEGMENTATION; REGISTRATION;
D O I
10.1016/j.iswa.2022.200170
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Microscopic techniques in low-to-middle income countries are constrained by the lack of adequate equipment and trained operators. Since light microscopy delivers crucial methods for the diagnosis and screening of numerous diseases, several efforts have been made by the scientific community to develop low-cost devices such as 3D- printed portable microscopes. Nevertheless, these devices present some drawbacks that directly affect image quality: the capture of the samples is done via mobile phones; more affordable lenses are usually used, leading to poorer physical properties and images with lower depth of field; misalignments in the microscopic set-up regarding optical, mechanical, and illumination components are frequent, causing image distortions such as chromatic aberrations. This work investigates several pre-processing methods to tackle the presented issues and proposed a new workflow for low-cost microscopy. Additionally, two new deep learning models based on Convolutional Neural Networks are also proposed (EDoF-CNN-Fast and EDoF-CNN-Pairwise) to generate Extended Depth of Field (EDoF) images, and compared against state-of-the-art approaches. The models were tested using two different datasets of cytology microscopic images: public Cervix93 and a new dataset that has been made publicly available containing images captured with mu SmartScope. Experimental results demonstrate that the proposed workflow can achieve state-of-the-art performance when generating EDoF images from lowcost microscopes.
引用
收藏
页数:12
相关论文
共 53 条
[1]  
Phoulady HA, 2018, Arxiv, DOI arXiv:1811.09651
[2]  
Amin-Naji M., 2018, J AI DATA MINING, V6, P233, DOI DOI 10.22044/JADM.2017.5169.1624
[3]   Fusion of multi-focus images using differential evolution algorithm [J].
Aslantas, V. ;
Kurban, R. .
EXPERT SYSTEMS WITH APPLICATIONS, 2010, 37 (12) :8861-8870
[4]   Quadtree-based multi-focus image fusion using a weighted focus-measure [J].
Bai, Xiangzhi ;
Zhang, Yu ;
Zhou, Fugen ;
Xue, Bindang .
INFORMATION FUSION, 2015, 22 :105-118
[5]   Graph-Cut RANSAC [J].
Barath, Daniel ;
Matas, Jiri .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6733-6741
[6]  
Blasch E., 2018, Multispectral image fusion and colorization, DOI [10.1117/3.2316455, DOI 10.1117/3.2316455]
[7]   Emulating human visual perception for measuring difference in images using an SPN graph approach [J].
Bourbakis, NG .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2002, 32 (02) :191-201
[8]  
Brandao P., 2021, Journal of Materials: Design and Applications
[9]  
Branson K., 2004, PRACTICAL REV UNIFOR
[10]   Mobile Phone Based Clinical Microscopy for Global Health Applications [J].
Breslauer, David N. ;
Maamari, Robi N. ;
Switz, Neil A. ;
Lam, Wilbur A. ;
Fletcher, Daniel A. .
PLOS ONE, 2009, 4 (07)