Automatic microscopic image analysis by moving window local Fourier Transform and Machine Learning

被引:23
作者
Jany, Benedykt R. [1 ]
Janas, Arkadiusz [1 ]
Krok, Franciszek [1 ]
机构
[1] Jagiellonian Univ, Marian Smoluchowski Inst Phys, Lojasiewicza 11, PL-30348 Krakow, Poland
关键词
Microscopy; Image analysis; Machine Learning; PCA; NMF; SOURCE SEPARATION;
D O I
10.1016/j.micron.2019.102800
中图分类号
TH742 [显微镜];
学科分类号
摘要
Analysis of microscope images is a tedious work which requires patience and time, usually done manually by the microscopist after data collection. The results obtained in such a way might be biased by the human who performed the analysis. Here we introduce an approach of automatic image analysis, which is based on locally applied Fourier Transform and Machine Learning methods. In this approach, a whole image is scanned by a local moving window with defined size and the 2D Fourier Transform is calculated for each window. Then, all the Local Fourier Transforms are fed into Machine Learning processing. Firstly, a number of components in the data is estimated from Principal Component Analysis (PCA) Scree Plot performed on the data. Secondly, the data are decomposed blindly by Non-Negative Matrix Factorization (NMF) into interpretable spatial maps (loadings) and corresponding Fourier Transforms (factors). As a result, the microscopic image is analyzed and the features on the image are automatically discovered, based on the local changes in Fourier Transform, without human bias. The user selects only a size and movement of the scanning local window which defines the final analysis resolution. This automatic approach was successfully applied to analysis of various microscopic images with and without local periodicity i.e. atomically resolved High Angle Annular Dark Field (HAADF) Scanning Transmission Electron Microscopy (STEM) image of Au nanoisland of fcc and Au hcp phases, Scanning Tunneling Microscopy (STM) image of Au-induced reconstruction on Ge(001) surface, Scanning Electron Microscopy (SEM) image of metallic nanoclusters grown on GaSb surface, and Fluorescence microscopy image of HeLa cell line of cervical cancer. The proposed approach could be used to automatically analyze the local structure of microscopic images within a time of about a minute for a single image on a modern desktop/notebook computer and it is freely available as a Python analysis notebook and Python program for batch processing.
引用
收藏
页数:8
相关论文
共 27 条
  • [1] HRTEMFringeAnalyzer a free python']python module for an automated analysis of fringe pattern in transmission electron micrographs
    Alxneit, Ivo
    [J]. JOURNAL OF MICROSCOPY, 2018, 271 (01) : 62 - 68
  • [2] [Anonymous], ARXIV190710121
  • [3] Identification of phases, symmetries and defects through local crystallography
    Belianinov, Alex
    He, Qian
    Kravchenko, Mikhail
    Jesse, Stephen
    Borisevich, Albina
    Kalinin, Sergei V.
    [J]. NATURE COMMUNICATIONS, 2015, 6
  • [4] Extended Red Emission and the evolution of carbonaceous nanograins in NGC 7023
    Berne, O.
    Joblin, C.
    Rapacioli, M.
    Thomas, J.
    Cuillandre, J. -C.
    Deville, Y.
    [J]. ASTRONOMY & ASTROPHYSICS, 2008, 479 (03) : L41 - L44
  • [5] Atomically controlled quantum chains hosting a Tomonaga-Luttinger liquid
    Blumenstein, C.
    Schaefer, J.
    Mietke, S.
    Meyer, S.
    Dollinger, A.
    Lochner, M.
    Cui, X. Y.
    Patthey, L.
    Matzdorf, R.
    Claessen, R.
    [J]. NATURE PHYSICS, 2011, 7 (10) : 776 - 780
  • [6] StatSTEM: An efficient approach for accurate and precise model-based quantification of atomic resolution electron microscopy images
    De Backer, A.
    van den Bos, K. H. W.
    Van den Broek, W.
    Sijbers, J.
    Van Aert, S.
    [J]. ULTRAMICROSCOPY, 2016, 171 : 104 - 116
  • [7] Scanning precession electron tomography for three-dimensional nanoscale orientation imaging and crystallographic analysis
    Eggeman, Alexander S.
    Krakow, Robert
    Midgley, Paul A.
    [J]. NATURE COMMUNICATIONS, 2015, 6
  • [8] Recent Advances in Transmission Electron Microscopy for Materials Science at the EMAT Lab of the University of Antwerp
    Guzzinati, Giulio
    Altantzis, Thomas
    Batuk, Maria
    De Backer, Annick
    Lumbeeck, Gunnar
    Samaee, Vahid
    Batuk, Dmitry
    Idrissi, Hosni
    Hadermann, Joke
    Van Aert, Sandra
    Schryvers, Dominique
    Verbeeck, Johan
    Bals, Sara
    [J]. MATERIALS, 2018, 11 (08)
  • [9] Quantitative measurement of displacement and strain fields from HREM micrographs
    Hytch, MJ
    Snoeck, E
    Kilaas, R
    [J]. ULTRAMICROSCOPY, 1998, 74 (03) : 131 - 146
  • [10] Retrieving the Quantitative Chemical Information at Nanoscale from Scanning Electron Microscope Energy Dispersive X-ray Measurements by Machine Learning
    Jany, B. R.
    Janas, A.
    Krok, F.
    [J]. NANO LETTERS, 2017, 17 (11) : 6520 - 6525