Deep-Learning-Based Automated Morphology Analysis With Atomic Force Microscopy

被引:3
作者
Chang, Yingao [1 ]
Liu, Zhiang [1 ]
Wu, Yinan [1 ]
Fang, Yongchun [1 ]
机构
[1] Nankai Univ, Inst Robot & Automat Informat Syst, Coll Artificial Intelligence, Tianjin Key Lab Intelligent Robot, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
Atomic force microscopy; morphology analysis; image segmentation; deep learning; U-shaped structure; SEGMENTATION; NANOBUBBLE; IMAGES;
D O I
10.1109/TASE.2023.3346887
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Morphology analysis based on atomic force microscopy (AFM) imaging contributes to understanding the characteristics of specimens more deeply. The preliminary and crucial step of implementing morphology analysis is to precisely segment the target area from the complex background. In this study, an automated AFM image segmentation strategy based on a well-designed U-shaped neural network is proposed to achieve accurate and robust segmentation for AFM images of different samples, thus realizing morphology analysis in micro-nano scale. Specifically, the centralized information interaction strategy cooperated with a two-path attention module is introduced to realize efficient cross-scale information interaction, which can fundamentally avoid the negative effects induced by spatial interpolation. Besides, the global information flows are adopted to guide the global information extracted by atrous spatial pyramid pooling to each level of the top-down pathway, which ensures that the high-level semantic information is not diluted during the top-down transmission process, thus locating the target area more precisely. Moreover, an AFM image dataset is constructed to train the network, which will be available online for free to facilitate other data-based AFM research. The segmentation results demonstrate that the proposed strategy has better performance on multiple AFM images compared with traditional Otsu method, fully convolutional network and U-Net. The application of the proposed method is carried out to exhibit the effectiveness in automated morphology analysis. Note to Practitioners-Despite the growing demand of AFM-based morphology analysis in many fields, the automated analysis is still lacking limited by accuracy and robustness of AFM image segmentation. Since manual segmentation, sometimes tedious and time-consuming, heavily depends on the personal judgment, it is thus necessary to develop automated segmentation methods. Although traditional automated segmentation algorithms have good performance on certain types of images, they may be difficult to apply in different scenarios, especially for micro-nano images, due to the limited robustness. Therefore, this paper proposes an automated image segmentation algorithm based on an improved U-shaped neural network to achieve accurate morphology analysis for AFM images. The proposed automated morphology analysis workflow will be a practical tool to help reduce human workload and subjective errors, as well as enhancing the accuracy and robustness of the analysis process. In addition, the constructed AFM image dataset can greatly facilitate the research on data-based AFM image analysis of other practitioners. Moreover, practitioners can benefit from our algorithm to improve the accuracy and robustness of image segmentation in other practical applications.
引用
收藏
页码:7662 / 7673
页数:12
相关论文
共 57 条
[1]  
Adams JD, 2016, NAT NANOTECHNOL, V11, P147, DOI [10.1038/NNANO.2015.254, 10.1038/nnano.2015.254]
[2]   Automated structure discovery in atomic force microscopy [J].
Alldritt, Benjamin ;
Hapala, Prokop ;
Oinonena, Niko ;
Urtev, Fedor ;
Krejci, Ondrej ;
Canova, Filippo Federici ;
Kannala, Juho ;
Schulz, Fabian ;
Liljeroth, Peter ;
Foster, Adam S. .
SCIENCE ADVANCES, 2020, 6 (09)
[3]   Nanowire Detection in AFM Images Using Deep Learning [J].
Bai, Huitian ;
Wu, Sen .
MICROSCOPY AND MICROANALYSIS, 2021, 27 (01) :54-64
[4]   Automated analysis of the architecture of receptors, imaged by atomic force microscopy [J].
Barrera, Nelson P. ;
Ge, Haifang ;
Henderson, Robert M. ;
Fitzgerald, William J. ;
Edwardson, J. Michael .
MICRON, 2008, 39 (02) :101-110
[5]   Combining Spiral Scanning and Internal Model Control for Sequential AFM Imaging at Video Rate [J].
Bazaei, Ali ;
Yong, Yuen Kuan ;
Moheimani, S. O. Reza .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2017, 22 (01) :371-380
[6]   Big data and deep data in scanning and electron microscopies: deriving functionality from multidimensional data sets [J].
Belianinov, Alex ;
Vasudevan, Rama ;
Strelcov, Evgheni ;
Steed, Chad ;
Yang, Sang Mo ;
Tselev, Alexander ;
Jesse, Stephen ;
Biegalski, Michael ;
Shipman, Galen ;
Symons, Christopher ;
Borisevich, Albina ;
Archibald, Rick ;
Kalinin, Sergei .
ADVANCED STRUCTURAL AND CHEMICAL IMAGING, 2015, 1
[7]   Machine learning-based multidomain processing for texture-based image segmentation and analysis [J].
Borodinov, Nikolay ;
Tsai, Wan-Yu ;
Korolkov, Vladimir V. ;
Balke, Nina ;
Kalinin, Sergei V. ;
Ovchinnikova, Olga S. .
APPLIED PHYSICS LETTERS, 2020, 116 (04)
[8]   The Influence of Uncertainty Contributions on Deep Learning Architectures in Vision-Based Evaluation Systems [J].
Callari, Giuseppina ;
Mencattini, Arianna ;
Casti, Paola ;
Comes, Maria Colomba ;
Di Giuseppe, Davide ;
Di Natale, Corrado ;
Sammarco, Innocenzo ;
Pietroiusti, Antonio ;
Magrini, Andrea ;
Lesci, Isidoro Giorgio ;
Luce, Marco ;
Cricenti, Antonio ;
Martinelli, Eugenio .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2019, 68 (07) :2425-2432
[9]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[10]  
Chen LB, 2017, IEEE INT SYMP NANO, P1, DOI 10.1109/NANOARCH.2017.8053709