Workflow towards automated segmentation of agglomerated, non-spherical particles from electron microscopy images using artificial neural networks
Open Access
- 2 March 2021
- journal article
- research article
- Published by Springer Science and Business Media LLC in Scientific Reports
- Vol. 11 (1), 1-10
- https://doi.org/10.1038/s41598-021-84287-6
Abstract
We present a workflow for obtaining fully trained artificial neural networks that can perform automatic particle segmentations of agglomerated, non-spherical nanoparticles from scanning electron microscopy images “from scratch”, without the need for large training data sets of manually annotated images. The whole process only requires about 15 min of hands-on time by a user and can typically be finished within less than 12 h when training on a single graphics card (GPU). After training, SEM image analysis can be carried out by the artificial neural network within seconds. This is achieved by using unsupervised learning for most of the training dataset generation, making heavy use of generative adversarial networks and especially unpaired image-to-image translation via cycle-consistent adversarial networks. We compare the segmentation masks obtained with our suggested workflow qualitatively and quantitatively to state-of-the-art methods using various metrics. Finally, we used the segmentation masks for automatically extracting particle size distributions from the SEM images of TiO2 particles, which were in excellent agreement with particle size distributions obtained manually but could be obtained in a fraction of the time.Keywords
Funding Information
- Bundesanstalt für Materialforschung und -prüfung (BAM)
This publication has 22 references indexed in Scilit:
- How reliably can a material be classified as a nanomaterial? Available particle-sizing techniques at workJournal of Nanoparticle Research, 2016
- High-Throughput, Algorithmic Determination of Nanoparticle Structure from Electron Microscopy ImagesACS Nano, 2015
- U-Net: Convolutional Networks for Biomedical Image SegmentationPublished by Springer Science and Business Media LLC ,2015
- Crowdsourcing the creation of image segmentation algorithms for connectomicsFrontiers in Neuroanatomy, 2015
- Improving Computer-Aided Detection UsingConvolutional Neural Networks and Random View AggregationIEEE Transactions on Medical Imaging, 2015
- Performance of High-Resolution SEM/EDX Systems Equipped with Transmission Mode (TSEM) for Imaging and Measurement of Size and Size Distribution of Spherical NanoparticlesMicroscopy and Microanalysis, 2014
- Measurement uncertainties of size, shape, and surface measurements using transmission electron microscopy of near-monodisperse, near-spherical nanoparticlesJournal of Nanoparticle Research, 2013
- Minimum cross entropy thresholdingPattern Recognition, 1993
- An image synthesizerACM SIGGRAPH Computer Graphics, 1985
- A Threshold Selection Method from Gray-Level HistogramsIEEE Transactions on Systems, Man, and Cybernetics, 1979