Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Partial Scanning Transmission Electron Microscopy with Deep Learning.

ABSTRACT: Compressed sensing algorithms are used to decrease electron microscope scan time and electron beam exposure with minimal information loss. Following successful applications of deep learning to compressed sensing, we have developed a two-stage multiscale generative adversarial neural network to complete realistic 512?×?512 scanning transmission electron micrographs from spiral, jittered gridlike, and other partial scans. For spiral scans and mean squared error based pre-training, this enables electron beam coverage to be decreased by 17.9× with a 3.8% test set root mean squared intensity error, and by 87.0× with a 6.2% error. Our generator networks are trained on partial scans created from a new dataset of 16227 scanning transmission electron micrographs. High performance is achieved with adaptive learning rate clipping of loss spikes and an auxiliary trainer network. Our source code, new dataset, and pre-trained models are publicly available.

SUBMITTER: Ede JM

PROVIDER: S-EPMC7239858 | biostudies-literature | 2020 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Partial Scanning Transmission Electron Microscopy with Deep Learning.

Ede Jeffrey M JM Beanland Richard R

Scientific reports 20200520 1

Compressed sensing algorithms are used to decrease electron microscope scan time and electron beam exposure with minimal information loss. Following successful applications of deep learning to compressed sensing, we have developed a two-stage multiscale generative adversarial neural network to complete realistic 512 × 512 scanning transmission electron micrographs from spiral, jittered gridlike, and other partial scans. For spiral scans and mean squared error based pre-training, this enables ele ...[more]

PMID: 32433582

Similar Datasets

Deep learning-based noise filtering toward millisecond order imaging by using scanning transmission electron microscopy.

Project description:Application of scanning transmission electron microscopy (STEM) to in situ observation will be essential in the current and emerging data-driven materials science by taking STEM's high affinity with various analytical options into account. As is well known, STEM's image acquisition time needs to be further shortened to capture a targeted phenomenon in real-time as STEM's current temporal resolution is far below the conventional TEM's. However, rapid image acquisition in the millisecond per frame or faster generally causes image distortion, poor electron signals, and unidirectional blurring, which are obstacles for realizing video-rate STEM observation. Here we show an image correction framework integrating deep learning (DL)-based denoising and image distortion correction schemes optimized for STEM rapid image acquisition. By comparing a series of distortion corrected rapid scan images with corresponding regular scan speed images, the trained DL network is shown to remove not only the statistical noise but also the unidirectional blurring. This result demonstrates that rapid as well as high-quality image acquisition by STEM without hardware modification can be established by the DL. The DL-based noise filter could be applied to in-situ observation, such as dislocation activities under external stimuli, with high spatio-temporal resolution.

| S-EPMC9356044 | biostudies-literature

In Situ Scanning Transmission Electron Microscopy Study of MoS<sub>2</sub> Formation on Graphene with a Deep-Learning Framework.

Project description:Atomic-scale information is essential for understanding and designing unique structures and properties of two-dimensional (2D) materials. Recent developments in in situ transmission electron microscopy (TEM) and scanning transmission electron microscopy (STEM) enable research to provide abundant insights into the growth of nanomaterials. In this study, 2D MoS2 is synthesized on a suspended graphene substrate inside a TEM column through thermolysis of the ammonium tetrathiomolybdate (NH4)2MoS4 precursor at 500 °C. To avoid misinterpretation of the in situ STEM images, a deep-learning framework, DeepSTEM, is developed. The DeepSTEM framework successfully reconstructs an object function in atomic-resolution STEM imaging for accurate determination of the atomic structure and dynamic analysis. In situ STEM imaging with DeepSTEM enables observation of the edge configuration, formation, and reknitting progress of MoS2 clusters with the formation of a mirror twin boundary. The synthesized MoS2/graphene heterostructure shows various twist angles, as revealed by atomic-resolution TEM. This deep-learning framework-assisted in situ STEM imaging provides atomic information for in-depth studies on the growth and structure of 2D materials and shows the potential use of deep-learning techniques in 2D material research.

| S-EPMC8388093 | biostudies-literature

Three-dimensional scanning transmission electron microscopy of biological specimens.

Project description:A three-dimensional (3D) reconstruction of the cytoskeleton and a clathrin-coated pit in mammalian cells has been achieved from a focal-series of images recorded in an aberration-corrected scanning transmission electron microscope (STEM). The specimen was a metallic replica of the biological structure comprising Pt nanoparticles 2-3 nm in diameter, with a high stability under electron beam radiation. The 3D dataset was processed by an automated deconvolution procedure. The lateral resolution was 1.1 nm, set by pixel size. Particles differing by only 10 nm in vertical position were identified as separate objects with greater than 20% dip in contrast between them. We refer to this value as the axial resolution of the deconvolution or reconstruction, the ability to recognize two objects, which were unresolved in the original dataset. The resolution of the reconstruction is comparable to that achieved by tilt-series transmission electron microscopy. However, the focal-series method does not require mechanical tilting and is therefore much faster. 3D STEM images were also recorded of the Golgi ribbon in conventional thin sections containing 3T3 cells with a comparable axial resolution in the deconvolved dataset.

| S-EPMC2917646 | biostudies-literature

Big Data Analytics for Scanning Transmission Electron Microscopy Ptychography.

Project description:Electron microscopy is undergoing a transition; from the model of producing only a few micrographs, through the current state where many images and spectra can be digitally recorded, to a new mode where very large volumes of data (movies, ptychographic and multi-dimensional series) can be rapidly obtained. Here, we discuss the application of so-called "big-data" methods to high dimensional microscopy data, using unsupervised multivariate statistical techniques, in order to explore salient image features in a specific example of BiFeO3 domains. Remarkably, k-means clustering reveals domain differentiation despite the fact that the algorithm is purely statistical in nature and does not require any prior information regarding the material, any coexisting phases, or any differentiating structures. While this is a somewhat trivial case, this example signifies the extraction of useful physical and structural information without any prior bias regarding the sample or the instrumental modality. Further interpretation of these types of results may still require human intervention. However, the open nature of this algorithm and its wide availability, enable broad collaborations and exploratory work necessary to enable efficient data analysis in electron microscopy.

| S-EPMC4876439 | biostudies-literature

Materials characterisation by angle-resolved scanning transmission electron microscopy.

Project description:Solid-state properties such as strain or chemical composition often leave characteristic fingerprints in the angular dependence of electron scattering. Scanning transmission electron microscopy (STEM) is dedicated to probe scattered intensity with atomic resolution, but it drastically lacks angular resolution. Here we report both a setup to exploit the explicit angular dependence of scattered intensity and applications of angle-resolved STEM to semiconductor nanostructures. Our method is applied to measure nitrogen content and specimen thickness in a GaNxAs1-x layer independently at atomic resolution by evaluating two dedicated angular intervals. We demonstrate contrast formation due to strain and composition in a Si- based metal-oxide semiconductor field effect transistor (MOSFET) with GexSi1-x stressors as a function of the angles used for imaging. To shed light on the validity of current theoretical approaches this data is compared with theory, namely the Rutherford approach and contemporary multislice simulations. Inconsistency is found for the Rutherford model in the whole angular range of 16-255?mrad. Contrary, the multislice simulations are applicable for angles larger than 35?mrad whereas a significant mismatch is observed at lower angles. This limitation of established simulations is discussed particularly on the basis of inelastic scattering.

| S-EPMC5111052 | biostudies-literature

Electron counting detectors in scanning transmission electron microscopy via hardware signal processing.

Project description:Transmission electron microscopy is a pivotal instrument in materials and biological sciences due to its ability to provide local structural and spectroscopic information on a wide range of materials. However, the electron detectors used in scanning transmission electron microscopy are often unable to provide quantified information, that is the number of electrons impacting the detector, without exhaustive calibration and processing. This results in arbitrary signal values with slow response times that cannot be used for quantification or comparison to simulations. Here we demonstrate and optimise a hardware signal processing approach to augment electron detectors to perform single electron counting.

| S-EPMC10457289 | biostudies-literature

Deep-Learning-Based Segmentation of Small Extracellular Vesicles in Transmission Electron Microscopy Images.

Project description:Small extracellular vesicles (sEVs) are cell-derived vesicles of nanoscale size (~30-200 nm) that function as conveyors of information between cells, reflecting the cell of their origin and its physiological condition in their content. Valuable information on the shape and even on the composition of individual sEVs can be recorded using transmission electron microscopy (TEM). Unfortunately, sample preparation for TEM image acquisition is a complex procedure, which often leads to noisy images and renders automatic quantification of sEVs an extremely difficult task. We present a completely deep-learning-based pipeline for the segmentation of sEVs in TEM images. Our method applies a residual convolutional neural network to obtain fine masks and use the Radon transform for splitting clustered sEVs. Using three manually annotated datasets that cover a natural variability typical for sEV studies, we show that the proposed method outperforms two different state-of-the-art approaches in terms of detection and segmentation performance. Furthermore, the diameter and roundness of the segmented vesicles are estimated with an error of less than 10%, which supports the high potential of our method in biological applications.

| S-EPMC6744556 | biostudies-literature

Amyloid structure and assembly: insights from scanning transmission electron microscopy.

Project description:Amyloid fibrils are filamentous protein aggregates implicated in several common diseases such as Alzheimer's disease and type II diabetes. Similar structures are also the molecular principle of the infectious spongiform encephalopathies such as Creutzfeldt-Jakob disease in humans, scrapie in sheep, and of the so-called yeast prions, inherited non-chromosomal elements found in yeast and fungi. Scanning transmission electron microscopy (STEM) is often used to delineate the assembly mechanism and structural properties of amyloid aggregates. In this review we consider specifically contributions and limitations of STEM for the investigation of amyloid assembly pathways, fibril polymorphisms and structural models of amyloid fibrils. This type of microscopy provides the only method to directly measure the mass-per-length (MPL) of individual filaments. Made on both in vitro assembled and ex vivo samples, STEM mass measurements have illuminated the hierarchical relationships between amyloid fibrils and revealed that polymorphic fibrils and various globular oligomers can assemble simultaneously from a single polypeptide. The MPLs also impose strong constraints on possible packing schemes, assisting in molecular model building when combined with high-resolution methods like solid-state nuclear magnetic resonance (NMR) and electron paramagnetic resonance (EPR).

| S-EPMC3005892 | biostudies-literature

Nanomaterial datasets to advance tomography in scanning transmission electron microscopy.

Project description:Electron tomography in materials science has flourished with the demand to characterize nanoscale materials in three dimensions (3D). Access to experimental data is vital for developing and validating reconstruction methods that improve resolution and reduce radiation dose requirements. This work presents five high-quality scanning transmission electron microscope (STEM) tomography datasets in order to address the critical need for open access data in this field. The datasets represent the current limits of experimental technique, are of high quality, and contain materials with structural complexity. Included are tomographic series of a hyperbranched Co2P nanocrystal, platinum nanoparticles on a carbon nanofibre imaged over the complete 180° tilt range, a platinum nanoparticle and a tungsten needle both imaged at atomic resolution by equal slope tomography, and a through-focal tilt series of PtCu nanoparticles. A volumetric reconstruction from every dataset is provided for comparison and development of post-processing and visualization techniques. Researchers interested in creating novel data processing and reconstruction algorithms will now have access to state of the art experimental test data.

| S-EPMC4896123 | biostudies-literature

Scanning Electron Microscopy versus Transmission Electron Microscopy for Material Characterization: A Comparative Study on High-Strength Steels.

Project description:The microstructures of quenched and tempered steels have been traditionally explored by transmission electron microscopy (TEM) rather than scanning electron microscopy (SEM) since TEM offers the high resolution necessary to image the structural details that control the mechanical properties. However, scanning electron microscopes, apart from providing larger area coverage, are commonly available and cheaper to purchase and operate compared to TEM and have evolved considerably in terms of resolution. This work presents detailed comparison of the microstructure characterization of quenched and tempered high-strength steels with TEM and SEM electron channeling contrast techniques. For both techniques, similar conclusions were made in terms of large-scale distribution of martensite lath and plates and nanoscale observation of nanotwins and dislocation structures. These observations were completed with electron backscatter diffraction to assess the martensite size distribution and the retained austenite area fraction. Precipitation was characterized using secondary imaging in the SEM, and a deep learning method was used for image segmentation. In this way, carbide size, shape, and distribution were quantitatively measured down to a few nanometers and compared well with the TEM-based measurements. These encouraging results are intended to help the material science community develop characterization techniques at lower cost and higher statistical significance.

| S-EPMC8112914 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data