Comparison of Different Neural Network Architectures for Plasmonic Inverse Design.
Ontology highlight
ABSTRACT:
SUBMITTER: Wu Q
PROVIDER: S-EPMC8444196 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Predicting physical response of an artificially structured material is of particular interest for scientific and engineering applications. Here we use deep learning to predict optical response of artificially engineered nanophotonic devices. In addition to predicting forward approximation of transmission response for any given topology, this approach allows us to inversely approximate designs for a targeted optical response. Our Deep Neural Network (DNN) could design compact (2.6 × 2.6 μm2) silicon-on-insulator (SOI)-based 1 × 2 power splitters with various target splitting ratios in a fraction of a second. This model is trained to minimize the reflection (to smaller than ~ -20 dB) while achieving maximum transmission efficiency above 90% and target splitting specifications. This approach paves the way for rapid design of integrated photonic components relying on complex nanostructures.
| S-EPMC6361971 | biostudies-literature
Project description:ObjectiveAttention networks learn an intelligent weighted averaging mechanism over a series of entities, providing increases to both performance and interpretability. In this article, we propose a novel time-aware transformer-based network and compare it to another leading model with similar characteristics. We also decompose model performance along several critical axes and examine which features contribute most to our model's performance.Materials and methodsUsing data sets representing patient records obtained between 2017 and 2019 by the Kaiser Permanente Mid-Atlantic States medical system, we construct four attentional models with varying levels of complexity on two targets (patient mortality and hospitalization). We examine how incorporating transfer learning and demographic features contribute to model success. We also test the performance of a model proposed in recent medical modeling literature. We compare these models with out-of-sample data using the area under the receiver-operator characteristic (AUROC) curve and average precision as measures of performance. We also analyze the attentional weights assigned by these models to patient diagnoses.ResultsWe found that our model significantly outperformed the alternative on a mortality prediction task (91.96% AUROC against 73.82% AUROC). Our model also outperformed on the hospitalization task, although the models were significantly more competitive in that space (82.41% AUROC against 80.33% AUROC). Furthermore, we found that demographic features and transfer learning features which are frequently omitted from new models proposed in the EMR modeling space contributed significantly to the success of our model.DiscussionWe proposed an original construction of deep learning electronic medical record models which achieved very strong performance. We found that our unique model construction outperformed on several tasks in comparison to a leading literature alternative, even when input data was held constant between them. We obtained further improvements by incorporating several methods that are frequently overlooked in new model proposals, suggesting that it will be useful to explore these options further in the future.
| S-EPMC8358476 | biostudies-literature
Project description:Noniridescent and nonfading structural colors generated from metallic and dielectric nanoparticles with extraordinary optical properties hold great promise in applications such as image display, color printing, and information security. Yet, due to the strong wavelength dependence of optical constants and the radiation pattern, it is difficult and time-consuming to design nanoparticles with the desired hue, saturation, and brightness. Herein, we combined the Monte Carlo and Mie scattering simulations and a bidirectional neural network (BNN) to improve the design of gold nanoparticles' structural colors. The optical simulations provided a dataset including color properties and geometric parameters of gold nanoparticle systems, while the BNN was proposed to accurately predict the structural colors of gold nanoparticle systems and inversely design the geometric parameters for the desired colors. Taking the human chromatic discrimination ability as a criterion, our proposed approach achieved a high accuracy of 99.83% on the predicted colors and 98.5% on the designed geometric parameters. This work provides a general method to accurately and efficiently design the structural colors of nanoparticle systems, which can be exploited in a variety of applications and contribute to the development of advanced optical materials.
| S-EPMC8703294 | biostudies-literature
Project description:This data manuscript presents a set of signals collected from the Llaima volcano located at the western edge of the Andes in Araucania Region, Chile. The signals were recorded from the LAV station between 2010 and 2016. After individually processing and analyzing every signal, specialists from the Observatorio Vulcanológico de los Andes Sur (OVDAS) classified them into four class according to their event source: i) Volcano-Tectonic (VT); ii) Long Period (LP); iii) Tremor (TR), and iv) Tectonic (TC). The dataset is composed of 3592 signals separated by class and filtered to select the segment that contains the most representative part of the seismic event. This dataset is important to support researchers interested in studying seismic signals from active volcanoes and developing new methods to model time-dependent data. In this sense, we have published the manuscript "In-Depth Comparison of Deep Artificial Neural Network Architectures on Seismic Events Classification" [1] analyzing such signals with different Deep Neural Networks (DNN). The main contribution of such manuscript is a new DNN architecture called SeismicNet, which provided classification results among the best in the literature without demanding explicit signal pre-processing steps. Therefore, the reader is referred to such manuscript for the interpretation of the data.
| S-EPMC7206203 | biostudies-literature
Project description:MotivationConvolutional neural networks (CNN) have outperformed conventional methods in modeling the sequence specificity of DNA-protein binding. Yet inappropriate CNN architectures can yield poorer performance than simpler models. Thus an in-depth understanding of how to match CNN architecture to a given task is needed to fully harness the power of CNNs for computational biology applications.ResultsWe present a systematic exploration of CNN architectures for predicting DNA sequence binding using a large compendium of transcription factor datasets. We identify the best-performing architectures by varying CNN width, depth and pooling designs. We find that adding convolutional kernels to a network is important for motif-based tasks. We show the benefits of CNNs in learning rich higher-order sequence features, such as secondary motifs and local sequence context, by comparing network performance on multiple modeling tasks ranging in difficulty. We also demonstrate how careful construction of sequence benchmark datasets, using approaches that control potentially confounding effects like positional or motif strength bias, is critical in making fair comparisons between competing methods. We explore how to establish the sufficiency of training data for these learning tasks, and we have created a flexible cloud-based framework that permits the rapid exploration of alternative neural network architectures for problems in computational biology.Availability and implementationAll the models analyzed are available at http://cnn.csail.mit.eduContactgifford@mit.eduSupplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC4908339 | biostudies-literature
Project description:Generating optimal nanomaterials using artificial neural networks can potentially lead to a notable revolution in future materials design. Although progress has been made in creating small and simple molecules, complex materials such as crystalline porous materials have yet to be generated using any of the neural networks. Here, we have implemented a generative adversarial network that uses a training set of 31,713 known zeolites to produce 121 crystalline porous materials. Our neural network takes in inputs in the form of energy and material dimensions, and we show that zeolites with a user-desired range of 4 kJ/mol methane heat of adsorption can be reliably produced using our neural network. The fine-tuning of user-desired capability can potentially accelerate materials development as it demonstrates a successful case of inverse design of porous materials.
| S-EPMC6941911 | biostudies-literature
Project description:We propose a method to use artificial neural networks to approximate light scattering by multilayer nanoparticles. We find that the network needs to be trained on only a small sampling of the data to approximate the simulation to high precision. Once the neural network is trained, it can simulate such optical processes orders of magnitude faster than conventional simulations. Furthermore, the trained neural network can be used to solve nanophotonic inverse design problems by using back propagation, where the gradient is analytical, not numerical.
| S-EPMC5983917 | biostudies-literature
Project description:Directly manipulating the atomic structure to achieve a specific property is a long pursuit in the field of materials. However, hindered by the disordered, non-prototypical glass structure and the complex interplay between structure and property, such inverse design is dauntingly hard for glasses. Here, combining two cutting-edge techniques, graph neural networks and swap Monte Carlo, we develop a data-driven, property-oriented inverse design route that managed to improve the plastic resistance of Cu-Zr metallic glasses in a controllable way. Swap Monte Carlo, as a sampler, effectively explores the glass landscape, and graph neural networks, with high regression accuracy in predicting the plastic resistance, serves as a decider to guide the search in configuration space. Via an unconventional strengthening mechanism, a geometrically ultra-stable yet energetically meta-stable state is unraveled, contrary to the common belief that the higher the energy, the lower the plastic resistance. This demonstrates a vast configuration space that can be easily overlooked by conventional atomistic simulations. The data-driven techniques, structural search methods and optimization algorithms consolidate to form a toolbox, paving a new way to the design of glassy materials.
| S-EPMC8429760 | biostudies-literature
Project description:Different polymer architectures behave differently regarding their dynamics. We have used a combination of dielectric spectroscopy, and fast field cycling nuclear magnetic resonance (NMR) to compare the dynamical behavior of two different polymer architectures, with similar overall molecular weight. The systems of interest are a bottlebrush polymer and a linear one, both based on poly(dimethylsiloxane) (PDMS). To verify the structure of the PDMS-g-PDMS bottlebrush in the melt, small-angle neutron scattering was used, yielding a spherical shape. Information about the segmental dynamics was revealed by dielectric spectroscopy and extended to higher temperatures by fast field cycling NMR. One advantage of fast field cycling NMR is the detection of large-scale chain dynamics, which dielectric spectroscopy cannot probe for PDMS. While segmental relaxation seems to be independent of the architecture, the large-scale chain dynamics show substantial differences, as represented by the mean square displacement. Here, two regions are detected for each polymer. The linear polymer shows the Rouse regime, followed by reptation. In contrast, the bottlebrush polymer performs Rouse dynamics and diffusion in the available time window, and entanglement effects are completely missing.
| S-EPMC7905874 | biostudies-literature
Project description:Pneumonitis is an infectious disease that causes the inflammation of the air sac. It can be life-threatening to the very young and elderly. Detection of pneumonitis from X-ray images is a significant challenge. Early detection and assistance with diagnosis can be crucial. Recent developments in the field of deep learning have significantly improved their performance in medical image analysis. The superior predictive performance of the deep learning methods makes them ideal for pneumonitis classification from chest X-ray images. However, training deep learning models can be cumbersome and resource-intensive. Reusing knowledge representations of public models trained on large-scale datasets through transfer learning can help alleviate these challenges. In this paper, we compare various image classification models based on transfer learning with well-known deep learning architectures. The Kaggle chest X-ray dataset was used to evaluate and compare our models. We apply basic data augmentation and fine-tune our feed-forward classification head on the models pretrained on the ImageNet dataset. We observed that the DenseNet201 model outperforms other models with an AUROC score of 0.966 and a recall score of 0.99. We also visualize the class activation maps from the DenseNet201 model to interpret the patterns recognized by the model for prediction.
| S-EPMC8452401 | biostudies-literature