Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

A k-nearest neighbor space-time simulator with applications to large-scale wind and solar power modeling.

ABSTRACT: We develop and present a k-nearest neighbor space-time simulator that accounts for the spatiotemporal dependence in high-dimensional hydroclimatic fields (e.g., wind and solar) and can simulate synthetic realizations of arbitrary length. We illustrate how this statistical simulation tool can be used in the context of regional power system planning under a scenario of high reliance on wind and solar generation and when long historical records of wind and solar power generation potential are not available. We show how our simulation model can be used to assess the probability distribution of the severity and duration of energy "droughts" at the network scale that need to be managed by long-duration storage or alternate energy sources. We present this estimation of supply-side shortages for the Texas Interconnection.

SUBMITTER: Amonkar Y

PROVIDER: S-EPMC9058912 | biostudies-literature | 2022 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

A k-nearest neighbor space-time simulator with applications to large-scale wind and solar power modeling.

Amonkar Yash Y Farnham David J DJ Lall Upmanu U

Patterns (New York, N.Y.) 20220228 3

We develop and present a k-nearest neighbor space-time simulator that accounts for the spatiotemporal dependence in high-dimensional hydroclimatic fields (e.g., wind and solar) and can simulate synthetic realizations of arbitrary length. We illustrate how this statistical simulation tool can be used in the context of regional power system planning under a scenario of high reliance on wind and solar generation and when long historical records of wind and solar power generation potential are not a ...[more]

PMID: 35510191

Similar Datasets

Approximate nearest neighbor graph provides fast and efficient embedding with applications for large-scale biological data.

Project description:Dimension reduction (DR or embedding) algorithms such as t-SNE and UMAP have many applications in big data visualization but remain slow for large datasets. Here, we further improve the UMAP-like algorithms by (i) combining several aspects of t-SNE and UMAP to create a new DR algorithm; (ii) replacing its rate-limiting step, the K-nearest neighbor graph (K-NNG), with a Hierarchical Navigable Small World (HNSW) graph; and (iii) extending the functionality to DNA/RNA sequence data by combining HNSW with locality sensitive hashing algorithms (e.g. MinHash) for distance estimations among sequences. We also provide additional features including computation of local intrinsic dimension and hubness, which can reflect structures and properties of the underlying data that strongly affect the K-NNG accuracy, and thus the quality of the resulting embeddings. Our library, called annembed, is implemented, and fully parallelized in Rust and shows competitive accuracy compared to the popular UMAP-like algorithms. Additionally, we showcase the usefulness and scalability of our library with three real-world examples: visualizing a large-scale microbial genomic database, visualizing single-cell RNA sequencing data and metagenomic contig (or population) binning. Therefore, annembed can facilitate DR for several tasks for biological data analysis where distance computation is expensive or when there are millions to billions of data points to process.

| S-EPMC11655291 | biostudies-literature

Utilizing Curtailed Wind and Solar Power to Scale Up Electrolytic Hydrogen Production in Europe.

Project description:The growth of European wind and solar power capacity is associated with increasing electricity curtailment to manage excess generation and ensure safe network operations. Instead, this surplus electricity could be used to produce hydrogen, thereby reducing the need for fossil-fueled hydrogen production in ammonia and refining industries. Based on historical data, we estimate the potential for surplus electricity from wind and solar power for 27 countries across Europe. Following an optimization-based approach, we determine the cost-optimal design and operation of a system producing hydrogen from surplus electricity, including the option of battery and hydrogen storage. Two potential applications are analyzed: (1) a fuel-saving scenario, where electrolytic hydrogen substitutes fossil-fuel-derived hydrogen, whenever surplus electricity is available, and (2) a fuel-replacing scenario, where hydrogen from surplus electricity fully replaces a subset of fossil-fueled hydrogen production facilities. Our findings suggest that hydrogen from surplus electricity could substitute 30% (1.9 MtH2/y) of fossil hydrogen, reducing ammonia and refinery emissions by 18% (20 MtCO2/y). However, fully replacing fossil-fueled hydrogen production facilities increases hydrogen production costs substantially as it requires costly battery and/or hydrogen storage capacity to balance hydrogen production and supply. Nonetheless, about 19% (1.2 MtH2/y) of the fossil-fueled hydrogen production could be replaced cost-effectively.

| S-EPMC11866934 | biostudies-literature

A large-scale view of Space Technology 5 magnetometer response to solar wind drivers.

Project description:In this data report we discuss reprocessing of the Space Technology 5 (ST5) magnetometer database for inclusion in NASA's Coordinated Data Analysis Web (CDAWeb) virtual observatory. The mission consisted of three spacecraft flying in elliptical orbits, from 27 March to 27 June 2006. Reprocessing includes (1) transforming the data into the Modified Apex Coordinate System for projection to a common reference altitude of 110 km, (2) correcting gain jumps, and (3) validating the results. We display the averaged magnetic perturbations as a keogram, which allows direct comparison of the full-mission data with the solar wind values and geomagnetic indices. With the data referenced to a common altitude, we find the following: (1) Magnetic perturbations that track the passage of corotating interaction regions and high-speed solar wind; (2) unexpectedly strong dayside perturbations during a solstice magnetospheric sawtooth oscillation interval characterized by a radial interplanetary magnetic field (IMF) component that may have enhanced the accompanying modest southward IMF; and (3) intervals of reduced magnetic perturbations or "calms," associated with periods of slow solar wind, interspersed among variable-length episodic enhancements. These calms are most evident when the IMF is northward or projects with a northward component onto the geomagnetic dipole. The reprocessed ST5 data are in very good agreement with magnetic perturbations from the Defense Meteorological Satellite Program (DMSP) spacecraft, which we also map to 110 km. We briefly discuss the methods used to remap the ST5 data and the means of validating the results against DMSP. Our methods form the basis for future intermission comparisons of space-based magnetometer data.

| S-EPMC5125408 | biostudies-literature

Clonal Analysis of the Neonatal Mouse Heart using Nearest Neighbor Modeling.

Project description:By replacing lost or dysfunctional myocardium, tissue regeneration is a promising approach to treat heart failure. However, the challenge of detecting bona fide heart regeneration limits the validation of potential regenerative factors. One method to detect new cardiomyocytes is multicolor lineage tracing with clonal analysis. Clonal analysis experiments can be difficult to undertake, because labeling conditions that are too sparse lack sensitivity for rare events such as cardiomyocyte proliferation, and diffuse labeling limits the ability to resolve clones. Presented here is a protocol to undertake clonal analysis of the neonatal mouse heart by using statistical modeling of nearest neighbor distributions to resolve cardiomyocyte clones. This approach enables resolution of clones over a range of labeling conditions and provides a robust analytical approach for quantifying cardiomyocyte proliferation and regeneration. This protocol can be adapted to other tissues and can be broadly used to study tissue regeneration.

| S-EPMC7594646 | biostudies-literature

Large-scale tandem mass spectrum clustering using fast nearest neighbor searching.

Project description:RationaleAdvanced algorithmic solutions are necessary to process the ever-increasing amounts of mass spectrometry data that are being generated. In this study, we describe the falcon spectrum clustering tool for efficient clustering of millions of MS/MS spectra.Methodsfalcon succeeds in efficiently clustering large amounts of mass spectral data using advanced techniques for fast spectrum similarity searching. First, high-resolution spectra are binned and converted to low-dimensional vectors using feature hashing. Next, the spectrum vectors are used to construct nearest neighbor indexes for fast similarity searching. The nearest neighbor indexes are used to efficiently compute a sparse pairwise distance matrix without having to exhaustively perform all pairwise spectrum comparisons within the relevant precursor mass tolerance. Finally, density-based clustering is performed to group similar spectra into clusters.ResultsSeveral state-of-the-art spectrum clustering tools were evaluated using a large draft human proteome data set consisting of 25 million spectra, indicating that alternative tools produce clustering results with different characteristics. Notably, falcon generates larger highly pure clusters than alternative tools, leading to a larger reduction in data volume without the loss of relevant information for more efficient downstream processing.Conclusionsfalcon is a highly efficient spectrum clustering tool, which is publicly available as an open source under the permissive BSD license at https://github.com/bittremieux/falcon.

| S-EPMC8709870 | biostudies-literature

Open access repository-scale propagated nearest neighbor suspect spectral library for untargeted metabolomics.

Project description:Despite the increasing availability of tandem mass spectrometry (MS/MS) community spectral libraries for untargeted metabolomics over the past decade, the majority of acquired MS/MS spectra remain uninterpreted. To further aid in interpreting unannotated spectra, we created a nearest neighbor suspect spectral library, consisting of 87,916 annotated MS/MS spectra derived from hundreds of millions of MS/MS spectra originating from published untargeted metabolomics experiments. Entries in this library, or "suspects," were derived from unannotated spectra that could be linked in a molecular network to an annotated spectrum. Annotations were propagated to unknowns based on structural relationships to reference molecules using MS/MS-based spectrum alignment. We demonstrate the broad relevance of the nearest neighbor suspect spectral library through representative examples of propagation-based annotation of acylcarnitines, bacterial and plant natural products, and drug metabolism. Our results also highlight how the library can help to better understand an Alzheimer's brain phenotype. The nearest neighbor suspect spectral library is openly available for download or for data analysis through the GNPS platform to help investigators hypothesize candidate structures for unknown MS/MS spectra in untargeted metabolomics data.

| S-EPMC10733301 | biostudies-literature

The multi-scale nature of the solar wind.

Project description:The solar wind is a magnetized plasma and as such exhibits collective plasma behavior associated with its characteristic spatial and temporal scales. The characteristic length scales include the size of the heliosphere, the collisional mean free paths of all species, their inertial lengths, their gyration radii, and their Debye lengths. The characteristic timescales include the expansion time, the collision times, and the periods associated with gyration, waves, and oscillations. We review the past and present research into the multi-scale nature of the solar wind based on in-situ spacecraft measurements and plasma theory. We emphasize that couplings of processes across scales are important for the global dynamics and thermodynamics of the solar wind. We describe methods to measure in-situ properties of particles and fields. We then discuss the role of expansion effects, non-equilibrium distribution functions, collisions, waves, turbulence, and kinetic microinstabilities for the multi-scale plasma evolution.

| S-EPMC6934245 | biostudies-literature

A pre-averaged pseudo nearest neighbor classifier.

Project description:The k-nearest neighbor algorithm is a powerful classification method. However, its classification performance will be affected in small-size samples with existing outliers. To address this issue, a pre-averaged pseudo nearest neighbor classifier (PAPNN) is proposed to improve classification performance. In the PAPNN rule, the pre-averaged categorical vectors are calculated by taking the average of any two points of the training sets in each class. Then, k-pseudo nearest neighbors are chosen from the preprocessed vectors of every class to determine the category of a query point. The pre-averaged vectors can reduce the negative impact of outliers to some degree. Extensive experiments are conducted on nineteen numerical real data sets and three high dimensional real data sets by comparing PAPNN to other twelve classification methods. The experimental results demonstrate that the proposed PAPNN rule is effective for classification tasks in the case of small-size samples with existing outliers.

| S-EPMC11419614 | biostudies-literature

Geophysical constraints on the reliability of solar and wind power worldwide.

Project description:If future net-zero emissions energy systems rely heavily on solar and wind resources, spatial and temporal mismatches between resource availability and electricity demand may challenge system reliability. Using 39 years of hourly reanalysis data (1980-2018), we analyze the ability of solar and wind resources to meet electricity demand in 42 countries, varying the hypothetical scale and mix of renewable generation as well as energy storage capacity. Assuming perfect transmission and annual generation equal to annual demand, but no energy storage, we find the most reliable renewable electricity systems are wind-heavy and satisfy countries' electricity demand in 72-91% of hours (83-94% by adding 12 h of storage). Yet even in systems which meet >90% of demand, hundreds of hours of unmet demand may occur annually. Our analysis helps quantify the power, energy, and utilization rates of additional energy storage, demand management, or curtailment, as well as the benefits of regional aggregation.

| S-EPMC8536784 | biostudies-literature

Harmonised global datasets of wind and solar farm locations and power.

Project description:Energy systems need decarbonisation in order to limit global warming to within safe limits. While global land planners are promising more of the planet's limited space to wind and solar photovoltaic, there is little information on where current infrastructure is located. The majority of recent studies use land suitability for wind and solar, coupled with technical and socioeconomic constraints, as a proxy for actual location data. Here, we address this shortcoming. Using readily accessible OpenStreetMap data we present, to our knowledge, the first global, open-access, harmonised spatial datasets of wind and solar installations. We also include user friendly code to enable users to easily create newer versions of the dataset. Finally, we include first order estimates of power capacities of installations. We anticipate these data will be of widespread interest within global studies of the future potential and trade-offs associated with the global decarbonisation of energy systems.

| S-EPMC7190618 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data