Browse
Submit Data
Databases
API
Help

Dataset Information

30 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Clustered sparsity and Poisson-gap sampling.

ABSTRACT: Non-uniform sampling (NUS) is a popular way of reducing the amount of time taken by multidimensional NMR experiments. Among the various non-uniform sampling schemes that exist, the Poisson-gap (PG) schedules are particularly popular, especially when combined with compressed-sensing (CS) reconstruction of missing data points. However, the use of PG is based mainly on practical experience and has not, as yet, been explained in terms of CS theory. Moreover, an apparent contradiction exists between the reported effectiveness of PG and CS theory, which states that a "flat" pseudo-random generator is the best way to generate sampling schedules in order to reconstruct sparse spectra. In this paper we explain how, and in what situations, PG reveals its superior features in NMR spectroscopy. We support our theoretical considerations with simulations and analyses of experimental data from the Biological Magnetic Resonance Bank (BMRB). Our analyses reveal a previously unnoticed feature of many NMR spectra that explains the success of "blue-noise" schedules, such as PG. We call this feature "clustered sparsity". This refers to the fact that the peaks in NMR spectra are not just sparse but often form clusters in the indirect dimension, and PG is particularly suited to deal with such situations. Additionally, we discuss why denser sampling in the initial and final parts of the clustered signal may be useful.

SUBMITTER: Kasprzak P

PROVIDER: S-EPMC8642362 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Poisson-gap sampling and forward maximum entropy reconstruction for enhancing the resolution and sensitivity of protein NMR data.

Project description:The Fourier transform has been the gold standard for transforming data from the time domain to the frequency domain in many spectroscopic methods, including NMR spectroscopy. While reliable, it has the drawback that it requires a grid of uniformely sampled data points, which is not efficient for decaying signals, and it also suffers from artifacts when dealing with nondecaying signals. Over several decades, many alternative sampling and transformation schemes have been proposed. Their common problem is that relative signal amplitudes are not well-preserved. Here we demonstrate the superior performance of a sine-weighted Poisson-gap distribution sparse-sampling scheme combined with forward maximum entropy (FM) reconstruction. While the relative signal amplitudes are well-preserved, we also find that the signal-to-noise ratio is enhanced up to 4-fold per unit of data acquisition time relative to traditional linear sampling.

| S-EPMC2825045 | biostudies-literature

Deterministic multidimensional nonuniform gap sampling.

Project description:Born from empirical observations in nonuniformly sampled multidimensional NMR data relating to gaps between sampled points, the Poisson-gap sampling method has enjoyed widespread use in biomolecular NMR. While the majority of nonuniform sampling schemes are fully randomly drawn from probability densities that vary over a Nyquist grid, the Poisson-gap scheme employs constrained random deviates to minimize the gaps between sampled grid points. We describe a deterministic gap sampling method, based on the average behavior of Poisson-gap sampling, which performs comparably to its random counterpart with the additional benefit of completely deterministic behavior. We also introduce a general algorithm for multidimensional nonuniform sampling based on a gap equation, and apply it to yield a deterministic sampling scheme that combines burst-mode sampling features with those of Poisson-gap schemes. Finally, we derive a relationship between stochastic gap equations and the expectation value of their sampling probability densities.

| S-EPMC4970466 | biostudies-literature

Clustered mixed nonhomogeneous Poisson process spline models for the analysis of recurrent event panel data.

Project description:A flexible semiparametric model for analyzing longitudinal panel count data arising from mixtures is presented. Panel count data refers here to count data on recurrent events collected as the number of events that have occurred within specific follow-up periods. The model assumes that the counts for each subject are generated by mixtures of nonhomogeneous Poisson processes with smooth intensity functions modeled with penalized splines. Time-dependent covariate effects are also incorporated into the process intensity using splines. Discrete mixtures of these nonhomogeneous Poisson process spline models extract functional information from underlying clusters representing hidden subpopulations. The motivating application is an experiment to test the effectiveness of pheromones in disrupting the mating pattern of the cherry bark tortrix moth. Mature moths arise from hidden, but distinct, subpopulations and monitoring the subpopulation responses was of interest. Within-cluster random effects are used to account for correlation structures and heterogeneity common to this type of data. An estimating equation approach to inference requiring only low moment assumptions is developed and the finite sample properties of the proposed estimating functions are investigated empirically by simulation.

| S-EPMC2996855 | biostudies-literature

Poisson Statistics of Combinatorial Library Sampling Predict False Discovery Rates of Screening.

Project description:Microfluidic droplet-based screening of DNA-encoded one-bead-one-compound combinatorial libraries is a miniaturized, potentially widely distributable approach to small molecule discovery. In these screens, a microfluidic circuit distributes library beads into droplets of activity assay reagent, photochemically cleaves the compound from the bead, then incubates and sorts the droplets based on assay result for subsequent DNA sequencing-based hit compound structure elucidation. Pilot experimental studies revealed that Poisson statistics describe nearly all aspects of such screens, prompting the development of simulations to understand system behavior. Monte Carlo screening simulation data showed that increasing mean library sampling (ε), mean droplet occupancy, or library hit rate all increase the false discovery rate (FDR). Compounds identified as hits on k > 1 beads (the replicate k class) were much more likely to be authentic hits than singletons (k = 1), in agreement with previous findings. Here, we explain this observation by deriving an equation for authenticity, which reduces to the product of a library sampling bias term (exponential in k) and a sampling saturation term (exponential in ε) setting a threshold that the k-dependent bias must overcome. The equation thus quantitatively describes why each hit structure's FDR is based on its k class, and further predicts the feasibility of intentionally populating droplets with multiple library beads, assaying the micromixtures for function, and identifying the active members by statistical deconvolution.

| S-EPMC5558193 | biostudies-literature

Analyzing clustered count data with a cluster specific random effect zero-inflated Conway-Maxwell-Poisson distribution.

Project description:In recent years, data analysis techniques have been developed in biological and medical research areas with different types of count distributions. In particular, zero-inflated versions of parametric count distributions have been used to model excessive zeros that are often present in these assays. Perhaps, the most common count distribution which has been used for analyzing such data is the Poisson distribution. However, a Poisson distribution, having a single underlying parameter, cannot cope with any other data dispersion pattern besides equidispersion. A negative binomial distribution is capable of modeling overdispersed, but not underdispersed data. However, a Conway-Maxwell-Poisson (CMP) distribution (Conway, R. W., and Maxwell, W. L., 1962) can handle not only overdispersion but also underdispersion. We show with an illustrative data set on next generation sequencing of maize hybrids that both underdispersion and overdispersion can be present in genetic data. Furthermore, if count data consists of clustered observations, one of the most efficient statistical technique is to introduce a cluster specific random effect term. Once again, the maize hybrids data presents such a situation. We develop inference procedures for a zero-inflated CMP regression that incorporates a cluster specific random effect term. Unlike, the Gaussian models, the underlying likelihood is computationally challenging. We use a numerical approximation via a Gaussian quadrature to circumvent this issues. A test for checking zero-inflation has also been developed in our setting. Finite sample properties of our estimators and test have been investigated by extensive simulations. Finally, the statistical methodology has been applied to analyze the maize data mentioned before.

| S-EPMC6510495 | biostudies-literature

Marginal regression models for clustered count data based on zero-inflated Conway-Maxwell-Poisson distribution with applications.

Project description:Community water fluoridation is an important public health measure to prevent dental caries, but it continues to be somewhat controversial. The Iowa Fluoride Study (IFS) is a longitudinal study on a cohort of Iowa children that began in 1991. The main purposes of this study (http://www.dentistry.uiowa.edu/preventive-fluoride-study) were to quantify fluoride exposures from both dietary and nondietary sources and to associate longitudinal fluoride exposures with dental fluorosis (spots on teeth) and dental caries (cavities). We analyze a subset of the IFS data by a marginal regression model with a zero-inflated version of the Conway-Maxwell-Poisson distribution for count data exhibiting excessive zeros and a wide range of dispersion patterns. In general, we introduce two estimation methods for fitting a ZICMP marginal regression model. Finite sample behaviors of the estimators and the resulting confidence intervals are studied using extensive simulation studies. We apply our methodologies to the dental caries data. Our novel modeling incorporating zero inflation, clustering, and overdispersion sheds some new light on the effect of community water fluoridation and other factors. We also include a second application of our methodology to a genomic (next-generation sequencing) dataset that exhibits underdispersion.

| S-EPMC4948193 | biostudies-literature

"Gap hunting" to characterize clustered probe signals in Illumina methylation array data.

Project description:BackgroundThe Illumina 450k array has been widely used in epigenetic association studies. Current quality-control (QC) pipelines typically remove certain sets of probes, such as those containing a SNP or with multiple mapping locations. An additional set of potentially problematic probes are those with DNA methylation distributions characterized by two or more distinct clusters separated by gaps. Data-driven identification of such probes may offer additional insights for downstream analyses.ResultsWe developed a procedure, termed "gap hunting," to identify probes showing clustered distributions. Among 590 peripheral blood samples from the Study to Explore Early Development, we identified 11,007 "gap probes." The vast majority (9199) are likely attributed to an underlying SNP(s) or other variant in the probe, although SNP-affected probes exist that do not produce a gap signals. Specific factors predict which SNPs lead to gap signals, including type of nucleotide change, probe type, DNA strand, and overall methylation state. These expected effects are demonstrated in paired genotype and 450k data on the same samples. Gap probes can also serve as a surrogate for the local genetic sequence on a haplotype scale and can be used to adjust for population stratification.ConclusionsThe characteristics of gap probes reflect potentially informative biology. QC pipelines may benefit from an efficient data-driven approach that "flags" gap probes, rather than filtering such probes, followed by careful interpretation of downstream association analyses. Our results should translate directly to the recently released Illumina EPIC array given the similar chemistry and content design.

| S-EPMC5142147 | biostudies-literature

A Singular Value Decomposition based Maximal Poisson-disk Sampling for adaptive Digital Elevation Model simplification.

Project description:The proposed method is to do simplification for Digital Elevation Model (DEM), which uses a few of original nodes representing the terrain surface while maintaining the accuracy. The original DEM nodes are sampled using the Maximal Poisson-disk Sampling (MPS), in which, the disk's size of each sample is computed on basis of the Singular Value Decomposition (SVD). MPS can generate the hyper-uniformly distributed samples and was taken to do DEM adaptive sampling by being combined with the geodesic metric. However, the geodesic distance computation is complex and the requirement for memory is high. As such, this paper proposes an extension of the classic MPS based method for selecting quasi-randomly distributed points from DEM nodes based on the distribution of eigenvalues, accounting for surface heterogeneity. To achieve this objective, uniform MPS is conducted to sample the DEM nodes by setting the related disk radius to be inversely proportional to the local terrain complexity, which is defined as an index expressing the local terrain variation. Then, the geodesic metric related parameters are implicitly contained in the defined index. As a result, more samples are concentrated in the rugged regions, and vice versa. The proposed method shows better perfermance, at least the results are comparable with the geodesic distance based Poisson disk sampling method. Meanwhile, it greatly accelerates the sampling process and reduces the memory cost.

| S-EPMC7462260 | biostudies-literature

How many dinosaur species were there? Fossil bias and true richness estimated using a Poisson sampling model.

Project description:The fossil record is a rich source of information about biological diversity in the past. However, the fossil record is not only incomplete but has also inherent biases due to geological, physical, chemical and biological factors. Our knowledge of past life is also biased because of differences in academic and amateur interests and sampling efforts. As a result, not all individuals or species that lived in the past are equally likely to be discovered at any point in time or space. To reconstruct temporal dynamics of diversity using the fossil record, biased sampling must be explicitly taken into account. Here, we introduce an approach that uses the variation in the number of times each species is observed in the fossil record to estimate both sampling bias and true richness. We term our technique TRiPS (True Richness estimated using a Poisson Sampling model) and explore its robustness to violation of its assumptions via simulations. We then venture to estimate sampling bias and absolute species richness of dinosaurs in the geological stages of the Mesozoic. Using TRiPS, we estimate that 1936 (1543-2468) species of dinosaurs roamed the Earth during the Mesozoic. We also present improved estimates of species richness trajectories of the three major dinosaur clades: the sauropodomorphs, ornithischians and theropods, casting doubt on the Jurassic-Cretaceous extinction event and demonstrating that all dinosaur groups are subject to considerable sampling bias throughout the Mesozoic.

| S-EPMC4810813 | biostudies-literature

Time Clustered Sampling Can Inflate the Inferred Substitution Rate in Foot-And-Mouth Disease Virus Analyses.

Project description:With the emergence of analytical software for the inference of viral evolution, a number of studies have focused on estimating important parameters such as the substitution rate and the time to the most recent common ancestor (tMRCA) for rapidly evolving viruses. Coupled with an increasing abundance of sequence data sampled under widely different schemes, an effort to keep results consistent and comparable is needed. This study emphasizes commonly disregarded problems in the inference of evolutionary rates in viral sequence data when sampling is unevenly distributed on a temporal scale through a study of the foot-and-mouth (FMD) disease virus serotypes SAT 1 and SAT 2. Our study shows that clustered temporal sampling in phylogenetic analyses of FMD viruses will strongly bias the inferences of substitution rates and tMRCA because the inferred rates in such data sets reflect a rate closer to the mutation rate rather than the substitution rate. Estimating evolutionary parameters from viral sequences should be performed with due consideration of the differences in short-term and longer-term evolutionary processes occurring within sets of temporally sampled viruses, and studies should carefully consider how samples are combined.

| S-EPMC4667911 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data